Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250625 14:01:50.690109 11422 test_util.cc:276] Using random seed: -487393498
2025-06-25T14:01:50Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-06-25T14:01:50Z Disabled control of system clock
I20250625 14:01:50.707319 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.190:38199
--webserver_interface=127.11.39.190
--webserver_port=0
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250625 14:01:50.814479 11430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:01:50.814740 11430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:01:50.814785 11430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250625 14:01:50.818039 11430 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250625 14:01:50.818116 11430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:01:50.818138 11430 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250625 14:01:50.818156 11430 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250625 14:01:50.822089 11430 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.190:38199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.39.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.11430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:01:50.823338 11430 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:01:50.824532 11430 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 14:01:50.831964 11438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:50.832079 11430 server_base.cc:1048] running on GCE node
W20250625 14:01:50.832041 11436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:50.831975 11435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:50.832818 11430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:01:50.833806 11430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250625 14:01:50.834961 11430 hybrid_clock.cc:648] HybridClock initialized: now 1750860110834940 us; error 46 us; skew 500 ppm
I20250625 14:01:50.836967 11430 webserver.cc:469] Webserver started at http://127.11.39.190:38689/ using document root <none> and password file <none>
I20250625 14:01:50.837576 11430 fs_manager.cc:362] Metadata directory not provided
I20250625 14:01:50.837641 11430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:01:50.837831 11430 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 14:01:50.839571 11430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/instance:
uuid: "b569e7a9e38b4882a89092d98a2f1b9b"
format_stamp: "Formatted at 2025-06-25 14:01:50 on dist-test-slave-b81v"
I20250625 14:01:50.840101 11430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal/instance:
uuid: "b569e7a9e38b4882a89092d98a2f1b9b"
format_stamp: "Formatted at 2025-06-25 14:01:50 on dist-test-slave-b81v"
I20250625 14:01:50.843649 11430 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250625 14:01:50.846045 11444 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:50.847131 11430 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 14:01:50.847252 11430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
uuid: "b569e7a9e38b4882a89092d98a2f1b9b"
format_stamp: "Formatted at 2025-06-25 14:01:50 on dist-test-slave-b81v"
I20250625 14:01:50.847360 11430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:01:50.866956 11430 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 14:01:50.867717 11430 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:01:50.867930 11430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:01:50.875453 11430 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.190:38199
I20250625 14:01:50.875461 11496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.190:38199 every 8 connection(s)
I20250625 14:01:50.876611 11430 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/info.pb
I20250625 14:01:50.879400 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:50.883857 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 11430
I20250625 14:01:50.884045 11422 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal/instance
I20250625 14:01:50.884243 11497 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } has no permanent_uuid. Determining permanent_uuid...
I20250625 14:01:50.886029 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.189:44065
--webserver_interface=127.11.39.189
--webserver_port=0
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250625 14:01:50.897439 11497 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } has no permanent_uuid. Determining permanent_uuid...
W20250625 14:01:50.898435 11447 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.39.189:44065: connect: Connection refused (error 111)
W20250625 14:01:50.899360 11497 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.189:44065: Network error: Client connection negotiation failed: client connection to 127.11.39.189:44065: connect: Connection refused (error 111)
I20250625 14:01:50.948645 11497 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } attempt: 1
W20250625 14:01:50.950212 11497 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.189:44065: Network error: Client connection negotiation failed: client connection to 127.11.39.189:44065: connect: Connection refused (error 111)
W20250625 14:01:50.998807 11501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:01:50.999080 11501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:01:50.999128 11501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250625 14:01:51.002467 11501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250625 14:01:51.002543 11501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:01:51.002564 11501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250625 14:01:51.002583 11501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250625 14:01:51.006592 11501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.189:44065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.39.189
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.11501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:01:51.007736 11501 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:01:51.008912 11501 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 14:01:51.016072 11507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:51.016172 11508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:51.016093 11510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:51.016278 11501 server_base.cc:1048] running on GCE node
I20250625 14:01:51.016862 11501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:01:51.017819 11501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250625 14:01:51.018359 11497 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } attempt: 2
I20250625 14:01:51.019006 11501 hybrid_clock.cc:648] HybridClock initialized: now 1750860111018981 us; error 31 us; skew 500 ppm
W20250625 14:01:51.019941 11497 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.189:44065: Network error: Client connection negotiation failed: client connection to 127.11.39.189:44065: connect: Connection refused (error 111)
I20250625 14:01:51.021289 11501 webserver.cc:469] Webserver started at http://127.11.39.189:42365/ using document root <none> and password file <none>
I20250625 14:01:51.021869 11501 fs_manager.cc:362] Metadata directory not provided
I20250625 14:01:51.021926 11501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:01:51.022104 11501 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 14:01:51.023896 11501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/data/instance:
uuid: "9b19d4bb9dd34b4c92dd939a17482334"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.024407 11501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/wal/instance:
uuid: "9b19d4bb9dd34b4c92dd939a17482334"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.028115 11501 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20250625 14:01:51.030581 11516 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:51.031697 11501 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 14:01:51.031831 11501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/wal
uuid: "9b19d4bb9dd34b4c92dd939a17482334"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.031936 11501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:01:51.049202 11501 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 14:01:51.049932 11501 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:01:51.050145 11501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:01:51.057610 11501 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.189:44065
I20250625 14:01:51.057615 11568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.189:44065 every 8 connection(s)
I20250625 14:01:51.058756 11501 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/data/info.pb
I20250625 14:01:51.061461 11569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:51.063850 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 11501
I20250625 14:01:51.063959 11422 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-1/wal/instance
I20250625 14:01:51.064586 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.188:43359
--webserver_interface=127.11.39.188
--webserver_port=0
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250625 14:01:51.065105 11569 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } has no permanent_uuid. Determining permanent_uuid...
I20250625 14:01:51.075086 11569 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } has no permanent_uuid. Determining permanent_uuid...
I20250625 14:01:51.081945 11569 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } has no permanent_uuid. Determining permanent_uuid...
W20250625 14:01:51.082825 11517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
W20250625 14:01:51.083678 11569 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.188:43359: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
I20250625 14:01:51.111107 11497 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } attempt: 3
I20250625 14:01:51.115676 11497 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } has no permanent_uuid. Determining permanent_uuid...
W20250625 14:01:51.117120 11497 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.188:43359: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
I20250625 14:01:51.132949 11569 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } attempt: 1
W20250625 14:01:51.134508 11569 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.188:43359: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
I20250625 14:01:51.148335 11497 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } attempt: 1
W20250625 14:01:51.149991 11497 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.188:43359: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
W20250625 14:01:51.183740 11571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:01:51.183998 11571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:01:51.184041 11571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250625 14:01:51.187427 11571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250625 14:01:51.187508 11571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:01:51.187530 11571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250625 14:01:51.187563 11571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250625 14:01:51.191630 11571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.188:43359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.39.188
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.11571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:01:51.192842 11571 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:01:51.194075 11571 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 14:01:51.201385 11580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:51.201440 11571 server_base.cc:1048] running on GCE node
W20250625 14:01:51.201385 11582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:51.201385 11579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:51.202157 11571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:01:51.202709 11569 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } attempt: 2
I20250625 14:01:51.203291 11571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20250625 14:01:51.203998 11569 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.188:43359: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
I20250625 14:01:51.204455 11571 hybrid_clock.cc:648] HybridClock initialized: now 1750860111204431 us; error 41 us; skew 500 ppm
I20250625 14:01:51.206454 11571 webserver.cc:469] Webserver started at http://127.11.39.188:37561/ using document root <none> and password file <none>
I20250625 14:01:51.207053 11571 fs_manager.cc:362] Metadata directory not provided
I20250625 14:01:51.207113 11571 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:01:51.207327 11571 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 14:01:51.209018 11571 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/instance:
uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.209517 11571 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal/instance:
uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.213100 11571 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20250625 14:01:51.215389 11588 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:51.216427 11571 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:51.216538 11571 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.216638 11571 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:01:51.225201 11497 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } attempt: 2
W20250625 14:01:51.226665 11497 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.39.188:43359: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
I20250625 14:01:51.239153 11571 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 14:01:51.239857 11571 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:01:51.240029 11571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:01:51.247700 11571 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.188:43359
I20250625 14:01:51.247720 11640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.188:43359 every 8 connection(s)
I20250625 14:01:51.248848 11571 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
I20250625 14:01:51.250867 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 11571
I20250625 14:01:51.250980 11422 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal/instance
I20250625 14:01:51.251762 11641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:51.255936 11641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } has no permanent_uuid. Determining permanent_uuid...
I20250625 14:01:51.264277 11641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } has no permanent_uuid. Determining permanent_uuid...
I20250625 14:01:51.269219 11641 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } has no permanent_uuid. Determining permanent_uuid...
I20250625 14:01:51.275460 11641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Bootstrap starting.
I20250625 14:01:51.277848 11641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:51.278779 11641 log.cc:826] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Log is configured to *not* fsync() on all Append() calls
I20250625 14:01:51.280460 11641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: No bootstrap required, opened a new log
I20250625 14:01:51.283339 11641 raft_consensus.cc:357] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.283543 11641 raft_consensus.cc:383] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:51.283594 11641 raft_consensus.cc:738] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac8e2e2cf5c4faea7755bbad7d23d99, State: Initialized, Role: FOLLOWER
I20250625 14:01:51.284044 11641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.284526 11649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.284643 11649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:51.285187 11641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: configured and running, proceeding with master startup.
W20250625 14:01:51.290244 11660 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250625 14:01:51.290411 11660 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250625 14:01:51.289678 11571 master_runner.cc:186] Error getting master registration for 127.11.39.190:38199: OK, instance_id { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" instance_seqno: 1750860110873262 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250625 14:01:51.291435 11571 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250625 14:01:51.295176 11569 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } attempt: 3
I20250625 14:01:51.303172 11569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Bootstrap starting.
I20250625 14:01:51.306223 11569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:51.307246 11569 log.cc:826] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Log is configured to *not* fsync() on all Append() calls
I20250625 14:01:51.309398 11569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: No bootstrap required, opened a new log
I20250625 14:01:51.313375 11569 raft_consensus.cc:357] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.313616 11569 raft_consensus.cc:383] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:51.313668 11569 raft_consensus.cc:738] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b19d4bb9dd34b4c92dd939a17482334, State: Initialized, Role: FOLLOWER
I20250625 14:01:51.314241 11569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.315660 11569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: configured and running, proceeding with master startup.
I20250625 14:01:51.316241 11663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.316465 11663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: FOLLOWER
W20250625 14:01:51.321219 11674 catalog_manager.cc:1560] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250625 14:01:51.321458 11674 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250625 14:01:51.319501 11501 master_runner.cc:186] Error getting master registration for 127.11.39.190:38199: OK, instance_id { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" instance_seqno: 1750860110873262 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250625 14:01:51.322016 11501 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250625 14:01:51.325884 11497 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } attempt: 3
I20250625 14:01:51.336146 11497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: Bootstrap starting.
I20250625 14:01:51.339213 11497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:51.340474 11497 log.cc:826] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: Log is configured to *not* fsync() on all Append() calls
I20250625 14:01:51.342782 11497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: No bootstrap required, opened a new log
I20250625 14:01:51.346376 11497 raft_consensus.cc:357] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.346621 11497 raft_consensus.cc:383] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:51.346717 11497 raft_consensus.cc:738] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b569e7a9e38b4882a89092d98a2f1b9b, State: Initialized, Role: FOLLOWER
I20250625 14:01:51.347277 11497 consensus_queue.cc:260] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.347787 11677 sys_catalog.cc:455] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.348019 11677 sys_catalog.cc:458] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:51.348670 11497 sys_catalog.cc:564] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: configured and running, proceeding with master startup.
W20250625 14:01:51.355255 11688 catalog_manager.cc:1560] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250625 14:01:51.355468 11688 catalog_manager.cc:875] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250625 14:01:51.358235 11430 master_runner.cc:263] No leader master found from master b569e7a9e38b4882a89092d98a2f1b9b
I20250625 14:01:51.358378 11430 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250625 14:01:51.369534 11450 tablet.cc:2378] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20250625 14:01:51.491384 11594 tablet.cc:2378] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20250625 14:01:51.551633 11522 tablet.cc:2378] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250625 14:01:51.582329 11663 raft_consensus.cc:491] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:51.582569 11663 raft_consensus.cc:513] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.583674 11663 leader_election.cc:290] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b569e7a9e38b4882a89092d98a2f1b9b (127.11.39.190:38199), 4ac8e2e2cf5c4faea7755bbad7d23d99 (127.11.39.188:43359)
I20250625 14:01:51.584048 11471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b19d4bb9dd34b4c92dd939a17482334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" is_pre_election: true
I20250625 14:01:51.584404 11471 raft_consensus.cc:2466] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b19d4bb9dd34b4c92dd939a17482334 in term 0.
I20250625 14:01:51.584841 11520 leader_election.cc:304] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b19d4bb9dd34b4c92dd939a17482334, b569e7a9e38b4882a89092d98a2f1b9b; no voters:
I20250625 14:01:51.584885 11615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b19d4bb9dd34b4c92dd939a17482334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" is_pre_election: true
I20250625 14:01:51.585150 11663 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:51.585201 11615 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b19d4bb9dd34b4c92dd939a17482334 in term 0.
I20250625 14:01:51.585239 11663 raft_consensus.cc:491] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:51.585296 11663 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:51.586334 11663 raft_consensus.cc:513] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.586685 11663 leader_election.cc:290] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [CANDIDATE]: Term 1 election: Requested vote from peers b569e7a9e38b4882a89092d98a2f1b9b (127.11.39.190:38199), 4ac8e2e2cf5c4faea7755bbad7d23d99 (127.11.39.188:43359)
I20250625 14:01:51.587066 11471 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b19d4bb9dd34b4c92dd939a17482334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b569e7a9e38b4882a89092d98a2f1b9b"
I20250625 14:01:51.587049 11615 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9b19d4bb9dd34b4c92dd939a17482334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99"
I20250625 14:01:51.587185 11615 raft_consensus.cc:3058] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:51.587195 11471 raft_consensus.cc:3058] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:51.588111 11471 raft_consensus.cc:2466] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b19d4bb9dd34b4c92dd939a17482334 in term 1.
I20250625 14:01:51.588143 11615 raft_consensus.cc:2466] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b19d4bb9dd34b4c92dd939a17482334 in term 1.
I20250625 14:01:51.588433 11517 leader_election.cc:304] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac8e2e2cf5c4faea7755bbad7d23d99, 9b19d4bb9dd34b4c92dd939a17482334; no voters:
I20250625 14:01:51.588608 11663 raft_consensus.cc:2802] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:51.588785 11663 raft_consensus.cc:695] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [term 1 LEADER]: Becoming Leader. State: Replica: 9b19d4bb9dd34b4c92dd939a17482334, State: Running, Role: LEADER
I20250625 14:01:51.589089 11663 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:51.590938 11690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b19d4bb9dd34b4c92dd939a17482334. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.591050 11690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
I20250625 14:01:51.591413 11692 catalog_manager.cc:1477] Loading table and tablet metadata into memory...
I20250625 14:01:51.592303 11692 catalog_manager.cc:1486] Initializing Kudu cluster ID...
I20250625 14:01:51.596771 11471 raft_consensus.cc:1273] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 1 FOLLOWER]: Refusing update from remote peer 9b19d4bb9dd34b4c92dd939a17482334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:51.596771 11615 raft_consensus.cc:1273] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 1 FOLLOWER]: Refusing update from remote peer 9b19d4bb9dd34b4c92dd939a17482334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:51.597462 11663 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:51.597637 11690 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:51.601440 11677 sys_catalog.cc:455] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b19d4bb9dd34b4c92dd939a17482334. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.601459 11649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b19d4bb9dd34b4c92dd939a17482334. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.601579 11649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:51.601579 11677 sys_catalog.cc:458] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:51.603564 11663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.603626 11690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.603710 11663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
I20250625 14:01:51.603715 11690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
I20250625 14:01:51.604167 11677 sys_catalog.cc:455] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.604285 11677 sys_catalog.cc:458] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:51.604542 11695 mvcc.cc:204] Tried to move back new op lower bound from 7171523017093722112 to 7171523017071321088. Current Snapshot: MvccSnapshot[applied={T|T < 7171523017093722112}]
I20250625 14:01:51.604586 11649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:51.604701 11649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:51.605469 11692 catalog_manager.cc:1349] Generated new cluster ID: a3a3501b615546dbb967e53684a94696
I20250625 14:01:51.605540 11692 catalog_manager.cc:1497] Initializing Kudu internal certificate authority...
I20250625 14:01:51.637753 11692 catalog_manager.cc:1372] Generated new certificate authority record
I20250625 14:01:51.638931 11692 catalog_manager.cc:1506] Loading token signing keys...
I20250625 14:01:51.645701 11692 catalog_manager.cc:5955] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Generated new TSK 0
I20250625 14:01:51.646621 11692 catalog_manager.cc:1516] Initializing in-progress tserver states...
I20250625 14:01:51.665012 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.39.129:0
--local_ip_for_outbound_sockets=127.11.39.129
--webserver_interface=127.11.39.129
--webserver_port=0
--tserver_master_addrs=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20250625 14:01:51.777479 11702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:01:51.777738 11702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:01:51.777792 11702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250625 14:01:51.781555 11702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:01:51.781697 11702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.39.129
I20250625 14:01:51.785748 11702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.39.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.39.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--never_fsync=true
--heap_profile_path=/tmp/kudu.11702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.39.129
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:01:51.786988 11702 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:01:51.788192 11702 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 14:01:51.796263 11708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:51.796378 11710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:51.796450 11702 server_base.cc:1048] running on GCE node
W20250625 14:01:51.796295 11707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:51.796929 11702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:01:51.797498 11702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250625 14:01:51.798645 11702 hybrid_clock.cc:648] HybridClock initialized: now 1750860111798632 us; error 30 us; skew 500 ppm
I20250625 14:01:51.800698 11702 webserver.cc:469] Webserver started at http://127.11.39.129:38269/ using document root <none> and password file <none>
I20250625 14:01:51.801272 11702 fs_manager.cc:362] Metadata directory not provided
I20250625 14:01:51.801327 11702 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:01:51.801489 11702 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 14:01:51.803205 11702 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/data/instance:
uuid: "56419e38d8e34f6985d4d970c1ce76e5"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.803682 11702 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/instance:
uuid: "56419e38d8e34f6985d4d970c1ce76e5"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.807233 11702 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250625 14:01:51.809608 11716 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:51.810696 11702 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250625 14:01:51.810806 11702 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal
uuid: "56419e38d8e34f6985d4d970c1ce76e5"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.810914 11702 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:01:51.830711 11702 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 14:01:51.831389 11702 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:01:51.831544 11702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:01:51.832094 11702 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 14:01:51.833101 11702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 14:01:51.833153 11702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:51.833217 11702 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 14:01:51.833253 11702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:51.842335 11702 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.129:44223
I20250625 14:01:51.842366 11829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.129:44223 every 8 connection(s)
I20250625 14:01:51.843314 11702 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/data/info.pb
I20250625 14:01:51.851233 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 11702
I20250625 14:01:51.851377 11422 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/instance
I20250625 14:01:51.854082 11832 heartbeater.cc:344] Connected to a master server at 127.11.39.189:44065
I20250625 14:01:51.854054 11830 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:51.854413 11832 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:51.854431 11831 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:01:51.854509 11831 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:51.855047 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.39.130:0
--local_ip_for_outbound_sockets=127.11.39.130
--webserver_interface=127.11.39.130
--webserver_port=0
--tserver_master_addrs=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250625 14:01:51.855163 11831 heartbeater.cc:507] Master 127.11.39.190:38199 requested a full tablet report, sending...
I20250625 14:01:51.855167 11832 heartbeater.cc:507] Master 127.11.39.189:44065 requested a full tablet report, sending...
I20250625 14:01:51.854413 11830 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:51.855952 11830 heartbeater.cc:507] Master 127.11.39.188:43359 requested a full tablet report, sending...
I20250625 14:01:51.856760 11461 ts_manager.cc:194] Registered new tserver with Master: 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:51.856760 11533 ts_manager.cc:194] Registered new tserver with Master: 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:51.857028 11605 ts_manager.cc:194] Registered new tserver with Master: 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:51.858065 11533 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.39.129:57127
W20250625 14:01:51.972481 11840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:01:51.972740 11840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:01:51.972800 11840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250625 14:01:51.976143 11840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:01:51.976286 11840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.39.130
I20250625 14:01:51.980254 11840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.39.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.39.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--never_fsync=true
--heap_profile_path=/tmp/kudu.11840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.39.130
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:01:51.981374 11840 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:01:51.982519 11840 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 14:01:51.990752 11845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:51.990758 11848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:51.990752 11846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:51.990998 11840 server_base.cc:1048] running on GCE node
I20250625 14:01:51.991497 11840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:01:51.992120 11840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250625 14:01:51.993294 11840 hybrid_clock.cc:648] HybridClock initialized: now 1750860111993270 us; error 42 us; skew 500 ppm
I20250625 14:01:51.995489 11840 webserver.cc:469] Webserver started at http://127.11.39.130:46293/ using document root <none> and password file <none>
I20250625 14:01:51.996126 11840 fs_manager.cc:362] Metadata directory not provided
I20250625 14:01:51.996199 11840 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:01:51.996409 11840 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 14:01:51.998178 11840 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/data/instance:
uuid: "bfff52620fea460d850827814b790c35"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:51.998764 11840 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/instance:
uuid: "bfff52620fea460d850827814b790c35"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:52.002445 11840 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250625 14:01:52.004835 11854 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:52.005913 11840 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:52.006037 11840 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal
uuid: "bfff52620fea460d850827814b790c35"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:52.006138 11840 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:01:52.027503 11840 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 14:01:52.028198 11840 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:01:52.028385 11840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:01:52.028926 11840 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 14:01:52.029937 11840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 14:01:52.029989 11840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:52.030056 11840 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 14:01:52.030083 11840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:52.039103 11840 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.130:45381
I20250625 14:01:52.039149 11967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.130:45381 every 8 connection(s)
I20250625 14:01:52.040146 11840 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/data/info.pb
I20250625 14:01:52.043409 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 11840
I20250625 14:01:52.043525 11422 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/instance
I20250625 14:01:52.046103 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.39.131:0
--local_ip_for_outbound_sockets=127.11.39.131
--webserver_interface=127.11.39.131
--webserver_port=0
--tserver_master_addrs=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250625 14:01:52.052223 11970 heartbeater.cc:344] Connected to a master server at 127.11.39.189:44065
I20250625 14:01:52.052521 11970 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:52.052587 11968 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:52.052981 11968 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:52.053216 11970 heartbeater.cc:507] Master 127.11.39.189:44065 requested a full tablet report, sending...
I20250625 14:01:52.053277 11968 heartbeater.cc:507] Master 127.11.39.188:43359 requested a full tablet report, sending...
I20250625 14:01:52.053735 11969 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:01:52.053812 11969 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:52.054019 11969 heartbeater.cc:507] Master 127.11.39.190:38199 requested a full tablet report, sending...
I20250625 14:01:52.054445 11533 ts_manager.cc:194] Registered new tserver with Master: bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.054482 11605 ts_manager.cc:194] Registered new tserver with Master: bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.055051 11461 ts_manager.cc:194] Registered new tserver with Master: bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.055133 11533 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.39.130:43215
W20250625 14:01:52.161489 11975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:01:52.161746 11975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:01:52.161803 11975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250625 14:01:52.165359 11975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:01:52.165508 11975 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.39.131
I20250625 14:01:52.169713 11975 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.39.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.39.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--never_fsync=true
--heap_profile_path=/tmp/kudu.11975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.39.131
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:01:52.170970 11975 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:01:52.172174 11975 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250625 14:01:52.180308 11983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:52.180387 11981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:52.180320 11980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:52.180477 11975 server_base.cc:1048] running on GCE node
I20250625 14:01:52.181017 11975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:01:52.181648 11975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250625 14:01:52.182809 11975 hybrid_clock.cc:648] HybridClock initialized: now 1750860112182796 us; error 30 us; skew 500 ppm
I20250625 14:01:52.185019 11975 webserver.cc:469] Webserver started at http://127.11.39.131:46051/ using document root <none> and password file <none>
I20250625 14:01:52.185624 11975 fs_manager.cc:362] Metadata directory not provided
I20250625 14:01:52.185683 11975 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:01:52.185876 11975 server_base.cc:896] This appears to be a new deployment of Kudu; creating new FS layout
I20250625 14:01:52.187626 11975 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/data/instance:
uuid: "87a003e25dbf461ebec24a29ad7016ed"
format_stamp: "Formatted at 2025-06-25 14:01:52 on dist-test-slave-b81v"
I20250625 14:01:52.188140 11975 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/instance:
uuid: "87a003e25dbf461ebec24a29ad7016ed"
format_stamp: "Formatted at 2025-06-25 14:01:52 on dist-test-slave-b81v"
I20250625 14:01:52.191720 11975 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250625 14:01:52.194096 11989 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:52.195225 11975 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250625 14:01:52.195353 11975 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal
uuid: "87a003e25dbf461ebec24a29ad7016ed"
format_stamp: "Formatted at 2025-06-25 14:01:52 on dist-test-slave-b81v"
I20250625 14:01:52.195465 11975 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:01:52.219574 11975 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 14:01:52.220238 11975 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:01:52.220417 11975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:01:52.221004 11975 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250625 14:01:52.222074 11975 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250625 14:01:52.222123 11975 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:52.222165 11975 ts_tablet_manager.cc:610] Registered 0 tablets
I20250625 14:01:52.222182 11975 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:52.231451 11975 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.131:34921
I20250625 14:01:52.231487 12102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.131:34921 every 8 connection(s)
I20250625 14:01:52.232470 11975 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/data/info.pb
I20250625 14:01:52.233764 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 11975
I20250625 14:01:52.233886 11422 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/instance
I20250625 14:01:52.243649 12103 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:52.243669 12104 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:01:52.243929 12103 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:52.243930 12104 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:52.243954 12105 heartbeater.cc:344] Connected to a master server at 127.11.39.189:44065
I20250625 14:01:52.244125 12105 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:52.244655 12105 heartbeater.cc:507] Master 127.11.39.189:44065 requested a full tablet report, sending...
I20250625 14:01:52.244663 12103 heartbeater.cc:507] Master 127.11.39.188:43359 requested a full tablet report, sending...
I20250625 14:01:52.244669 12104 heartbeater.cc:507] Master 127.11.39.190:38199 requested a full tablet report, sending...
I20250625 14:01:52.245796 11533 ts_manager.cc:194] Registered new tserver with Master: 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.245973 11461 ts_manager.cc:194] Registered new tserver with Master: 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.246433 11533 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.39.131:54515
I20250625 14:01:52.246938 11605 ts_manager.cc:194] Registered new tserver with Master: 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.255146 11422 external_mini_cluster.cc:934] 3 TS(s) registered with all masters
I20250625 14:01:52.270478 11422 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu with pid 11571
I20250625 14:01:52.272400 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ab0fb893ecd94fd7bd28e6772ed838c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.273800 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab0fb893ecd94fd7bd28e6772ed838c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.273968 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e31a56a40a9e49c1a23ebf90791f2fe1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.274353 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e31a56a40a9e49c1a23ebf90791f2fe1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.274616 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_149ab38510c248b4b403c6bba396f22c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.274914 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_149ab38510c248b4b403c6bba396f22c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.275823 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2b99b1d92f1047e0affb69f9130ad766"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.276176 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b99b1d92f1047e0affb69f9130ad766 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.276854 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4c7ae17a6ef44001ba81ff86d9276907"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.277179 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c7ae17a6ef44001ba81ff86d9276907 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.278123 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2a5aa8c6421c4cdcbee5ea770c94da81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.278475 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a5aa8c6421c4cdcbee5ea770c94da81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.279067 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_989eba9d138a4cb7806ef29740f3ce90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.279354 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_989eba9d138a4cb7806ef29740f3ce90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.280071 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cc2a6604d70349789a16670755d519a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.280339 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc2a6604d70349789a16670755d519a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.272432 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_af2719c0ad2349c0a5b3cb3c347b9fb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.281806 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af2719c0ad2349c0a5b3cb3c347b9fb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.272399 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d97884d7badc4d1db97406ac3208b3a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.282641 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d97884d7badc4d1db97406ac3208b3a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:52.284866 11517 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 -> Peer 4ac8e2e2cf5c4faea7755bbad7d23d99 (127.11.39.188:43359): Couldn't send request to peer 4ac8e2e2cf5c4faea7755bbad7d23d99. Status: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:52.290457 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ab0fb893ecd94fd7bd28e6772ed838c6" } new_table_name: "default.Table_fc5b526753c6429f8f3a535557f09381" modify_external_catalogs: true
I20250625 14:01:52.291303 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_149ab38510c248b4b403c6bba396f22c" } modify_external_catalogs: true
I20250625 14:01:52.292620 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_149ab38510c248b4b403c6bba396f22c" } modify_external_catalogs: true
I20250625 14:01:52.295187 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_989eba9d138a4cb7806ef29740f3ce90" } new_table_name: "default.Table_d93251dc77c743b5b8dea7a7f7a6b738" modify_external_catalogs: true
I20250625 14:01:52.295367 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2b99b1d92f1047e0affb69f9130ad766" } new_table_name: "default.Table_0003a9521c894d7bbe2377ba2912a633" modify_external_catalogs: true
I20250625 14:01:52.295401 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4c7ae17a6ef44001ba81ff86d9276907" } modify_external_catalogs: true
I20250625 14:01:52.295511 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4c7ae17a6ef44001ba81ff86d9276907" } modify_external_catalogs: true
I20250625 14:01:52.296361 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e31a56a40a9e49c1a23ebf90791f2fe1" } new_table_name: "default.Table_b600fb8d9d0f485182805e01002284c0" modify_external_catalogs: true
I20250625 14:01:52.297154 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2a5aa8c6421c4cdcbee5ea770c94da81" } new_table_name: "default.Table_84840e9c91d943969b62a478c6d7c2e2" modify_external_catalogs: true
I20250625 14:01:52.297238 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cc2a6604d70349789a16670755d519a0" } modify_external_catalogs: true
I20250625 14:01:52.297328 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cc2a6604d70349789a16670755d519a0" } modify_external_catalogs: true
I20250625 14:01:52.297362 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_af2719c0ad2349c0a5b3cb3c347b9fb4" } modify_external_catalogs: true
I20250625 14:01:52.297451 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_af2719c0ad2349c0a5b3cb3c347b9fb4" } modify_external_catalogs: true
I20250625 14:01:52.297909 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d97884d7badc4d1db97406ac3208b3a5" } modify_external_catalogs: true
I20250625 14:01:52.298004 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d97884d7badc4d1db97406ac3208b3a5" } modify_external_catalogs: true
W20250625 14:01:52.302356 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22c1000d243b415e91d2218566135f95 consensus state has no leader
W20250625 14:01:52.305967 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b578aeacb9743eb8c66de64117e54c0 has no consensus state
I20250625 14:01:52.307555 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 6a286a99e31142b28c4739c287bbb269 (DEFAULT_TABLE table=default.Table_149ab38510c248b4b403c6bba396f22c [id=615344d290894f08b268455ab5fba96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.308204 11532 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 5e362cac968e42faae3e61945b189843
I20250625 14:01:52.308343 11525 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 582054bb933d4522bb08abd4223eabdb
I20250625 14:01:52.308782 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a286a99e31142b28c4739c287bbb269. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.309340 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 22c1000d243b415e91d2218566135f95 (DEFAULT_TABLE table=default.Table_ab0fb893ecd94fd7bd28e6772ed838c6 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.309684 11528 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 25d7a1e2fdda455d80ec0a100b0e612a
W20250625 14:01:52.309957 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f8b967cff8e4af88a30ee6b132833bd has no consensus state
W20250625 14:01:52.310253 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8755a0ff70714ad6b274750f148e04ac has no consensus state
I20250625 14:01:52.311230 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c1000d243b415e91d2218566135f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.313527 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 22c1000d243b415e91d2218566135f95 (DEFAULT_TABLE table=default.Table_ab0fb893ecd94fd7bd28e6772ed838c6 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.314061 11527 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 8a934e4790c441a9ba64190aacdcad3e
I20250625 14:01:52.314662 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c1000d243b415e91d2218566135f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.316913 12166 tablet_bootstrap.cc:492] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.313537 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 6a286a99e31142b28c4739c287bbb269 (DEFAULT_TABLE table=default.Table_149ab38510c248b4b403c6bba396f22c [id=615344d290894f08b268455ab5fba96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.318581 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a286a99e31142b28c4739c287bbb269. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.319725 12166 tablet_bootstrap.cc:654] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.320605 12166 log.cc:826] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: Log is configured to *not* fsync() on all Append() calls
I20250625 14:01:52.321410 12167 tablet_bootstrap.cc:492] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.323549 12166 tablet_bootstrap.cc:492] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.323770 12166 ts_tablet_manager.cc:1397] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20250625 14:01:52.324198 12167 tablet_bootstrap.cc:654] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.324991 12167 log.cc:826] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: Log is configured to *not* fsync() on all Append() calls
I20250625 14:01:52.325937 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 6a286a99e31142b28c4739c287bbb269 (DEFAULT_TABLE table=default.Table_149ab38510c248b4b403c6bba396f22c [id=615344d290894f08b268455ab5fba96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.326962 12167 tablet_bootstrap.cc:492] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.327047 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a286a99e31142b28c4739c287bbb269. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.325954 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 22c1000d243b415e91d2218566135f95 (DEFAULT_TABLE table=default.Table_ab0fb893ecd94fd7bd28e6772ed838c6 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.327167 12167 ts_tablet_manager.cc:1397] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20250625 14:01:52.327494 12166 raft_consensus.cc:357] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.327718 12166 raft_consensus.cc:383] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.327764 12166 raft_consensus.cc:738] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.327771 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c1000d243b415e91d2218566135f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.328248 12166 consensus_queue.cc:260] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.329170 12166 ts_tablet_manager.cc:1428] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250625 14:01:52.330137 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6a286a99e31142b28c4739c287bbb269
W20250625 14:01:52.331210 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 756ad485e4f3494db5cd66aa3a192a05 has no consensus state
I20250625 14:01:52.331050 12167 raft_consensus.cc:357] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.331293 12167 raft_consensus.cc:383] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.331388 12167 raft_consensus.cc:738] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.331911 12167 consensus_queue.cc:260] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:52.332391 11968 heartbeater.cc:646] Failed to heartbeat to 127.11.39.188:43359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
I20250625 14:01:52.333091 12167 ts_tablet_manager.cc:1428] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 14:01:52.333252 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a286a99e31142b28c4739c287bbb269 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.333448 12172 tablet_bootstrap.cc:492] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:52.335232 12103 heartbeater.cc:646] Failed to heartbeat to 127.11.39.188:43359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
I20250625 14:01:52.336189 12172 tablet_bootstrap.cc:654] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.336670 12105 heartbeater.cc:499] Master 127.11.39.189:44065 was elected leader, sending a full tablet report...
I20250625 14:01:52.337278 12172 log.cc:826] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: Log is configured to *not* fsync() on all Append() calls
I20250625 14:01:52.337404 12167 tablet_bootstrap.cc:492] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.337481 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 22c1000d243b415e91d2218566135f95 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.338515 12167 tablet_bootstrap.cc:654] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.338572 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a286a99e31142b28c4739c287bbb269 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.338847 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a286a99e31142b28c4739c287bbb269 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:52.339030 11520 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f8b967cff8e4af88a30ee6b132833bd has no consensus state
I20250625 14:01:52.339229 11970 heartbeater.cc:499] Master 127.11.39.189:44065 was elected leader, sending a full tablet report...
I20250625 14:01:52.339345 12172 tablet_bootstrap.cc:492] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.339494 12172 ts_tablet_manager.cc:1397] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20250625 14:01:52.340201 12167 tablet_bootstrap.cc:492] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.340283 12167 ts_tablet_manager.cc:1397] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.340862 12167 raft_consensus.cc:357] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:52.340914 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 6a286a99e31142b28c4739c287bbb269 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a286a99e31142b28c4739c287bbb269 already in progress: creating tablet
I20250625 14:01:52.340968 12167 raft_consensus.cc:383] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.341003 12167 raft_consensus.cc:738] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.341130 12167 consensus_queue.cc:260] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:52.341456 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6a286a99e31142b28c4739c287bbb269 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a286a99e31142b28c4739c287bbb269 already in progress: creating tablet
I20250625 14:01:52.341521 12167 ts_tablet_manager.cc:1428] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.342552 12166 tablet_bootstrap.cc:492] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.342643 12172 raft_consensus.cc:357] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.342864 12172 raft_consensus.cc:383] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.342944 12172 raft_consensus.cc:738] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.343688 12166 tablet_bootstrap.cc:654] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.344209 12172 consensus_queue.cc:260] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.344879 12166 tablet_bootstrap.cc:492] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.344980 12166 ts_tablet_manager.cc:1397] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:52.345533 12172 ts_tablet_manager.cc:1428] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250625 14:01:52.345575 12166 raft_consensus.cc:357] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.345688 12166 raft_consensus.cc:383] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.345723 12166 raft_consensus.cc:738] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.345878 12166 consensus_queue.cc:260] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:52.346098 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6a286a99e31142b28c4739c287bbb269 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a286a99e31142b28c4739c287bbb269 already in progress: creating tablet
I20250625 14:01:52.346426 12166 ts_tablet_manager.cc:1428] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:52.348306 12172 tablet_bootstrap.cc:492] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.348917 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 3b578aeacb9743eb8c66de64117e54c0 (DEFAULT_TABLE table=default.Table_d93251dc77c743b5b8dea7a7f7a6b738 [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.349221 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b578aeacb9743eb8c66de64117e54c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.349495 12172 tablet_bootstrap.cc:654] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.349967 11832 heartbeater.cc:499] Master 127.11.39.189:44065 was elected leader, sending a full tablet report...
I20250625 14:01:52.350232 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 22c1000d243b415e91d2218566135f95 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 1 got 0
I20250625 14:01:52.351212 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 22c1000d243b415e91d2218566135f95 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 1 got 0
I20250625 14:01:52.351629 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 7f8b967cff8e4af88a30ee6b132833bd (DEFAULT_TABLE table=default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.351897 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8b967cff8e4af88a30ee6b132833bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.352072 11530 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 22c1000d243b415e91d2218566135f95 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 1 got 0
I20250625 14:01:52.352777 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 3b578aeacb9743eb8c66de64117e54c0 (DEFAULT_TABLE table=default.Table_d93251dc77c743b5b8dea7a7f7a6b738 [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.353039 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b578aeacb9743eb8c66de64117e54c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.353124 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a286a99e31142b28c4739c287bbb269 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.353374 12173 tablet_replica.cc:331] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.353482 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 8755a0ff70714ad6b274750f148e04ac (DEFAULT_TABLE table=default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.353722 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8755a0ff70714ad6b274750f148e04ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.353730 12173 raft_consensus.cc:2241] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.354053 12173 raft_consensus.cc:2270] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.354388 12167 tablet_bootstrap.cc:492] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.355334 12173 ts_tablet_manager.cc:1905] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.355480 12167 tablet_bootstrap.cc:654] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.356346 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 756ad485e4f3494db5cd66aa3a192a05 (DEFAULT_TABLE table=default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.356578 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756ad485e4f3494db5cd66aa3a192a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.357084 11688 catalog_manager.cc:1261] Loaded cluster ID: a3a3501b615546dbb967e53684a94696
I20250625 14:01:52.357126 11688 catalog_manager.cc:1554] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: loading cluster ID for follower catalog manager: success
I20250625 14:01:52.357612 12173 ts_tablet_manager.cc:1918] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.357693 12173 log.cc:1199] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6a286a99e31142b28c4739c287bbb269
I20250625 14:01:52.357945 12173 ts_tablet_manager.cc:1939] T 6a286a99e31142b28c4739c287bbb269 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.359402 11688 catalog_manager.cc:1576] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: acquiring CA information for follower catalog manager: success
I20250625 14:01:52.359947 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6a286a99e31142b28c4739c287bbb269 (table default.Table_149ab38510c248b4b403c6bba396f22c [id=615344d290894f08b268455ab5fba96d]) successfully deleted
I20250625 14:01:52.360536 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 3b578aeacb9743eb8c66de64117e54c0 (DEFAULT_TABLE table=default.Table_d93251dc77c743b5b8dea7a7f7a6b738 [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:52.360718 11830 heartbeater.cc:646] Failed to heartbeat to 127.11.39.188:43359 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111)
I20250625 14:01:52.360813 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b578aeacb9743eb8c66de64117e54c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.360962 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 756ad485e4f3494db5cd66aa3a192a05 (DEFAULT_TABLE table=default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.361176 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756ad485e4f3494db5cd66aa3a192a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.361763 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 756ad485e4f3494db5cd66aa3a192a05 (DEFAULT_TABLE table=default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.361912 12172 tablet_bootstrap.cc:492] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.361996 12172 ts_tablet_manager.cc:1397] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:01:52.362197 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 7f8b967cff8e4af88a30ee6b132833bd (DEFAULT_TABLE table=default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.362434 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8b967cff8e4af88a30ee6b132833bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.362673 12172 raft_consensus.cc:357] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.362777 12172 raft_consensus.cc:383] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.362807 12172 raft_consensus.cc:738] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.362922 12172 consensus_queue.cc:260] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.362989 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 8755a0ff70714ad6b274750f148e04ac (DEFAULT_TABLE table=default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.362003 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756ad485e4f3494db5cd66aa3a192a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.363207 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8755a0ff70714ad6b274750f148e04ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.363245 12166 tablet_bootstrap.cc:492] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.363286 12172 ts_tablet_manager.cc:1428] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.363471 12172 tablet_bootstrap.cc:492] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.364401 12166 tablet_bootstrap.cc:654] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.364432 12172 tablet_bootstrap.cc:654] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.365271 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a286a99e31142b28c4739c287bbb269 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.365605 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 8755a0ff70714ad6b274750f148e04ac (DEFAULT_TABLE table=default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.365686 12172 tablet_bootstrap.cc:492] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.365749 12172 ts_tablet_manager.cc:1397] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:52.365849 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8755a0ff70714ad6b274750f148e04ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.366240 12172 raft_consensus.cc:357] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.366376 12172 raft_consensus.cc:383] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.366420 12172 raft_consensus.cc:738] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.366439 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a286a99e31142b28c4739c287bbb269 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.366551 12172 consensus_queue.cc:260] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.366633 12175 tablet_replica.cc:331] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.366796 12172 ts_tablet_manager.cc:1428] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.366953 12172 tablet_bootstrap.cc:492] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.366971 12175 raft_consensus.cc:2241] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.367250 12175 raft_consensus.cc:2270] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.367573 12177 tablet_replica.cc:331] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.367856 12177 raft_consensus.cc:2241] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.367941 12172 tablet_bootstrap.cc:654] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.368139 12177 raft_consensus.cc:2270] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.368505 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 7f8b967cff8e4af88a30ee6b132833bd (DEFAULT_TABLE table=default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.369019 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8b967cff8e4af88a30ee6b132833bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.372139 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 22c1000d243b415e91d2218566135f95
I20250625 14:01:52.372294 12172 tablet_bootstrap.cc:492] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.372372 12172 ts_tablet_manager.cc:1397] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:52.372449 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 22c1000d243b415e91d2218566135f95 deleted and replaced by tablet 0eb159c2babe400386e250da3a177c79
I20250625 14:01:52.372866 12172 raft_consensus.cc:357] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.372987 12172 raft_consensus.cc:383] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.373018 12172 raft_consensus.cc:738] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.373136 12172 consensus_queue.cc:260] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.373431 12172 ts_tablet_manager.cc:1428] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:52.373607 12172 tablet_bootstrap.cc:492] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.374837 12172 tablet_bootstrap.cc:654] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.374855 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 22c1000d243b415e91d2218566135f95 with delete_type TABLET_DATA_DELETED (replaced by tablet 0eb159c2babe400386e250da3a177c79) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.375476 12175 ts_tablet_manager.cc:1905] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.375653 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 22c1000d243b415e91d2218566135f95 with delete_type TABLET_DATA_DELETED (replaced by tablet 0eb159c2babe400386e250da3a177c79) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.375890 12173 tablet_replica.cc:331] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.376049 12173 raft_consensus.cc:2241] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.376199 12173 raft_consensus.cc:2270] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.376685 12173 ts_tablet_manager.cc:1905] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.377383 12172 tablet_bootstrap.cc:492] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.377897 12175 ts_tablet_manager.cc:1918] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.377987 12172 ts_tablet_manager.cc:1397] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:52.378005 12175 log.cc:1199] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6a286a99e31142b28c4739c287bbb269
I20250625 14:01:52.378258 12175 ts_tablet_manager.cc:1939] T 6a286a99e31142b28c4739c287bbb269 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.378579 12172 raft_consensus.cc:357] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.378683 12172 raft_consensus.cc:383] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.378715 12172 raft_consensus.cc:738] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.378860 12172 consensus_queue.cc:260] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.378952 12173 ts_tablet_manager.cc:1918] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.379022 12173 log.cc:1199] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/22c1000d243b415e91d2218566135f95
I20250625 14:01:52.379251 12173 ts_tablet_manager.cc:1939] T 22c1000d243b415e91d2218566135f95 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.379942 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 22c1000d243b415e91d2218566135f95 with delete_type TABLET_DATA_DELETED (replaced by tablet 0eb159c2babe400386e250da3a177c79) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.380170 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 22c1000d243b415e91d2218566135f95 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:52.380453 12172 ts_tablet_manager.cc:1428] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:52.380995 12172 tablet_bootstrap.cc:492] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.382265 12175 tablet_replica.cc:331] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.382406 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6a286a99e31142b28c4739c287bbb269 (table default.Table_149ab38510c248b4b403c6bba396f22c [id=615344d290894f08b268455ab5fba96d]) successfully deleted
I20250625 14:01:52.382709 11688 catalog_manager.cc:1604] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250625 14:01:52.382921 12172 tablet_bootstrap.cc:654] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.383049 12175 raft_consensus.cc:2241] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.383530 11530 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 756ad485e4f3494db5cd66aa3a192a05 (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]). Expected version 1 got 0
I20250625 14:01:52.383518 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 0eb159c2babe400386e250da3a177c79 (DEFAULT_TABLE table=default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.383646 11530 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 3b578aeacb9743eb8c66de64117e54c0 (table default.Table_d93251dc77c743b5b8dea7a7f7a6b738 [id=47d8fe69c6c74648951544929540413d]). Expected version 1 got 0
I20250625 14:01:52.383769 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb159c2babe400386e250da3a177c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.384135 12172 tablet_bootstrap.cc:492] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.384205 12172 ts_tablet_manager.cc:1397] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.384707 12172 raft_consensus.cc:357] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.384820 12172 raft_consensus.cc:383] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.384855 12172 raft_consensus.cc:738] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.384856 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 0eb159c2babe400386e250da3a177c79 (DEFAULT_TABLE table=default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.384991 12172 consensus_queue.cc:260] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.385104 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb159c2babe400386e250da3a177c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.385264 12172 ts_tablet_manager.cc:1428] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.385888 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 756ad485e4f3494db5cd66aa3a192a05 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.386525 12172 tablet_bootstrap.cc:492] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.387396 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 0eb159c2babe400386e250da3a177c79 (DEFAULT_TABLE table=default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.387568 12172 tablet_bootstrap.cc:654] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.387684 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eb159c2babe400386e250da3a177c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.388667 12172 tablet_bootstrap.cc:492] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.388743 12172 ts_tablet_manager.cc:1397] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:52.389189 12172 raft_consensus.cc:357] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.389292 12172 raft_consensus.cc:383] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.389326 12172 raft_consensus.cc:738] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.389442 12172 consensus_queue.cc:260] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.389729 12172 ts_tablet_manager.cc:1428] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.391093 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 8755a0ff70714ad6b274750f148e04ac from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.391333 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 756ad485e4f3494db5cd66aa3a192a05 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.392364 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 756ad485e4f3494db5cd66aa3a192a05 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.392637 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 756ad485e4f3494db5cd66aa3a192a05
I20250625 14:01:52.393137 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 756ad485e4f3494db5cd66aa3a192a05 with delete_type TABLET_DATA_DELETED (replaced by tablet 66b7d6a225ad4bc398f6d762a1e33c2f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.393162 12175 raft_consensus.cc:2270] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.393280 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 756ad485e4f3494db5cd66aa3a192a05 with delete_type TABLET_DATA_DELETED (replaced by tablet 66b7d6a225ad4bc398f6d762a1e33c2f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.394130 12167 tablet_bootstrap.cc:492] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.394229 12167 ts_tablet_manager.cc:1397] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250625 14:01:52.394295 12166 tablet_bootstrap.cc:492] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.394407 12166 ts_tablet_manager.cc:1397] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:01:52.394400 12177 ts_tablet_manager.cc:1905] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.394801 12167 raft_consensus.cc:357] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.394927 12167 raft_consensus.cc:383] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.394960 12167 raft_consensus.cc:738] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.394964 12166 raft_consensus.cc:357] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.395073 12166 raft_consensus.cc:383] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.395109 12166 raft_consensus.cc:738] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.395090 12167 consensus_queue.cc:260] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.395227 12166 consensus_queue.cc:260] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.395375 12167 ts_tablet_manager.cc:1428] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:52.395514 12166 ts_tablet_manager.cc:1428] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:52.395606 12167 tablet_bootstrap.cc:492] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.395735 12166 tablet_bootstrap.cc:492] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.396520 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8755a0ff70714ad6b274750f148e04ac
I20250625 14:01:52.396732 12167 tablet_bootstrap.cc:654] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.396834 12166 tablet_bootstrap.cc:654] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.396868 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 8755a0ff70714ad6b274750f148e04ac deleted and replaced by tablet 574a885d2cc643839ca8f09e5bcf1b74
I20250625 14:01:52.396955 12177 ts_tablet_manager.cc:1918] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.397042 12177 log.cc:1199] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6a286a99e31142b28c4739c287bbb269
I20250625 14:01:52.397310 12177 ts_tablet_manager.cc:1939] T 6a286a99e31142b28c4739c287bbb269 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.397400 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]). Expected version 1 got 0
I20250625 14:01:52.398562 12177 tablet_replica.cc:331] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.398589 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 8755a0ff70714ad6b274750f148e04ac with delete_type TABLET_DATA_DELETED (replaced by tablet 574a885d2cc643839ca8f09e5bcf1b74) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.398697 12177 raft_consensus.cc:2241] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.398798 12177 raft_consensus.cc:2270] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.399164 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6a286a99e31142b28c4739c287bbb269 (table default.Table_149ab38510c248b4b403c6bba396f22c [id=615344d290894f08b268455ab5fba96d]) successfully deleted
I20250625 14:01:52.399215 12177 ts_tablet_manager.cc:1905] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.400233 12166 tablet_bootstrap.cc:492] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.400327 12166 ts_tablet_manager.cc:1397] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20250625 14:01:52.401033 12166 raft_consensus.cc:357] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.401160 12166 raft_consensus.cc:383] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.401193 12166 raft_consensus.cc:738] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.401314 12177 ts_tablet_manager.cc:1918] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.401316 12166 consensus_queue.cc:260] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.401386 12177 log.cc:1199] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/22c1000d243b415e91d2218566135f95
I20250625 14:01:52.401597 12177 ts_tablet_manager.cc:1939] T 22c1000d243b415e91d2218566135f95 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.401592 12166 ts_tablet_manager.cc:1428] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250625 14:01:52.401815 12166 tablet_bootstrap.cc:492] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.402458 12177 tablet_replica.cc:331] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.402592 12177 raft_consensus.cc:2241] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.402706 12177 raft_consensus.cc:2270] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.402976 12166 tablet_bootstrap.cc:654] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.403048 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 8755a0ff70714ad6b274750f148e04ac with delete_type TABLET_DATA_DELETED (replaced by tablet 574a885d2cc643839ca8f09e5bcf1b74) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.403136 12167 tablet_bootstrap.cc:492] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.403211 12177 ts_tablet_manager.cc:1905] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.403251 12167 ts_tablet_manager.cc:1397] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:52.403568 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 8755a0ff70714ad6b274750f148e04ac with delete_type TABLET_DATA_DELETED (replaced by tablet 574a885d2cc643839ca8f09e5bcf1b74) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.403671 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 22c1000d243b415e91d2218566135f95 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:52.403753 12167 raft_consensus.cc:357] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.403872 12167 raft_consensus.cc:383] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.403906 12167 raft_consensus.cc:738] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.404031 12167 consensus_queue.cc:260] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.404323 12167 ts_tablet_manager.cc:1428] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.404549 11530 catalog_manager.cc:6652] ReplaceTablet: tablet 756ad485e4f3494db5cd66aa3a192a05 deleted and replaced by tablet 66b7d6a225ad4bc398f6d762a1e33c2f
I20250625 14:01:52.404942 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 756ad485e4f3494db5cd66aa3a192a05 with delete_type TABLET_DATA_DELETED (replaced by tablet 66b7d6a225ad4bc398f6d762a1e33c2f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.405025 12175 ts_tablet_manager.cc:1905] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.406749 12177 ts_tablet_manager.cc:1918] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.407107 12177 log.cc:1199] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/756ad485e4f3494db5cd66aa3a192a05
I20250625 14:01:52.407426 12177 ts_tablet_manager.cc:1939] T 756ad485e4f3494db5cd66aa3a192a05 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.407836 12175 ts_tablet_manager.cc:1918] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.407944 12175 log.cc:1199] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/22c1000d243b415e91d2218566135f95
I20250625 14:01:52.408157 12175 ts_tablet_manager.cc:1939] T 22c1000d243b415e91d2218566135f95 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:01:52.408636 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8755a0ff70714ad6b274750f148e04ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8755a0ff70714ad6b274750f148e04ac already in progress: creating tablet
I20250625 14:01:52.408735 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 1 got 0
W20250625 14:01:52.408843 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 756ad485e4f3494db5cd66aa3a192a05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 756ad485e4f3494db5cd66aa3a192a05 already in progress: creating tablet
I20250625 14:01:52.408870 12175 tablet_replica.cc:331] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.408977 12175 raft_consensus.cc:2241] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.408629 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 756ad485e4f3494db5cd66aa3a192a05 (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]) successfully deleted
I20250625 14:01:52.409104 12175 raft_consensus.cc:2270] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:52.409106 11526 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0eb159c2babe400386e250da3a177c79 consensus state has no leader
I20250625 14:01:52.409279 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 22c1000d243b415e91d2218566135f95 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
W20250625 14:01:52.409437 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 756ad485e4f3494db5cd66aa3a192a05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 756ad485e4f3494db5cd66aa3a192a05 already in progress: creating tablet
I20250625 14:01:52.409494 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 3b578aeacb9743eb8c66de64117e54c0 (table default.Table_d93251dc77c743b5b8dea7a7f7a6b738 [id=47d8fe69c6c74648951544929540413d]). Expected version 1 got 0
I20250625 14:01:52.409540 12166 tablet_bootstrap.cc:492] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.409631 12166 ts_tablet_manager.cc:1397] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:52.410151 12166 raft_consensus.cc:357] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.410257 12166 raft_consensus.cc:383] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.410356 12167 tablet_bootstrap.cc:492] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.410549 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 66b7d6a225ad4bc398f6d762a1e33c2f (DEFAULT_TABLE table=default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.410794 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b7d6a225ad4bc398f6d762a1e33c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.411087 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]). Expected version 1 got 0
I20250625 14:01:52.411700 12167 tablet_bootstrap.cc:654] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.410292 12166 raft_consensus.cc:738] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.411805 12175 ts_tablet_manager.cc:1905] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.412058 12166 consensus_queue.cc:260] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.412462 12166 ts_tablet_manager.cc:1428] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:52.412642 12166 tablet_bootstrap.cc:492] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.412853 12167 tablet_bootstrap.cc:492] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.412963 12167 ts_tablet_manager.cc:1397] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:52.413154 12178 raft_consensus.cc:491] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.413272 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]). Expected version 1 got 0
I20250625 14:01:52.413308 12178 raft_consensus.cc:513] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.413435 12167 raft_consensus.cc:357] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.413499 12167 raft_consensus.cc:383] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.413527 12167 raft_consensus.cc:738] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.413638 12167 consensus_queue.cc:260] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.413709 12166 tablet_bootstrap.cc:654] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.413868 12167 ts_tablet_manager.cc:1428] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.414088 12167 tablet_bootstrap.cc:492] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.414402 12177 tablet_replica.cc:331] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.414451 12172 tablet_bootstrap.cc:492] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.414541 12177 raft_consensus.cc:2241] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.414667 12177 raft_consensus.cc:2270] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.414692 12178 leader_election.cc:290] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.415194 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]). Expected version 1 got 0
I20250625 14:01:52.415752 12172 tablet_bootstrap.cc:654] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.417697 12175 ts_tablet_manager.cc:1918] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.417810 12175 log.cc:1199] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8755a0ff70714ad6b274750f148e04ac
I20250625 14:01:52.418056 12175 ts_tablet_manager.cc:1939] T 8755a0ff70714ad6b274750f148e04ac P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.418071 12167 tablet_bootstrap.cc:654] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.419585 12172 tablet_bootstrap.cc:492] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.419698 12172 ts_tablet_manager.cc:1397] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:52.420096 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8755a0ff70714ad6b274750f148e04ac (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]) successfully deleted
I20250625 14:01:52.420251 12172 raft_consensus.cc:357] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.420384 12172 raft_consensus.cc:383] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.420428 12172 raft_consensus.cc:738] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.420553 12172 consensus_queue.cc:260] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.420594 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7f8b967cff8e4af88a30ee6b132833bd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.420826 12172 ts_tablet_manager.cc:1428] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.420871 11922 raft_consensus.cc:2466] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:52.421619 12177 ts_tablet_manager.cc:1905] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.420609 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 574a885d2cc643839ca8f09e5bcf1b74 (DEFAULT_TABLE table=default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.421864 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574a885d2cc643839ca8f09e5bcf1b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.422461 12167 tablet_bootstrap.cc:492] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.422565 12167 ts_tablet_manager.cc:1397] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:52.423141 12167 raft_consensus.cc:357] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.423254 12167 raft_consensus.cc:383] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.423290 12167 raft_consensus.cc:738] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.423413 12167 consensus_queue.cc:260] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.423698 12167 ts_tablet_manager.cc:1428] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:52.423894 12167 tablet_bootstrap.cc:492] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.423921 12177 ts_tablet_manager.cc:1918] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.424013 12177 log.cc:1199] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8755a0ff70714ad6b274750f148e04ac
I20250625 14:01:52.424237 12177 ts_tablet_manager.cc:1939] T 8755a0ff70714ad6b274750f148e04ac P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.424897 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 66b7d6a225ad4bc398f6d762a1e33c2f (DEFAULT_TABLE table=default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.424968 12167 tablet_bootstrap.cc:654] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.425177 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b7d6a225ad4bc398f6d762a1e33c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.425478 11990 leader_election.cc:304] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.425796 12171 raft_consensus.cc:2802] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.425882 12171 raft_consensus.cc:491] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.425956 12171 raft_consensus.cc:3058] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.426427 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 574a885d2cc643839ca8f09e5bcf1b74 (DEFAULT_TABLE table=default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.426515 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 66b7d6a225ad4bc398f6d762a1e33c2f (DEFAULT_TABLE table=default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.426664 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574a885d2cc643839ca8f09e5bcf1b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.427510 12171 raft_consensus.cc:513] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.427888 12171 leader_election.cc:290] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.428232 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b7d6a225ad4bc398f6d762a1e33c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.428726 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7f8b967cff8e4af88a30ee6b132833bd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:52.428853 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8755a0ff70714ad6b274750f148e04ac (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]) successfully deleted
I20250625 14:01:52.428995 11784 raft_consensus.cc:2466] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:52.428722 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7f8b967cff8e4af88a30ee6b132833bd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:52.429315 11783 raft_consensus.cc:3058] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.429809 12166 tablet_bootstrap.cc:492] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.429898 12166 ts_tablet_manager.cc:1397] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:52.430020 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 574a885d2cc643839ca8f09e5bcf1b74 (DEFAULT_TABLE table=default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.430272 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574a885d2cc643839ca8f09e5bcf1b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.430475 12166 raft_consensus.cc:357] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.430593 12166 raft_consensus.cc:383] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.430625 12166 raft_consensus.cc:738] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.430641 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7f8b967cff8e4af88a30ee6b132833bd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.430727 11922 raft_consensus.cc:3058] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.430748 12166 consensus_queue.cc:260] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.431162 12166 ts_tablet_manager.cc:1428] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.431427 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 66b7d6a225ad4bc398f6d762a1e33c2f (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]). Expected version 1 got 0
I20250625 14:01:52.431576 12166 tablet_bootstrap.cc:492] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.431771 11922 raft_consensus.cc:2466] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
W20250625 14:01:52.431783 11527 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 66b7d6a225ad4bc398f6d762a1e33c2f (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 66b7d6a225ad4bc398f6d762a1e33c2f consensus state has no leader
I20250625 14:01:52.432566 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 3b578aeacb9743eb8c66de64117e54c0 (table default.Table_d93251dc77c743b5b8dea7a7f7a6b738 [id=47d8fe69c6c74648951544929540413d]). Expected version 1 got 0
I20250625 14:01:52.432825 12166 tablet_bootstrap.cc:654] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.434031 11783 raft_consensus.cc:2466] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:52.434144 12167 tablet_bootstrap.cc:492] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.434255 12167 ts_tablet_manager.cc:1397] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20250625 14:01:52.434762 11993 leader_election.cc:304] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:01:52.434829 12167 raft_consensus.cc:357] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.434983 12167 raft_consensus.cc:383] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.434988 12171 raft_consensus.cc:2802] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.435048 12167 raft_consensus.cc:738] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.435146 12171 raft_consensus.cc:695] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:52.435225 12167 consensus_queue.cc:260] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.435391 12171 consensus_queue.cc:237] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.435570 12167 ts_tablet_manager.cc:1428] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.435741 12167 tablet_bootstrap.cc:492] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.436846 12167 tablet_bootstrap.cc:654] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.437153 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 8755a0ff70714ad6b274750f148e04ac with delete_type TABLET_DATA_DELETED (replaced by tablet 574a885d2cc643839ca8f09e5bcf1b74) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.437347 12173 tablet_replica.cc:331] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.437798 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 756ad485e4f3494db5cd66aa3a192a05 with delete_type TABLET_DATA_DELETED (replaced by tablet 66b7d6a225ad4bc398f6d762a1e33c2f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.438014 12175 tablet_replica.cc:331] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.438138 12175 raft_consensus.cc:2241] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.438275 12175 raft_consensus.cc:2270] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.438767 12172 tablet_bootstrap.cc:492] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.438875 12175 ts_tablet_manager.cc:1905] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.439860 12172 tablet_bootstrap.cc:654] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.440447 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 1 got 0
I20250625 14:01:52.440595 11524 catalog_manager.cc:5582] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:52.441085 12172 tablet_bootstrap.cc:492] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.441164 12172 ts_tablet_manager.cc:1397] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:52.441146 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]). Expected version 1 got 0
I20250625 14:01:52.441228 12175 ts_tablet_manager.cc:1918] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.441289 12175 log.cc:1199] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/756ad485e4f3494db5cd66aa3a192a05
I20250625 14:01:52.441496 12175 ts_tablet_manager.cc:1939] T 756ad485e4f3494db5cd66aa3a192a05 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.441666 12172 raft_consensus.cc:357] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.441780 12172 raft_consensus.cc:383] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.441812 12172 raft_consensus.cc:738] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.437582 12173 raft_consensus.cc:2241] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.441943 12172 consensus_queue.cc:260] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.442121 12173 raft_consensus.cc:2270] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.442220 12172 ts_tablet_manager.cc:1428] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.438041 12167 tablet_bootstrap.cc:492] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.442431 12167 ts_tablet_manager.cc:1397] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:52.442935 12167 raft_consensus.cc:357] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.443058 12167 raft_consensus.cc:383] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.443104 12167 raft_consensus.cc:738] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.443027 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 756ad485e4f3494db5cd66aa3a192a05 (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]) successfully deleted
I20250625 14:01:52.443233 12167 consensus_queue.cc:260] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.443506 12167 ts_tablet_manager.cc:1428] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.439659 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 756ad485e4f3494db5cd66aa3a192a05 with delete_type TABLET_DATA_DELETED (replaced by tablet 66b7d6a225ad4bc398f6d762a1e33c2f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.443710 12167 tablet_bootstrap.cc:492] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.444810 12167 tablet_bootstrap.cc:654] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.445042 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]). Expected version 1 got 0
I20250625 14:01:52.445188 12166 tablet_bootstrap.cc:492] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.445276 12166 ts_tablet_manager.cc:1397] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
W20250625 14:01:52.445365 11527 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 574a885d2cc643839ca8f09e5bcf1b74 consensus state has no leader
I20250625 14:01:52.445793 12166 raft_consensus.cc:357] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.445912 12166 raft_consensus.cc:383] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.445951 12166 raft_consensus.cc:738] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.446738 12173 ts_tablet_manager.cc:1905] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.447846 12166 consensus_queue.cc:260] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.449028 12167 tablet_bootstrap.cc:492] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.449124 12167 ts_tablet_manager.cc:1397] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:52.449318 12173 ts_tablet_manager.cc:1918] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.449442 12173 log.cc:1199] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8755a0ff70714ad6b274750f148e04ac
I20250625 14:01:52.449770 12173 ts_tablet_manager.cc:1939] T 8755a0ff70714ad6b274750f148e04ac P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.450024 12167 raft_consensus.cc:357] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.450155 12167 raft_consensus.cc:383] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.450191 12167 raft_consensus.cc:738] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.450213 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 1 got 0
I20250625 14:01:52.450337 12167 consensus_queue.cc:260] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.450430 12173 tablet_replica.cc:331] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.450634 12167 ts_tablet_manager.cc:1428] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:52.450771 12173 raft_consensus.cc:2241] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.450877 12173 raft_consensus.cc:2270] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.451112 12166 ts_tablet_manager.cc:1428] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:52.451493 12173 ts_tablet_manager.cc:1905] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.452327 12166 tablet_bootstrap.cc:492] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.452873 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_fc5b526753c6429f8f3a535557f09381 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 1 got 0
I20250625 14:01:52.453491 12166 tablet_bootstrap.cc:654] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.453496 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8755a0ff70714ad6b274750f148e04ac (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]) successfully deleted
I20250625 14:01:52.453580 12173 ts_tablet_manager.cc:1918] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.453680 12173 log.cc:1199] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/756ad485e4f3494db5cd66aa3a192a05
I20250625 14:01:52.453940 12173 ts_tablet_manager.cc:1939] T 756ad485e4f3494db5cd66aa3a192a05 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.454205 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]). Expected version 1 got 0
I20250625 14:01:52.454627 12166 tablet_bootstrap.cc:492] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.454730 12166 ts_tablet_manager.cc:1397] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20250625 14:01:52.455026 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]). Expected version 1 got 0
I20250625 14:01:52.455180 12166 raft_consensus.cc:357] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.455276 12166 raft_consensus.cc:383] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.455320 12166 raft_consensus.cc:738] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.455487 12166 consensus_queue.cc:260] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.455520 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 756ad485e4f3494db5cd66aa3a192a05 (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]) successfully deleted
I20250625 14:01:52.455999 12166 ts_tablet_manager.cc:1428] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:52.456250 12166 tablet_bootstrap.cc:492] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.456452 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 66b7d6a225ad4bc398f6d762a1e33c2f (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]). Expected version 1 got 0
I20250625 14:01:52.456930 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]). Expected version 1 got 0
I20250625 14:01:52.457369 12166 tablet_bootstrap.cc:654] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.458461 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]). Expected version 1 got 0
I20250625 14:01:52.458639 12166 tablet_bootstrap.cc:492] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.458721 12166 ts_tablet_manager.cc:1397] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:01:52.459168 12166 raft_consensus.cc:357] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.459264 12166 raft_consensus.cc:383] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.459300 12166 raft_consensus.cc:738] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.459437 12166 consensus_queue.cc:260] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.459686 12166 ts_tablet_manager.cc:1428] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:52.460605 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 66b7d6a225ad4bc398f6d762a1e33c2f (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]). Expected version 1 got 0
I20250625 14:01:52.461946 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 66b7d6a225ad4bc398f6d762a1e33c2f (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]). Expected version 1 got 0
I20250625 14:01:52.481478 12180 raft_consensus.cc:491] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.481644 12180 raft_consensus.cc:513] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.482829 12180 leader_election.cc:290] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:01:52.483682 12106 tablet.cc:2378] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250625 14:01:52.486559 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "574a885d2cc643839ca8f09e5bcf1b74" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.486763 11922 raft_consensus.cc:2466] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.487121 11717 leader_election.cc:304] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.487406 12180 raft_consensus.cc:2802] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.487496 12180 raft_consensus.cc:491] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.487468 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "574a885d2cc643839ca8f09e5bcf1b74" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.487548 12180 raft_consensus.cc:3058] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.487685 12057 raft_consensus.cc:2466] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.488518 12180 raft_consensus.cc:513] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.488844 12180 leader_election.cc:290] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.489239 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "574a885d2cc643839ca8f09e5bcf1b74" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.489292 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "574a885d2cc643839ca8f09e5bcf1b74" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.489377 11922 raft_consensus.cc:3058] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.489410 12057 raft_consensus.cc:3058] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.490127 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_493a555ade1e403cbd43a86a1c2dcbb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.490370 11922 raft_consensus.cc:2466] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.490470 12057 raft_consensus.cc:2466] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
W20250625 14:01:52.490741 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_493a555ade1e403cbd43a86a1c2dcbb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.490846 11717 leader_election.cc:304] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.491169 12180 raft_consensus.cc:2802] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.491390 12180 raft_consensus.cc:695] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:52.491684 12180 consensus_queue.cc:237] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.492611 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_203f3bd31394469a94a5fbbc34f6be42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.492799 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_054f665e4e8640109ae7c848fcf72633"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.493010 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_203f3bd31394469a94a5fbbc34f6be42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:52.493142 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_054f665e4e8640109ae7c848fcf72633 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.494238 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5f2c64f9e02144afb75670a83da7535a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.494629 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f2c64f9e02144afb75670a83da7535a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.496212 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_0c9a35c9dec84d4fa377b3db9d47a265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.496387 11528 catalog_manager.cc:5582] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
W20250625 14:01:52.496555 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c9a35c9dec84d4fa377b3db9d47a265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.496594 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]). Expected version 1 got 0
I20250625 14:01:52.497058 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9105e0cbac504e8ab336df92dbe11a16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.497366 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9105e0cbac504e8ab336df92dbe11a16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.499014 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4b8d606f8c3e424994ec2f294d0c1ef6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.499320 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b8d606f8c3e424994ec2f294d0c1ef6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.499948 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_df45e009102c47068fedf7e5fb3df0b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.500257 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df45e009102c47068fedf7e5fb3df0b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.500954 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3520facf466e4d6ebff18fc900b4f46e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.501372 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3520facf466e4d6ebff18fc900b4f46e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.501564 12180 raft_consensus.cc:491] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.501677 12180 raft_consensus.cc:513] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.502107 12180 leader_election.cc:290] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.502604 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0eb159c2babe400386e250da3a177c79" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.502760 11922 raft_consensus.cc:2466] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.503022 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0eb159c2babe400386e250da3a177c79" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.503106 11717 leader_election.cc:304] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.503101 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6531b22f10ff4322a646715bb910c654"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.503161 12057 raft_consensus.cc:2466] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:52.503441 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6531b22f10ff4322a646715bb910c654 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.505913 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fc5b526753c6429f8f3a535557f09381" } new_table_name: "default.Table_9373caf3ce8246379d0413f41703bb5f" modify_external_catalogs: true
I20250625 14:01:52.507292 12180 raft_consensus.cc:2802] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.507380 12180 raft_consensus.cc:491] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.507426 12180 raft_consensus.cc:3058] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.508566 12180 raft_consensus.cc:513] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.509389 12057 raft_consensus.cc:1273] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.509471 11922 raft_consensus.cc:1273] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.509488 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0eb159c2babe400386e250da3a177c79" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.509742 11921 raft_consensus.cc:3058] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.509881 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0eb159c2babe400386e250da3a177c79" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.509991 12057 raft_consensus.cc:3058] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.510536 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b600fb8d9d0f485182805e01002284c0" } modify_external_catalogs: true
I20250625 14:01:52.510632 12180 leader_election.cc:290] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.510677 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b600fb8d9d0f485182805e01002284c0" } modify_external_catalogs: true
I20250625 14:01:52.510771 12180 consensus_queue.cc:1035] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:52.511086 12057 raft_consensus.cc:2466] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.511267 11921 raft_consensus.cc:2466] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.511574 11717 leader_election.cc:304] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.511616 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_054f665e4e8640109ae7c848fcf72633" } new_table_name: "default.Table_3702c1a05762460794ae97100930f18c" modify_external_catalogs: true
I20250625 14:01:52.511758 12180 consensus_queue.cc:1035] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:52.512043 12180 raft_consensus.cc:2802] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.512120 12180 raft_consensus.cc:695] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:52.512254 12180 consensus_queue.cc:237] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.516139 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_84840e9c91d943969b62a478c6d7c2e2" } modify_external_catalogs: true
I20250625 14:01:52.516268 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_84840e9c91d943969b62a478c6d7c2e2" } modify_external_catalogs: true
I20250625 14:01:52.517974 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5f2c64f9e02144afb75670a83da7535a" } modify_external_catalogs: true
I20250625 14:01:52.518006 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0003a9521c894d7bbe2377ba2912a633" } modify_external_catalogs: true
I20250625 14:01:52.518096 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5f2c64f9e02144afb75670a83da7535a" } modify_external_catalogs: true
I20250625 14:01:52.518110 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0003a9521c894d7bbe2377ba2912a633" } modify_external_catalogs: true
I20250625 14:01:52.518241 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d93251dc77c743b5b8dea7a7f7a6b738" } new_table_name: "default.Table_c809e7c1c3894a12aa1504b30c0e4497" modify_external_catalogs: true
I20250625 14:01:52.518671 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9105e0cbac504e8ab336df92dbe11a16" } new_table_name: "default.Table_83c625f3606a4d38881343f54bb21815" modify_external_catalogs: true
I20250625 14:01:52.519462 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 99dd8205e438423f84792df3d651c7a9 (DEFAULT_TABLE table=default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.519652 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 99dd8205e438423f84792df3d651c7a9 (DEFAULT_TABLE table=default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.519757 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99dd8205e438423f84792df3d651c7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.519877 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99dd8205e438423f84792df3d651c7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.522137 12166 tablet_bootstrap.cc:492] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.523188 12166 tablet_bootstrap.cc:654] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.523911 12172 tablet_bootstrap.cc:492] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.524981 12172 tablet_bootstrap.cc:654] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.525941 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 99dd8205e438423f84792df3d651c7a9 (DEFAULT_TABLE table=default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.526239 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99dd8205e438423f84792df3d651c7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.528658 12171 raft_consensus.cc:491] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.528756 12171 raft_consensus.cc:513] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.529192 12171 leader_election.cc:290] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.529397 12167 tablet_bootstrap.cc:492] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.530637 12167 tablet_bootstrap.cc:654] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.532141 11920 raft_consensus.cc:1273] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 14:01:52.532565 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0eb159c2babe400386e250da3a177c79 consensus state has no leader
I20250625 14:01:52.532992 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 574a885d2cc643839ca8f09e5bcf1b74
I20250625 14:01:52.533190 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3b578aeacb9743eb8c66de64117e54c0" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:52.533322 11783 raft_consensus.cc:2466] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:52.533532 11784 raft_consensus.cc:1273] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.533517 12171 consensus_queue.cc:1035] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:52.533764 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3b578aeacb9743eb8c66de64117e54c0 consensus state has no leader
I20250625 14:01:52.533974 11531 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 16e754890a564953a6ea632513e2324f
W20250625 14:01:52.534543 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f433ff8fc284bb8b71f9d7d2b160d2d has no consensus state
I20250625 14:01:52.534802 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7f8b967cff8e4af88a30ee6b132833bd
I20250625 14:01:52.535218 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 574a885d2cc643839ca8f09e5bcf1b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.535334 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 7f8b967cff8e4af88a30ee6b132833bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.535387 12175 tablet_replica.cc:331] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.535512 12175 raft_consensus.cc:2241] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.535602 12175 pending_rounds.cc:70] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Trying to abort 2 pending ops.
I20250625 14:01:52.535704 12175 pending_rounds.cc:77] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7171523020828975104 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "574a885d2cc643839ca8f09e5bcf1b74" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_84840e9c91d943969b62a478c6d7c2e2" dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" new_extra_config { } }
I20250625 14:01:52.535815 12167 tablet_bootstrap.cc:492] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.535897 12167 ts_tablet_manager.cc:1397] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:52.536190 12175 pending_rounds.cc:77] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523020769222656 op_type: NO_OP noop_request { }
I20250625 14:01:52.536276 12175 raft_consensus.cc:2887] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:52.536355 12175 raft_consensus.cc:2270] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.536415 12167 raft_consensus.cc:357] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.536542 12167 raft_consensus.cc:383] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.536576 12167 raft_consensus.cc:738] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.536698 12167 consensus_queue.cc:260] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.536844 11993 leader_election.cc:304] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:01:52.537137 12167 ts_tablet_manager.cc:1428] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:52.537220 12178 raft_consensus.cc:2802] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.537289 12178 raft_consensus.cc:491] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.537338 12178 raft_consensus.cc:3058] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.537741 12166 tablet_bootstrap.cc:492] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.537829 12166 ts_tablet_manager.cc:1397] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20250625 14:01:52.538497 12166 raft_consensus.cc:357] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.538606 12166 raft_consensus.cc:383] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.538638 12166 raft_consensus.cc:738] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.538755 12166 consensus_queue.cc:260] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.539052 12166 ts_tablet_manager.cc:1428] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.539191 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 7f8b967cff8e4af88a30ee6b132833bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.539420 12173 tablet_replica.cc:331] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.539544 12173 raft_consensus.cc:2241] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:52.539836 12173 pending_rounds.cc:70] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 2 pending ops.
I20250625 14:01:52.539945 12173 pending_rounds.cc:77] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7171523020905725952 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "7f8b967cff8e4af88a30ee6b132833bd" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_b600fb8d9d0f485182805e01002284c0" dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" new_extra_config { } }
I20250625 14:01:52.540033 12178 raft_consensus.cc:513] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:52.540230 12173 tablet_service.cc:696] failed op from {username='slave'} at 127.0.0.1:36272: Aborted: Op aborted
I20250625 14:01:52.540390 12178 leader_election.cc:290] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.540637 12173 pending_rounds.cc:77] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523020538429440 op_type: NO_OP noop_request { }
I20250625 14:01:52.540728 12173 raft_consensus.cc:2887] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:52.540788 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 574a885d2cc643839ca8f09e5bcf1b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.541436 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_df45e009102c47068fedf7e5fb3df0b7" } new_table_name: "default.Table_36ee4ee859624376a5fdf46e0b8633eb" modify_external_catalogs: true
W20250625 14:01:52.542125 11971 tablet.cc:2378] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250625 14:01:52.542622 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3b578aeacb9743eb8c66de64117e54c0" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.542695 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 66b7d6a225ad4bc398f6d762a1e33c2f
I20250625 14:01:52.540799 12173 raft_consensus.cc:2270] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.542742 11919 raft_consensus.cc:3058] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.543421 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 66b7d6a225ad4bc398f6d762a1e33c2f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.543880 11919 raft_consensus.cc:2466] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:52.544067 12173 ts_tablet_manager.cc:1905] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.544407 11990 leader_election.cc:304] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.544606 12219 raft_consensus.cc:2802] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.544692 12219 raft_consensus.cc:695] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:52.544705 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 66b7d6a225ad4bc398f6d762a1e33c2f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.544818 12219 consensus_queue.cc:237] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:52.547554 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63f1676a2fc841f5b8fc60a6591b3824 has no consensus state
I20250625 14:01:52.548609 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3702c1a05762460794ae97100930f18c" } modify_external_catalogs: true
I20250625 14:01:52.548703 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3702c1a05762460794ae97100930f18c" } modify_external_catalogs: true
I20250625 14:01:52.549041 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 574a885d2cc643839ca8f09e5bcf1b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.549269 12177 tablet_replica.cc:331] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.549386 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 7f8b967cff8e4af88a30ee6b132833bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.549407 12177 raft_consensus.cc:2241] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:52.549576 12177 pending_rounds.cc:70] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 2 pending ops.
W20250625 14:01:52.549677 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 265c10a0b44f49f5ba55224f7c1ec8c7 has no consensus state
I20250625 14:01:52.549711 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 66b7d6a225ad4bc398f6d762a1e33c2f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.549688 12177 pending_rounds.cc:77] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7171523020828975104 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "574a885d2cc643839ca8f09e5bcf1b74" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_84840e9c91d943969b62a478c6d7c2e2" dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" new_extra_config { } }
W20250625 14:01:52.549990 12177 tablet_service.cc:696] failed op from {username='slave'} at 127.0.0.1:48698: Aborted: Op aborted
I20250625 14:01:52.550294 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3b578aeacb9743eb8c66de64117e54c0" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:52.550442 12177 pending_rounds.cc:77] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523020769222656 op_type: NO_OP noop_request { }
I20250625 14:01:52.550441 11784 raft_consensus.cc:3058] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.550565 12177 raft_consensus.cc:2887] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:52.546298 12173 ts_tablet_manager.cc:1918] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:52.550637 12177 raft_consensus.cc:2270] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.550685 12173 log.cc:1199] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7f8b967cff8e4af88a30ee6b132833bd
I20250625 14:01:52.532243 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3b578aeacb9743eb8c66de64117e54c0" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.550925 11922 raft_consensus.cc:2374] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1. Re-sending same reply.
I20250625 14:01:52.551396 12173 ts_tablet_manager.cc:1939] T 7f8b967cff8e4af88a30ee6b132833bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.551730 11784 raft_consensus.cc:2466] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:52.552634 12177 ts_tablet_manager.cc:1905] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.552721 12172 tablet_bootstrap.cc:492] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.552799 12172 ts_tablet_manager.cc:1397] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250625 14:01:52.553313 12172 raft_consensus.cc:357] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.553416 12172 raft_consensus.cc:383] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.553450 12172 raft_consensus.cc:738] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.553577 12172 consensus_queue.cc:260] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.553846 12172 ts_tablet_manager.cc:1428] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.553896 12173 tablet_replica.cc:331] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.554028 12173 raft_consensus.cc:2241] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.554134 12173 pending_rounds.cc:70] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 2 pending ops.
I20250625 14:01:52.554160 12173 pending_rounds.cc:77] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7171523020828975104 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "574a885d2cc643839ca8f09e5bcf1b74" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_84840e9c91d943969b62a478c6d7c2e2" dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" new_extra_config { } }
I20250625 14:01:52.554386 12173 pending_rounds.cc:77] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523020769222656 op_type: NO_OP noop_request { }
I20250625 14:01:52.554438 12173 raft_consensus.cc:2887] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:52.554497 12173 raft_consensus.cc:2270] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.554633 12208 raft_consensus.cc:491] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.554714 12208 raft_consensus.cc:513] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.555042 12177 ts_tablet_manager.cc:1918] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:52.555073 12208 leader_election.cc:290] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.555109 12177 log.cc:1199] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/574a885d2cc643839ca8f09e5bcf1b74
I20250625 14:01:52.555126 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]) successfully deleted
I20250625 14:01:52.555387 12177 ts_tablet_manager.cc:1939] T 574a885d2cc643839ca8f09e5bcf1b74 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:52.555871 12214 consensus_queue.cc:1162] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfff52620fea460d850827814b790c35" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20250625 14:01:52.555907 12173 ts_tablet_manager.cc:1905] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.556027 12177 tablet_replica.cc:331] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.556130 12177 raft_consensus.cc:2241] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.556241 12177 raft_consensus.cc:2270] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.557499 12175 ts_tablet_manager.cc:1905] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.557994 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66b7d6a225ad4bc398f6d762a1e33c2f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.558125 11921 raft_consensus.cc:2466] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.558398 12173 ts_tablet_manager.cc:1918] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:52.558480 12173 log.cc:1199] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/574a885d2cc643839ca8f09e5bcf1b74
I20250625 14:01:52.558756 12173 ts_tablet_manager.cc:1939] T 574a885d2cc643839ca8f09e5bcf1b74 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.558666 11528 catalog_manager.cc:5582] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:52.558944 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_9373caf3ce8246379d0413f41703bb5f [id=78536fe9fe35426dbf8b277c45594020]). Expected version 2 got 0
I20250625 14:01:52.559507 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66b7d6a225ad4bc398f6d762a1e33c2f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.559651 12057 raft_consensus.cc:2466] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.559628 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]) successfully deleted
I20250625 14:01:52.559851 12175 ts_tablet_manager.cc:1918] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:52.559926 12175 log.cc:1199] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/574a885d2cc643839ca8f09e5bcf1b74
I20250625 14:01:52.560181 12175 ts_tablet_manager.cc:1939] T 574a885d2cc643839ca8f09e5bcf1b74 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.560071 11524 catalog_manager.cc:5582] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:52.560314 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 3b578aeacb9743eb8c66de64117e54c0 (table default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]). Expected version 2 got 0
I20250625 14:01:52.560842 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 (DEFAULT_TABLE table=default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.561117 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265c10a0b44f49f5ba55224f7c1ec8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.561477 12175 tablet_replica.cc:331] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.561589 12175 raft_consensus.cc:2241] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.561664 12175 pending_rounds.cc:70] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Trying to abort 2 pending ops.
I20250625 14:01:52.561686 12175 pending_rounds.cc:77] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7171523020905725952 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "7f8b967cff8e4af88a30ee6b132833bd" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_b600fb8d9d0f485182805e01002284c0" dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" new_extra_config { } }
I20250625 14:01:52.561842 12175 pending_rounds.cc:77] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523020538429440 op_type: NO_OP noop_request { }
I20250625 14:01:52.561885 12175 raft_consensus.cc:2887] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:52.561945 12175 raft_consensus.cc:2270] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.562757 11717 leader_election.cc:304] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.563326 12166 tablet_bootstrap.cc:492] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.563598 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 (DEFAULT_TABLE table=default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.563867 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265c10a0b44f49f5ba55224f7c1ec8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.563892 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 19c33ee6404a43edbbedb843fd072148 (DEFAULT_TABLE table=default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.564152 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c33ee6404a43edbbedb843fd072148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.564904 12166 tablet_bootstrap.cc:654] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.565621 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]) successfully deleted
I20250625 14:01:52.563616 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 63f1676a2fc841f5b8fc60a6591b3824 (DEFAULT_TABLE table=default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.566238 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f1676a2fc841f5b8fc60a6591b3824. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.566170 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 0bf30c206f554b218008856045231f90 (DEFAULT_TABLE table=default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.566339 11899 tablet_service.cc:1468] Processing CreateTablet for tablet c37dd3f9883c41dd9a0255fd5060328e (DEFAULT_TABLE table=default.Table_4b8d606f8c3e424994ec2f294d0c1ef6 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.566464 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf30c206f554b218008856045231f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.566599 12177 ts_tablet_manager.cc:1905] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.566699 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 57fd02ad8c9748129f46fbffc6c178f2 (DEFAULT_TABLE table=default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.566895 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fd02ad8c9748129f46fbffc6c178f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.568446 12177 ts_tablet_manager.cc:1918] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.568516 12177 log.cc:1199] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7f8b967cff8e4af88a30ee6b132833bd
I20250625 14:01:52.566171 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 57fd02ad8c9748129f46fbffc6c178f2 (DEFAULT_TABLE table=default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.563890 12208 raft_consensus.cc:2802] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.568727 12177 ts_tablet_manager.cc:1939] T 7f8b967cff8e4af88a30ee6b132833bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.568764 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fd02ad8c9748129f46fbffc6c178f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.568733 12208 raft_consensus.cc:491] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.568833 12208 raft_consensus.cc:3058] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.569103 11760 tablet_service.cc:1468] Processing CreateTablet for tablet c37dd3f9883c41dd9a0255fd5060328e (DEFAULT_TABLE table=default.Table_4b8d606f8c3e424994ec2f294d0c1ef6 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.569324 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37dd3f9883c41dd9a0255fd5060328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.569717 12208 raft_consensus.cc:513] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.569871 12172 tablet_bootstrap.cc:492] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.570128 12208 leader_election.cc:290] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.570295 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37dd3f9883c41dd9a0255fd5060328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.571224 12172 tablet_bootstrap.cc:654] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.571578 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 0bf30c206f554b218008856045231f90 (DEFAULT_TABLE table=default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.571795 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf30c206f554b218008856045231f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.573315 12177 tablet_replica.cc:331] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.573371 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 63f1676a2fc841f5b8fc60a6591b3824 (DEFAULT_TABLE table=default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.573444 12177 raft_consensus.cc:2241] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.573549 12177 raft_consensus.cc:2270] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.573613 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f1676a2fc841f5b8fc60a6591b3824. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.574124 12175 ts_tablet_manager.cc:1905] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.574167 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d (DEFAULT_TABLE table=default.Table_3702c1a05762460794ae97100930f18c [id=0b415260a5134ff6ba2666d34d17b0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.574424 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.576083 12175 ts_tablet_manager.cc:1918] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:52.576162 12175 log.cc:1199] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7f8b967cff8e4af88a30ee6b132833bd
I20250625 14:01:52.576438 12175 ts_tablet_manager.cc:1939] T 7f8b967cff8e4af88a30ee6b132833bd P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.576473 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d (DEFAULT_TABLE table=default.Table_3702c1a05762460794ae97100930f18c [id=0b415260a5134ff6ba2666d34d17b0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.576654 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 19c33ee6404a43edbbedb843fd072148 (DEFAULT_TABLE table=default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.576735 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.576864 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c33ee6404a43edbbedb843fd072148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.576845 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66b7d6a225ad4bc398f6d762a1e33c2f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.576481 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "66b7d6a225ad4bc398f6d762a1e33c2f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.576980 12057 raft_consensus.cc:3058] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.577042 11921 raft_consensus.cc:3058] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.577955 11921 raft_consensus.cc:2466] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.577960 12057 raft_consensus.cc:2466] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.578603 11717 leader_election.cc:304] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:52.578740 11717 raft_consensus.cc:2684] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:52.578816 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 (DEFAULT_TABLE table=default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.579108 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265c10a0b44f49f5ba55224f7c1ec8c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.579280 12177 ts_tablet_manager.cc:1905] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.580771 12167 tablet_bootstrap.cc:492] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.580919 12175 tablet_replica.cc:331] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.581040 12175 raft_consensus.cc:2241] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.581146 12175 raft_consensus.cc:2270] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.581416 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 19c33ee6404a43edbbedb843fd072148 (DEFAULT_TABLE table=default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.581503 12036 tablet_service.cc:1468] Processing CreateTablet for tablet c37dd3f9883c41dd9a0255fd5060328e (DEFAULT_TABLE table=default.Table_4b8d606f8c3e424994ec2f294d0c1ef6 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.581651 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c33ee6404a43edbbedb843fd072148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.581703 12175 ts_tablet_manager.cc:1905] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.581763 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37dd3f9883c41dd9a0255fd5060328e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.582093 12167 tablet_bootstrap.cc:654] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.582602 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]) successfully deleted
I20250625 14:01:52.583650 12167 tablet_bootstrap.cc:492] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.583727 12167 ts_tablet_manager.cc:1397] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.583778 12175 ts_tablet_manager.cc:1918] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.583847 12175 log.cc:1199] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/66b7d6a225ad4bc398f6d762a1e33c2f
I20250625 14:01:52.583946 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 57fd02ad8c9748129f46fbffc6c178f2 (DEFAULT_TABLE table=default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.584049 12175 ts_tablet_manager.cc:1939] T 66b7d6a225ad4bc398f6d762a1e33c2f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.584203 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fd02ad8c9748129f46fbffc6c178f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.584265 12167 raft_consensus.cc:357] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.584363 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 63f1676a2fc841f5b8fc60a6591b3824 (DEFAULT_TABLE table=default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.584578 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f1676a2fc841f5b8fc60a6591b3824. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.584717 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 66b7d6a225ad4bc398f6d762a1e33c2f (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]) successfully deleted
I20250625 14:01:52.584372 12167 raft_consensus.cc:383] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.584895 12167 raft_consensus.cc:738] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.585036 12167 consensus_queue.cc:260] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.585309 12167 ts_tablet_manager.cc:1428] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:52.585495 12167 tablet_bootstrap.cc:492] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.585947 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d (DEFAULT_TABLE table=default.Table_3702c1a05762460794ae97100930f18c [id=0b415260a5134ff6ba2666d34d17b0b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.586143 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.586575 12167 tablet_bootstrap.cc:654] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.586849 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 0bf30c206f554b218008856045231f90 (DEFAULT_TABLE table=default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.587077 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf30c206f554b218008856045231f90. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.588119 12177 ts_tablet_manager.cc:1918] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.588194 12177 log.cc:1199] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/66b7d6a225ad4bc398f6d762a1e33c2f
I20250625 14:01:52.588413 12177 ts_tablet_manager.cc:1939] T 66b7d6a225ad4bc398f6d762a1e33c2f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.588656 12167 tablet_bootstrap.cc:492] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.588737 12167 ts_tablet_manager.cc:1397] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.589211 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7f8b967cff8e4af88a30ee6b132833bd (table default.Table_b600fb8d9d0f485182805e01002284c0 [id=55072243399149c5aeb58d59a35e80ef]) successfully deleted
I20250625 14:01:52.589532 12167 raft_consensus.cc:357] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.589639 12167 raft_consensus.cc:383] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.589670 12167 raft_consensus.cc:738] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.589797 12167 consensus_queue.cc:260] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.591306 12167 ts_tablet_manager.cc:1428] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:52.592443 12167 tablet_bootstrap.cc:492] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.592554 12057 raft_consensus.cc:1273] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.592756 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 265c10a0b44f49f5ba55224f7c1ec8c7 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.593034 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3f433ff8fc284bb8b71f9d7d2b160d2d
I20250625 14:01:52.593199 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 66b7d6a225ad4bc398f6d762a1e33c2f (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]) successfully deleted
I20250625 14:01:52.593863 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.593976 12208 consensus_queue.cc:1035] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:52.594588 11921 raft_consensus.cc:1273] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.594605 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 574a885d2cc643839ca8f09e5bcf1b74 (table default.Table_84840e9c91d943969b62a478c6d7c2e2 [id=8c5df1d9266d4758af2c67980ec88db0]) successfully deleted
I20250625 14:01:52.594805 12173 tablet_replica.cc:331] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.594918 12173 raft_consensus.cc:2241] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.595026 12173 raft_consensus.cc:2270] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:52.595431 11833 tablet.cc:2378] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250625 14:01:52.595602 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.595947 12172 tablet_bootstrap.cc:492] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.596038 12172 ts_tablet_manager.cc:1397] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20250625 14:01:52.596136 12166 tablet_bootstrap.cc:492] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.596177 12173 ts_tablet_manager.cc:1905] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.596222 12166 ts_tablet_manager.cc:1397] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20250625 14:01:52.596580 12172 raft_consensus.cc:357] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.596688 12172 raft_consensus.cc:383] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.596719 12172 raft_consensus.cc:738] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.596741 12166 raft_consensus.cc:357] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.596839 12166 raft_consensus.cc:383] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.596868 12166 raft_consensus.cc:738] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.596838 12172 consensus_queue.cc:260] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.596994 12166 consensus_queue.cc:260] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.597273 12166 ts_tablet_manager.cc:1428] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.597259 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 57fd02ad8c9748129f46fbffc6c178f2 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.597368 12172 ts_tablet_manager.cc:1428] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.597483 12166 tablet_bootstrap.cc:492] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.598062 12172 tablet_bootstrap.cc:492] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.599488 12172 tablet_bootstrap.cc:654] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.600638 12172 tablet_bootstrap.cc:492] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.600720 12172 ts_tablet_manager.cc:1397] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.601173 12173 ts_tablet_manager.cc:1918] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.601263 12173 log.cc:1199] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/66b7d6a225ad4bc398f6d762a1e33c2f
I20250625 14:01:52.601222 12172 raft_consensus.cc:357] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.601325 12172 raft_consensus.cc:383] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.601358 12172 raft_consensus.cc:738] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.601388 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 0bf30c206f554b218008856045231f90 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.601485 12173 ts_tablet_manager.cc:1939] T 66b7d6a225ad4bc398f6d762a1e33c2f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.601480 12172 consensus_queue.cc:260] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.601768 12172 ts_tablet_manager.cc:1428] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.601949 12172 tablet_bootstrap.cc:492] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.602691 12166 tablet_bootstrap.cc:654] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.602955 12172 tablet_bootstrap.cc:654] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:52.602964 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f433ff8fc284bb8b71f9d7d2b160d2d already in progress: creating tablet
I20250625 14:01:52.603499 12208 raft_consensus.cc:491] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.603585 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 57fd02ad8c9748129f46fbffc6c178f2 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.603585 12208 raft_consensus.cc:513] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.603881 12208 leader_election.cc:290] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.604185 12219 raft_consensus.cc:491] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.604272 12219 raft_consensus.cc:513] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.604650 12219 leader_election.cc:290] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:52.604933 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f433ff8fc284bb8b71f9d7d2b160d2d already in progress: creating tablet
I20250625 14:01:52.605091 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 66b7d6a225ad4bc398f6d762a1e33c2f (table default.Table_0003a9521c894d7bbe2377ba2912a633 [id=300481cf7fd7402484df17d11f56c772]) successfully deleted
I20250625 14:01:52.605109 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.605147 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99dd8205e438423f84792df3d651c7a9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.605252 12056 raft_consensus.cc:2466] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.605263 12205 consensus_queue.cc:1035] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:52.605319 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99dd8205e438423f84792df3d651c7a9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:52.605428 11784 raft_consensus.cc:2466] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:52.605430 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99dd8205e438423f84792df3d651c7a9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.605551 11920 raft_consensus.cc:2466] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:52.605582 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99dd8205e438423f84792df3d651c7a9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.605657 11921 raft_consensus.cc:2466] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.605901 11990 leader_election.cc:304] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.606091 11717 leader_election.cc:304] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:01:52.607482 12205 raft_consensus.cc:2802] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.607543 12205 raft_consensus.cc:491] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.607589 12205 raft_consensus.cc:3058] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.608310 12172 tablet_bootstrap.cc:492] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.608363 12167 tablet_bootstrap.cc:654] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.608402 12172 ts_tablet_manager.cc:1397] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:52.608696 12205 raft_consensus.cc:513] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.609030 12172 raft_consensus.cc:357] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.609124 12172 raft_consensus.cc:383] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.609163 12172 raft_consensus.cc:738] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.609040 12205 leader_election.cc:290] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.609280 12172 consensus_queue.cc:260] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.609319 12219 raft_consensus.cc:2802] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.609378 12219 raft_consensus.cc:491] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.609418 12219 raft_consensus.cc:3058] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.609567 12172 ts_tablet_manager.cc:1428] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.609597 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 19c33ee6404a43edbbedb843fd072148 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.609755 12172 tablet_bootstrap.cc:492] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.610085 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99dd8205e438423f84792df3d651c7a9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.610204 11920 raft_consensus.cc:3058] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.610239 12219 raft_consensus.cc:513] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:52.610546 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f433ff8fc284bb8b71f9d7d2b160d2d already in progress: creating tablet
I20250625 14:01:52.610667 12219 leader_election.cc:290] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.611052 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99dd8205e438423f84792df3d651c7a9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.611066 12036 tablet_service.cc:1468] Processing CreateTablet for tablet e5a715b432704be2a9ca8bdca624bf70 (DEFAULT_TABLE table=default.Table_6531b22f10ff4322a646715bb910c654 [id=b3553dc46c8440619049d4adc450e003]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.611335 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a715b432704be2a9ca8bdca624bf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.611356 11920 raft_consensus.cc:2466] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.611681 12205 raft_consensus.cc:491] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.611756 12205 raft_consensus.cc:513] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.611987 11899 tablet_service.cc:1468] Processing CreateTablet for tablet e5a715b432704be2a9ca8bdca624bf70 (DEFAULT_TABLE table=default.Table_6531b22f10ff4322a646715bb910c654 [id=b3553dc46c8440619049d4adc450e003]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.612048 12205 leader_election.cc:290] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.612265 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a715b432704be2a9ca8bdca624bf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.612421 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99dd8205e438423f84792df3d651c7a9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.612581 12057 raft_consensus.cc:2391] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56419e38d8e34f6985d4d970c1ce76e5 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:01:52.612540 11760 tablet_service.cc:1468] Processing CreateTablet for tablet e5a715b432704be2a9ca8bdca624bf70 (DEFAULT_TABLE table=default.Table_6531b22f10ff4322a646715bb910c654 [id=b3553dc46c8440619049d4adc450e003]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.612777 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a715b432704be2a9ca8bdca624bf70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.613072 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "265c10a0b44f49f5ba55224f7c1ec8c7" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.613171 11920 raft_consensus.cc:2466] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.613606 11717 leader_election.cc:304] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.613759 12205 raft_consensus.cc:2802] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.613837 12205 raft_consensus.cc:695] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:52.613969 12205 consensus_queue.cc:237] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.614753 11717 leader_election.cc:304] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.614961 12205 raft_consensus.cc:2802] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.615006 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "99dd8205e438423f84792df3d651c7a9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:52.615010 12205 raft_consensus.cc:491] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.615375 12205 raft_consensus.cc:3058] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.615741 12172 tablet_bootstrap.cc:654] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.616187 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "265c10a0b44f49f5ba55224f7c1ec8c7" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.616328 12057 raft_consensus.cc:2466] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.616433 12205 raft_consensus.cc:513] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.616744 12205 leader_election.cc:290] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.617511 12207 mvcc.cc:204] Tried to move back new op lower bound from 7171523021175656448 to 7171523020851585024. Current Snapshot: MvccSnapshot[applied={T|T < 7171523021175656448}]
I20250625 14:01:52.618788 11993 leader_election.cc:304] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:52.619004 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "265c10a0b44f49f5ba55224f7c1ec8c7" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.619123 11920 raft_consensus.cc:3058] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.619161 12219 raft_consensus.cc:2747] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 14:01:52.619455 12172 tablet_bootstrap.cc:492] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.619527 12172 ts_tablet_manager.cc:1397] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:52.620041 12172 raft_consensus.cc:357] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.620079 11920 raft_consensus.cc:2466] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.620134 12172 raft_consensus.cc:383] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.620164 12172 raft_consensus.cc:738] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.620267 12172 consensus_queue.cc:260] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.620535 12172 ts_tablet_manager.cc:1428] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.620563 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 265c10a0b44f49f5ba55224f7c1ec8c7
I20250625 14:01:52.620709 12172 tablet_bootstrap.cc:492] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.620898 11528 catalog_manager.cc:6652] ReplaceTablet: tablet 265c10a0b44f49f5ba55224f7c1ec8c7 deleted and replaced by tablet 44e926ec00614c31b2112c28ec546706
I20250625 14:01:52.621464 11717 leader_election.cc:304] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.621459 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "265c10a0b44f49f5ba55224f7c1ec8c7" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.621574 12057 raft_consensus.cc:3058] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.621760 12205 raft_consensus.cc:2802] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.621788 12172 tablet_bootstrap.cc:654] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.621897 12205 raft_consensus.cc:695] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:52.622040 12205 consensus_queue.cc:237] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.622694 12057 raft_consensus.cc:2466] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.623621 12233 tablet.cc:1722] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:52.624900 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 44e926ec00614c31b2112c28ec546706) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.625165 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0bf30c206f554b218008856045231f90
I20250625 14:01:52.625442 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 0bf30c206f554b218008856045231f90 deleted and replaced by tablet f5fdfb03404342778e33a9512004bec3
I20250625 14:01:52.625752 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_9373caf3ce8246379d0413f41703bb5f [id=78536fe9fe35426dbf8b277c45594020]). Expected version 2 got 0
I20250625 14:01:52.626400 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 0bf30c206f554b218008856045231f90 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fdfb03404342778e33a9512004bec3) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.626596 12173 tablet_replica.cc:331] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.626713 12172 tablet_bootstrap.cc:492] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.626719 12173 raft_consensus.cc:2241] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.626796 12172 ts_tablet_manager.cc:1397] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:52.626783 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 44e926ec00614c31b2112c28ec546706) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.626832 12173 raft_consensus.cc:2270] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.626930 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 0bf30c206f554b218008856045231f90 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fdfb03404342778e33a9512004bec3) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.627071 12175 tablet_replica.cc:331] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.627183 12175 raft_consensus.cc:2241] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.627278 12175 raft_consensus.cc:2270] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.627265 12172 raft_consensus.cc:357] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.627363 12172 raft_consensus.cc:383] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.627352 12173 ts_tablet_manager.cc:1905] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.627393 12172 raft_consensus.cc:738] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.627514 12172 consensus_queue.cc:260] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.627743 12175 ts_tablet_manager.cc:1905] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.627799 12172 ts_tablet_manager.cc:1428] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.628010 12172 tablet_bootstrap.cc:492] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.629041 12172 tablet_bootstrap.cc:654] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.629627 12173 ts_tablet_manager.cc:1918] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.629694 12173 log.cc:1199] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/265c10a0b44f49f5ba55224f7c1ec8c7
I20250625 14:01:52.629910 12173 ts_tablet_manager.cc:1939] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.629987 12175 ts_tablet_manager.cc:1918] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.630041 12172 tablet_bootstrap.cc:492] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.630055 12175 log.cc:1199] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/265c10a0b44f49f5ba55224f7c1ec8c7
I20250625 14:01:52.630113 12172 ts_tablet_manager.cc:1397] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:52.630247 12175 ts_tablet_manager.cc:1939] T 265c10a0b44f49f5ba55224f7c1ec8c7 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.630586 12172 raft_consensus.cc:357] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.630693 12172 raft_consensus.cc:383] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.630736 12172 raft_consensus.cc:738] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.630764 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 265c10a0b44f49f5ba55224f7c1ec8c7 (table default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]) successfully deleted
I20250625 14:01:52.630851 12172 consensus_queue.cc:260] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.631103 12172 ts_tablet_manager.cc:1428] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:52.631930 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 44e926ec00614c31b2112c28ec546706) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.632254 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 0bf30c206f554b218008856045231f90 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fdfb03404342778e33a9512004bec3) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.633059 12210 mvcc.cc:204] Tried to move back new op lower bound from 7171523021175656448 to 7171523020851585024. Current Snapshot: MvccSnapshot[applied={T|T < 7171523021175656448}]
I20250625 14:01:52.632881 12239 tablet.cc:1722] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:52.635151 12177 tablet_replica.cc:331] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.635285 12177 raft_consensus.cc:2241] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:52.635434 12177 pending_rounds.cc:70] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:52.635466 12177 pending_rounds.cc:77] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523021301420032 op_type: NO_OP noop_request { }
I20250625 14:01:52.635517 12177 raft_consensus.cc:2887] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:52.635567 12177 raft_consensus.cc:2270] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:52.636307 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 0bf30c206f554b218008856045231f90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bf30c206f554b218008856045231f90 already in progress: creating tablet
I20250625 14:01:52.636967 12172 tablet_bootstrap.cc:492] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.636811 12236 tablet.cc:1722] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:52.637470 12233 tablet.cc:1717] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:52.638091 12172 tablet_bootstrap.cc:654] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.639356 12239 tablet.cc:1717] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:52.640004 11921 raft_consensus.cc:1273] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.640398 11784 raft_consensus.cc:1273] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.640417 12171 consensus_queue.cc:1035] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:52.640759 12234 consensus_queue.cc:1162] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "56419e38d8e34f6985d4d970c1ce76e5" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:01:52.640759 12171 consensus_queue.cc:1035] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:52.641260 12177 ts_tablet_manager.cc:1905] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.643410 12177 ts_tablet_manager.cc:1918] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:52.643476 12177 log.cc:1199] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/265c10a0b44f49f5ba55224f7c1ec8c7
I20250625 14:01:52.643484 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 265c10a0b44f49f5ba55224f7c1ec8c7 (table default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]) successfully deleted
W20250625 14:01:52.643699 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 0bf30c206f554b218008856045231f90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0bf30c206f554b218008856045231f90 already in progress: creating tablet
I20250625 14:01:52.643734 12177 ts_tablet_manager.cc:1939] T 265c10a0b44f49f5ba55224f7c1ec8c7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.644299 12177 tablet_replica.cc:331] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.644418 12177 raft_consensus.cc:2241] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.644513 12177 raft_consensus.cc:2270] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.644770 12236 tablet.cc:1717] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:52.645023 12177 ts_tablet_manager.cc:1905] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.646198 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 265c10a0b44f49f5ba55224f7c1ec8c7 (table default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]) successfully deleted
I20250625 14:01:52.646615 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 57fd02ad8c9748129f46fbffc6c178f2
I20250625 14:01:52.646853 12177 ts_tablet_manager.cc:1918] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.646893 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 57fd02ad8c9748129f46fbffc6c178f2 deleted and replaced by tablet c707e7e992654147b71f75352a1c484d
I20250625 14:01:52.646916 12177 log.cc:1199] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0bf30c206f554b218008856045231f90
I20250625 14:01:52.647131 12177 ts_tablet_manager.cc:1939] T 0bf30c206f554b218008856045231f90 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.647737 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 57fd02ad8c9748129f46fbffc6c178f2 with delete_type TABLET_DATA_DELETED (replaced by tablet c707e7e992654147b71f75352a1c484d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.648195 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 57fd02ad8c9748129f46fbffc6c178f2 with delete_type TABLET_DATA_DELETED (replaced by tablet c707e7e992654147b71f75352a1c484d) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:52.648244 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 57fd02ad8c9748129f46fbffc6c178f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57fd02ad8c9748129f46fbffc6c178f2 already in progress: creating tablet
I20250625 14:01:52.648473 12172 tablet_bootstrap.cc:492] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.648566 12172 ts_tablet_manager.cc:1397] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:52.648584 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0bf30c206f554b218008856045231f90 (table default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]) successfully deleted
I20250625 14:01:52.648928 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 57fd02ad8c9748129f46fbffc6c178f2 with delete_type TABLET_DATA_DELETED (replaced by tablet c707e7e992654147b71f75352a1c484d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.649073 12172 raft_consensus.cc:357] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.649194 12172 raft_consensus.cc:383] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.649230 12172 raft_consensus.cc:738] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.649370 12172 consensus_queue.cc:260] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.649664 12172 ts_tablet_manager.cc:1428] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.649812 12177 tablet_replica.cc:331] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.649920 12177 raft_consensus.cc:2241] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.649930 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 19c33ee6404a43edbbedb843fd072148
I20250625 14:01:52.650020 12177 raft_consensus.cc:2270] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.650270 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 19c33ee6404a43edbbedb843fd072148 deleted and replaced by tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf
I20250625 14:01:52.650485 12177 ts_tablet_manager.cc:1905] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:52.650592 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 57fd02ad8c9748129f46fbffc6c178f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57fd02ad8c9748129f46fbffc6c178f2 already in progress: creating tablet
I20250625 14:01:52.650974 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 19c33ee6404a43edbbedb843fd072148 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.651153 12173 tablet_replica.cc:331] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.651162 12167 tablet_bootstrap.cc:492] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.651304 12173 raft_consensus.cc:2241] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.651376 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 19c33ee6404a43edbbedb843fd072148 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.651425 12173 raft_consensus.cc:2270] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.651309 12167 ts_tablet_manager.cc:1397] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
I20250625 14:01:52.651952 12173 ts_tablet_manager.cc:1905] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.652073 12167 raft_consensus.cc:357] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.652187 12167 raft_consensus.cc:383] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.652261 12167 raft_consensus.cc:738] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.652385 12167 consensus_queue.cc:260] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.652643 12167 ts_tablet_manager.cc:1428] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.652840 12167 tablet_bootstrap.cc:492] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.653905 12167 tablet_bootstrap.cc:654] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.654067 12173 ts_tablet_manager.cc:1918] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.654098 12172 tablet_bootstrap.cc:492] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.654132 12173 log.cc:1199] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/19c33ee6404a43edbbedb843fd072148
I20250625 14:01:52.654392 12173 ts_tablet_manager.cc:1939] T 19c33ee6404a43edbbedb843fd072148 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.655073 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 19c33ee6404a43edbbedb843fd072148 (table default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]) successfully deleted
I20250625 14:01:52.655220 12172 tablet_bootstrap.cc:654] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.655483 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 19c33ee6404a43edbbedb843fd072148 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.656545 12177 ts_tablet_manager.cc:1918] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.656613 12177 log.cc:1199] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/57fd02ad8c9748129f46fbffc6c178f2
I20250625 14:01:52.656814 12177 ts_tablet_manager.cc:1939] T 57fd02ad8c9748129f46fbffc6c178f2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.657558 12177 tablet_replica.cc:331] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.657678 12177 raft_consensus.cc:2241] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.657775 12177 raft_consensus.cc:2270] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.648928 12166 tablet_bootstrap.cc:492] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.658553 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 57fd02ad8c9748129f46fbffc6c178f2 (table default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]) successfully deleted
I20250625 14:01:52.658653 12166 ts_tablet_manager.cc:1397] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20250625 14:01:52.658845 12177 ts_tablet_manager.cc:1905] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.659020 12233 tablet.cc:1722] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:52.659190 12166 raft_consensus.cc:357] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.659328 12166 raft_consensus.cc:383] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.659363 12166 raft_consensus.cc:738] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.659478 12166 consensus_queue.cc:260] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.659739 12166 ts_tablet_manager.cc:1428] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:52.659910 12166 tablet_bootstrap.cc:492] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.660960 12177 ts_tablet_manager.cc:1918] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.660995 12166 tablet_bootstrap.cc:654] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.661034 12177 log.cc:1199] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/19c33ee6404a43edbbedb843fd072148
I20250625 14:01:52.661254 12177 ts_tablet_manager.cc:1939] T 19c33ee6404a43edbbedb843fd072148 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:52.661868 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 19c33ee6404a43edbbedb843fd072148 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19c33ee6404a43edbbedb843fd072148 already in progress: creating tablet
I20250625 14:01:52.662559 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 19c33ee6404a43edbbedb843fd072148 (table default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]) successfully deleted
I20250625 14:01:52.662822 12172 tablet_bootstrap.cc:492] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.662966 12172 ts_tablet_manager.cc:1397] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:52.663492 12172 raft_consensus.cc:357] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.663663 12172 raft_consensus.cc:383] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.663753 12172 raft_consensus.cc:738] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.663923 12172 consensus_queue.cc:260] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.664280 12172 ts_tablet_manager.cc:1428] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.664594 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 44e926ec00614c31b2112c28ec546706 (DEFAULT_TABLE table=default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.664880 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e926ec00614c31b2112c28ec546706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.666571 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 44e926ec00614c31b2112c28ec546706 (DEFAULT_TABLE table=default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.666811 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e926ec00614c31b2112c28ec546706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.667603 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 44e926ec00614c31b2112c28ec546706 (DEFAULT_TABLE table=default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.667815 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e926ec00614c31b2112c28ec546706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.669168 12172 tablet_bootstrap.cc:492] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.669816 11527 catalog_manager.cc:5582] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:52.670184 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 63f1676a2fc841f5b8fc60a6591b3824 (table default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]). Expected version 1 got 0
I20250625 14:01:52.670507 12172 tablet_bootstrap.cc:654] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.671653 12236 tablet.cc:1722] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:52.671744 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf (DEFAULT_TABLE table=default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.672050 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.672574 12241 tablet.cc:1722] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:52.673739 12213 mvcc.cc:204] Tried to move back new op lower bound from 7171523021368496128 to 7171523020985344000. Current Snapshot: MvccSnapshot[applied={T|T < 7171523021368496128}]
I20250625 14:01:52.674909 11899 tablet_service.cc:1468] Processing CreateTablet for tablet c707e7e992654147b71f75352a1c484d (DEFAULT_TABLE table=default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.675143 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c707e7e992654147b71f75352a1c484d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.675472 12161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:52.675529 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf (DEFAULT_TABLE table=default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.675583 12161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
I20250625 14:01:52.675757 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.675911 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf (DEFAULT_TABLE table=default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.676151 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.677917 12167 tablet_bootstrap.cc:492] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.678010 12167 ts_tablet_manager.cc:1397] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20250625 14:01:52.678642 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_9373caf3ce8246379d0413f41703bb5f [id=78536fe9fe35426dbf8b277c45594020]). Expected version 2 got 0
I20250625 14:01:52.679708 12167 raft_consensus.cc:357] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.680173 12167 raft_consensus.cc:383] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.680275 12167 raft_consensus.cc:738] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.680461 12167 consensus_queue.cc:260] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.681686 11900 tablet_service.cc:1468] Processing CreateTablet for tablet f5fdfb03404342778e33a9512004bec3 (DEFAULT_TABLE table=default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.682003 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fdfb03404342778e33a9512004bec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.682161 11764 tablet_service.cc:1468] Processing CreateTablet for tablet f5fdfb03404342778e33a9512004bec3 (DEFAULT_TABLE table=default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.682499 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fdfb03404342778e33a9512004bec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.683357 12236 tablet.cc:1717] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:52.683892 12167 ts_tablet_manager.cc:1428] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:52.684072 12167 tablet_bootstrap.cc:492] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.684324 12172 tablet_bootstrap.cc:492] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.684386 12172 ts_tablet_manager.cc:1397] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:52.684837 12172 raft_consensus.cc:357] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.684952 12172 raft_consensus.cc:383] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.685004 12172 raft_consensus.cc:738] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.685108 12167 tablet_bootstrap.cc:654] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.685146 12172 consensus_queue.cc:260] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.685410 12172 ts_tablet_manager.cc:1428] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.685580 12172 tablet_bootstrap.cc:492] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.685997 12233 tablet.cc:1717] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:52.686508 12172 tablet_bootstrap.cc:654] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.687211 12036 tablet_service.cc:1468] Processing CreateTablet for tablet c707e7e992654147b71f75352a1c484d (DEFAULT_TABLE table=default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.687470 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c707e7e992654147b71f75352a1c484d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.687430 12034 tablet_service.cc:1468] Processing CreateTablet for tablet f5fdfb03404342778e33a9512004bec3 (DEFAULT_TABLE table=default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.687638 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fdfb03404342778e33a9512004bec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.687641 11760 tablet_service.cc:1468] Processing CreateTablet for tablet c707e7e992654147b71f75352a1c484d (DEFAULT_TABLE table=default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.687870 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c707e7e992654147b71f75352a1c484d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.690371 12166 tablet_bootstrap.cc:492] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.690438 12241 tablet.cc:1717] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:52.690471 12166 ts_tablet_manager.cc:1397] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:01:52.690975 12166 raft_consensus.cc:357] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.691082 12166 raft_consensus.cc:383] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.691103 12166 raft_consensus.cc:738] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.691215 12166 consensus_queue.cc:260] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.691475 12166 ts_tablet_manager.cc:1428] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.691645 12166 tablet_bootstrap.cc:492] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.693008 12166 tablet_bootstrap.cc:654] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.693651 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_9373caf3ce8246379d0413f41703bb5f [id=78536fe9fe35426dbf8b277c45594020] alter complete (version 2)
I20250625 14:01:52.694558 12172 tablet_bootstrap.cc:492] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.694658 12172 ts_tablet_manager.cc:1397] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:52.694664 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 44e926ec00614c31b2112c28ec546706) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.695098 12172 raft_consensus.cc:357] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.695183 12172 raft_consensus.cc:383] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.695204 12172 raft_consensus.cc:738] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.695335 12172 consensus_queue.cc:260] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.695606 12172 ts_tablet_manager.cc:1428] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.695787 12172 tablet_bootstrap.cc:492] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.696866 12172 tablet_bootstrap.cc:654] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.697052 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d]). Expected version 1 got 0
W20250625 14:01:52.698029 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 because the tablet was not found. No further retry: Not found: Tablet not found: 265c10a0b44f49f5ba55224f7c1ec8c7
I20250625 14:01:52.698650 12172 tablet_bootstrap.cc:492] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.698791 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 44e926ec00614c31b2112c28ec546706) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.698799 12172 ts_tablet_manager.cc:1397] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20250625 14:01:52.699083 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 19c33ee6404a43edbbedb843fd072148 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.699572 12172 raft_consensus.cc:357] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.699692 12172 raft_consensus.cc:383] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.699724 12172 raft_consensus.cc:738] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.699832 12172 consensus_queue.cc:260] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.699941 12167 tablet_bootstrap.cc:492] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.700029 12167 ts_tablet_manager.cc:1397] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
W20250625 14:01:52.700259 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 265c10a0b44f49f5ba55224f7c1ec8c7 because the tablet was not found. No further retry: Not found: Tablet not found: 265c10a0b44f49f5ba55224f7c1ec8c7
I20250625 14:01:52.700361 12172 ts_tablet_manager.cc:1428] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20250625 14:01:52.700410 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 19c33ee6404a43edbbedb843fd072148 because the tablet was not found. No further retry: Not found: Tablet not found: 19c33ee6404a43edbbedb843fd072148
I20250625 14:01:52.700536 12172 tablet_bootstrap.cc:492] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.700515 12167 raft_consensus.cc:357] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.700613 12167 raft_consensus.cc:383] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.700642 12167 raft_consensus.cc:738] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.700757 12167 consensus_queue.cc:260] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.701037 12167 ts_tablet_manager.cc:1428] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:52.701263 12167 tablet_bootstrap.cc:492] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.701573 12172 tablet_bootstrap.cc:654] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.703153 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d] alter complete (version 2)
I20250625 14:01:52.703269 12167 tablet_bootstrap.cc:654] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:52.703984 11526 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_36ee4ee859624376a5fdf46e0b8633eb [id=998d811ce0b248cabdf95ddf2f1d5f1d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 44e926ec00614c31b2112c28ec546706 consensus state has no leader
I20250625 14:01:52.704314 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 0bf30c206f554b218008856045231f90 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fdfb03404342778e33a9512004bec3) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.704533 12175 tablet_replica.cc:331] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.704669 12175 raft_consensus.cc:2241] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.704783 12175 raft_consensus.cc:2270] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.704864 12167 tablet_bootstrap.cc:492] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.704941 12167 ts_tablet_manager.cc:1397] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20250625 14:01:52.705065 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 57fd02ad8c9748129f46fbffc6c178f2 with delete_type TABLET_DATA_DELETED (replaced by tablet c707e7e992654147b71f75352a1c484d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.705410 12167 raft_consensus.cc:357] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.705519 12167 raft_consensus.cc:383] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.705554 12167 raft_consensus.cc:738] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.705715 12173 tablet_replica.cc:331] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.705673 12167 consensus_queue.cc:260] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.705706 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 63f1676a2fc841f5b8fc60a6591b3824 (table default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]). Expected version 1 got 0
I20250625 14:01:52.705837 12173 raft_consensus.cc:2241] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.705919 12173 raft_consensus.cc:2270] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.706094 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 57fd02ad8c9748129f46fbffc6c178f2 with delete_type TABLET_DATA_DELETED (replaced by tablet c707e7e992654147b71f75352a1c484d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.706190 12167 ts_tablet_manager.cc:1428] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:52.706456 12167 tablet_bootstrap.cc:492] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.706648 12173 ts_tablet_manager.cc:1905] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.707418 12167 tablet_bootstrap.cc:654] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.707715 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c26da442fe0d4b83aafcd330909cb69b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.708173 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c26da442fe0d4b83aafcd330909cb69b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.708448 12167 tablet_bootstrap.cc:492] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.708518 12167 ts_tablet_manager.cc:1397] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20250625 14:01:52.708953 12173 ts_tablet_manager.cc:1918] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.709024 12167 raft_consensus.cc:357] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.709117 12167 raft_consensus.cc:383] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.709151 12167 raft_consensus.cc:738] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.709252 12167 consensus_queue.cc:260] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.709517 12167 ts_tablet_manager.cc:1428] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.710148 12175 ts_tablet_manager.cc:1905] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.710536 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.711602 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_41aff179ef0647bf861346e6d19e185f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.711768 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7fc376fdaa8b4298b06bcae3986df3c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.711915 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3b6fd368b65440c98670d7ad05b554bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.712054 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41aff179ef0647bf861346e6d19e185f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:52.712112 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fc376fdaa8b4298b06bcae3986df3c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:52.712213 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b6fd368b65440c98670d7ad05b554bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.712399 12175 ts_tablet_manager.cc:1918] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.712481 12175 log.cc:1199] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0bf30c206f554b218008856045231f90
I20250625 14:01:52.712698 12175 ts_tablet_manager.cc:1939] T 0bf30c206f554b218008856045231f90 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.712939 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_843d36b395ad4352a622e69d12b0da1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.713290 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_843d36b395ad4352a622e69d12b0da1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.713461 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c544019d9803494583e4e25b47a7b50d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.713725 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c544019d9803494583e4e25b47a7b50d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.714279 12166 tablet_bootstrap.cc:492] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.714406 12166 ts_tablet_manager.cc:1397] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:52.714687 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0bf30c206f554b218008856045231f90 (table default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]) successfully deleted
I20250625 14:01:52.714677 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.714901 12177 tablet_replica.cc:331] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.714854 12166 raft_consensus.cc:357] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.714969 12166 raft_consensus.cc:383] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.715010 12166 raft_consensus.cc:738] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.715050 12177 raft_consensus.cc:2241] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.715160 12177 raft_consensus.cc:2270] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.715139 12166 consensus_queue.cc:260] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.715422 12166 ts_tablet_manager.cc:1428] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.715410 12167 tablet_bootstrap.cc:492] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.715593 12166 tablet_bootstrap.cc:492] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.716615 12166 tablet_bootstrap.cc:654] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.709026 12173 log.cc:1199] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/57fd02ad8c9748129f46fbffc6c178f2
I20250625 14:01:52.717844 12173 ts_tablet_manager.cc:1939] T 57fd02ad8c9748129f46fbffc6c178f2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.718035 12172 tablet_bootstrap.cc:492] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.718132 12172 ts_tablet_manager.cc:1397] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.002s
I20250625 14:01:52.718464 12177 ts_tablet_manager.cc:1905] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.718482 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 0bf30c206f554b218008856045231f90 with delete_type TABLET_DATA_DELETED (replaced by tablet f5fdfb03404342778e33a9512004bec3) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.718616 12172 raft_consensus.cc:357] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.718719 12172 raft_consensus.cc:383] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.718744 12173 tablet_replica.cc:331] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.718755 12172 raft_consensus.cc:738] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.718854 12173 raft_consensus.cc:2241] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.718876 12172 consensus_queue.cc:260] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.718967 12173 raft_consensus.cc:2270] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.719079 12167 tablet_bootstrap.cc:654] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.719151 12172 ts_tablet_manager.cc:1428] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250625 14:01:52.719408 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 57fd02ad8c9748129f46fbffc6c178f2 (table default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]) successfully deleted
I20250625 14:01:52.720211 12175 tablet_replica.cc:331] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.720343 12175 raft_consensus.cc:2241] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.720446 12175 raft_consensus.cc:2270] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.720736 12177 ts_tablet_manager.cc:1918] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.720808 12177 log.cc:1199] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/3f433ff8fc284bb8b71f9d7d2b160d2d
I20250625 14:01:52.721004 12177 ts_tablet_manager.cc:1939] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.722873 12175 ts_tablet_manager.cc:1905] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.724001 12219 raft_consensus.cc:491] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.724105 12219 raft_consensus.cc:513] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.724431 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f07dddb6ca7a448985331ebf73b3cee3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.724539 12219 leader_election.cc:290] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:52.724834 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f07dddb6ca7a448985331ebf73b3cee3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.725361 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b736442acaca4a00b408d4fb0a3495aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.725666 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b736442acaca4a00b408d4fb0a3495aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:52.727923 11990 leader_election.cc:343] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 0bf30c206f554b218008856045231f90
I20250625 14:01:52.728217 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b1b9c613998f458f838388b3871d94f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.728590 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1b9c613998f458f838388b3871d94f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.729064 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 3f433ff8fc284bb8b71f9d7d2b160d2d (table default.Table_3702c1a05762460794ae97100930f18c [id=0b415260a5134ff6ba2666d34d17b0b3]) successfully deleted
I20250625 14:01:52.729774 12175 ts_tablet_manager.cc:1918] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.729857 12175 log.cc:1199] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/57fd02ad8c9748129f46fbffc6c178f2
I20250625 14:01:52.730091 12175 ts_tablet_manager.cc:1939] T 57fd02ad8c9748129f46fbffc6c178f2 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:01:52.730293 11993 leader_election.cc:343] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 0bf30c206f554b218008856045231f90
I20250625 14:01:52.730398 11993 leader_election.cc:304] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:52.730675 12219 raft_consensus.cc:2747] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:52.731005 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 57fd02ad8c9748129f46fbffc6c178f2 (table default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]) successfully deleted
I20250625 14:01:52.731314 12173 ts_tablet_manager.cc:1905] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.731532 12166 tablet_bootstrap.cc:492] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.731627 12166 ts_tablet_manager.cc:1397] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250625 14:01:52.732120 12166 raft_consensus.cc:357] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.732264 12166 raft_consensus.cc:383] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.732303 12166 raft_consensus.cc:738] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.732432 12166 consensus_queue.cc:260] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.733959 12173 ts_tablet_manager.cc:1918] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.734115 12173 log.cc:1199] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/3f433ff8fc284bb8b71f9d7d2b160d2d
I20250625 14:01:52.734553 12173 ts_tablet_manager.cc:1939] T 3f433ff8fc284bb8b71f9d7d2b160d2d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.734607 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 1a3907e22505461a8df58ec339c342da (DEFAULT_TABLE table=default.Table_c26da442fe0d4b83aafcd330909cb69b [id=ddedb1af9caa48b898f29c930bbf6bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.734752 12166 ts_tablet_manager.cc:1428] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:52.734952 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a3907e22505461a8df58ec339c342da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.735574 12173 tablet_replica.cc:331] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.735662 12166 tablet_bootstrap.cc:492] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.735754 12173 raft_consensus.cc:2241] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.735859 12173 raft_consensus.cc:2270] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.736354 12173 ts_tablet_manager.cc:1905] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.736804 12166 tablet_bootstrap.cc:654] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.736706 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3edd1f01767d41b5a77323b7403ded25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.737178 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3edd1f01767d41b5a77323b7403ded25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.737754 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 873a1c1cdef5407c99dc2da1a77822bc (DEFAULT_TABLE table=default.Table_41aff179ef0647bf861346e6d19e185f [id=32c6f57d20774d9b9bf27f8aea055cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.738001 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873a1c1cdef5407c99dc2da1a77822bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.738368 12166 tablet_bootstrap.cc:492] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.738448 12166 ts_tablet_manager.cc:1397] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.738394 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9373caf3ce8246379d0413f41703bb5f" } new_table_name: "default.Table_c40f23fe758c45e6a212b6500d7c6b03" modify_external_catalogs: true
I20250625 14:01:52.738550 12173 ts_tablet_manager.cc:1918] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.738624 12173 log.cc:1199] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0bf30c206f554b218008856045231f90
I20250625 14:01:52.738827 12173 ts_tablet_manager.cc:1939] T 0bf30c206f554b218008856045231f90 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.738924 12166 raft_consensus.cc:357] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.739032 12166 raft_consensus.cc:383] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.739068 12166 raft_consensus.cc:738] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.739202 12166 consensus_queue.cc:260] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.739369 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3520facf466e4d6ebff18fc900b4f46e" } modify_external_catalogs: true
I20250625 14:01:52.739468 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3520facf466e4d6ebff18fc900b4f46e" } modify_external_catalogs: true
I20250625 14:01:52.739490 12166 ts_tablet_manager.cc:1428] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.739684 12166 tablet_bootstrap.cc:492] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.740163 12259 raft_consensus.cc:491] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.740245 12259 raft_consensus.cc:513] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.740934 12166 tablet_bootstrap.cc:654] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.741770 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_36ee4ee859624376a5fdf46e0b8633eb" } new_table_name: "default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad" modify_external_catalogs: true
I20250625 14:01:52.742100 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_83c625f3606a4d38881343f54bb21815" } modify_external_catalogs: true
I20250625 14:01:52.742209 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_83c625f3606a4d38881343f54bb21815" } modify_external_catalogs: true
I20250625 14:01:52.742542 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c544019d9803494583e4e25b47a7b50d" } new_table_name: "default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb" modify_external_catalogs: true
I20250625 14:01:52.743163 12166 tablet_bootstrap.cc:492] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.743268 12166 ts_tablet_manager.cc:1397] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:52.743677 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_203f3bd31394469a94a5fbbc34f6be42" } modify_external_catalogs: true
I20250625 14:01:52.743759 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_203f3bd31394469a94a5fbbc34f6be42" } modify_external_catalogs: true
I20250625 14:01:52.743798 12166 raft_consensus.cc:357] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.743896 12166 raft_consensus.cc:383] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.743927 12166 raft_consensus.cc:738] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.744804 12172 tablet_bootstrap.cc:492] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.744932 12166 consensus_queue.cc:260] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.745402 12166 ts_tablet_manager.cc:1428] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:52.745721 12166 tablet_bootstrap.cc:492] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.745985 12172 tablet_bootstrap.cc:654] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.747102 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63f1676a2fc841f5b8fc60a6591b3824" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:52.747249 11784 raft_consensus.cc:2466] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:52.747437 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 873a1c1cdef5407c99dc2da1a77822bc (DEFAULT_TABLE table=default.Table_41aff179ef0647bf861346e6d19e185f [id=32c6f57d20774d9b9bf27f8aea055cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.747704 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873a1c1cdef5407c99dc2da1a77822bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.747756 12166 tablet_bootstrap.cc:654] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.747864 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 1a3907e22505461a8df58ec339c342da (DEFAULT_TABLE table=default.Table_c26da442fe0d4b83aafcd330909cb69b [id=ddedb1af9caa48b898f29c930bbf6bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.748159 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a3907e22505461a8df58ec339c342da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.748939 12166 tablet_bootstrap.cc:492] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.749018 12166 ts_tablet_manager.cc:1397] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.749472 12166 raft_consensus.cc:357] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.749572 12166 raft_consensus.cc:383] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.749603 12166 raft_consensus.cc:738] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.749723 12166 consensus_queue.cc:260] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.747439 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 1a3907e22505461a8df58ec339c342da (DEFAULT_TABLE table=default.Table_c26da442fe0d4b83aafcd330909cb69b [id=ddedb1af9caa48b898f29c930bbf6bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.750000 12166 ts_tablet_manager.cc:1428] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.750098 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a3907e22505461a8df58ec339c342da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.750202 12166 tablet_bootstrap.cc:492] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.747874 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 873a1c1cdef5407c99dc2da1a77822bc (DEFAULT_TABLE table=default.Table_41aff179ef0647bf861346e6d19e185f [id=32c6f57d20774d9b9bf27f8aea055cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.751368 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873a1c1cdef5407c99dc2da1a77822bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.751935 12166 tablet_bootstrap.cc:654] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.753650 12166 tablet_bootstrap.cc:492] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.753733 12166 ts_tablet_manager.cc:1397] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:52.754123 11858 leader_election.cc:304] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.754252 12166 raft_consensus.cc:357] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.754381 12166 raft_consensus.cc:383] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.754426 12166 raft_consensus.cc:738] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.754542 12166 consensus_queue.cc:260] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.747172 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 3f433ff8fc284bb8b71f9d7d2b160d2d (table default.Table_3702c1a05762460794ae97100930f18c [id=0b415260a5134ff6ba2666d34d17b0b3]) successfully deleted
I20250625 14:01:52.754936 12166 ts_tablet_manager.cc:1428] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.754993 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0bf30c206f554b218008856045231f90 (table default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]) successfully deleted
I20250625 14:01:52.755129 12166 tablet_bootstrap.cc:492] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.755451 12259 leader_election.cc:290] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.755627 12259 raft_consensus.cc:2802] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.755717 12259 raft_consensus.cc:491] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.755815 12259 raft_consensus.cc:3058] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.756283 12166 tablet_bootstrap.cc:654] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.756925 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c26da442fe0d4b83aafcd330909cb69b" } new_table_name: "default.Table_0d953c5d6072467bab1a7d797eb13dc6" modify_external_catalogs: true
I20250625 14:01:52.757794 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b1b9c613998f458f838388b3871d94f5" } new_table_name: "default.Table_ed4f16f35df243efae3f4c6bfff51566" modify_external_catalogs: true
I20250625 14:01:52.758598 12166 tablet_bootstrap.cc:492] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.758700 12166 ts_tablet_manager.cc:1397] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:52.759030 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_41aff179ef0647bf861346e6d19e185f" } modify_external_catalogs: true
I20250625 14:01:52.759138 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_41aff179ef0647bf861346e6d19e185f" } modify_external_catalogs: true
I20250625 14:01:52.759187 12166 raft_consensus.cc:357] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.759315 12166 raft_consensus.cc:383] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.759356 12166 raft_consensus.cc:738] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.759483 12166 consensus_queue.cc:260] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.759770 12166 ts_tablet_manager.cc:1428] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.759845 12167 tablet_bootstrap.cc:492] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.759931 12167 ts_tablet_manager.cc:1397] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.000s
I20250625 14:01:52.759965 12166 tablet_bootstrap.cc:492] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.760408 12167 raft_consensus.cc:357] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.760514 12167 raft_consensus.cc:383] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.760548 12167 raft_consensus.cc:738] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.760677 12167 consensus_queue.cc:260] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.760938 12167 ts_tablet_manager.cc:1428] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.760972 12166 tablet_bootstrap.cc:654] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.761179 12167 tablet_bootstrap.cc:492] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.762248 12167 tablet_bootstrap.cc:654] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.762909 12166 tablet_bootstrap.cc:492] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.763001 12166 ts_tablet_manager.cc:1397] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.763509 12166 raft_consensus.cc:357] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.763625 12166 raft_consensus.cc:383] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.763660 12166 raft_consensus.cc:738] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.763787 12166 consensus_queue.cc:260] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.764063 12166 ts_tablet_manager.cc:1428] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:52.764943 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44e926ec00614c31b2112c28ec546706 consensus state has no leader
I20250625 14:01:52.765046 12166 tablet_bootstrap.cc:492] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.765053 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63f1676a2fc841f5b8fc60a6591b3824" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.765223 12057 raft_consensus.cc:2466] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:52.766407 12219 raft_consensus.cc:491] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.766494 12219 raft_consensus.cc:513] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.766892 12219 leader_election.cc:290] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.767375 12166 tablet_bootstrap.cc:654] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.768397 12233 tablet.cc:1722] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:52.768833 12241 tablet.cc:1722] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:52.769145 12236 tablet.cc:1722] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:52.771137 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c37dd3f9883c41dd9a0255fd5060328e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.771271 11921 raft_consensus.cc:2466] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:52.771493 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c37dd3f9883c41dd9a0255fd5060328e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:52.771634 11784 raft_consensus.cc:2466] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:52.772030 11990 leader_election.cc:304] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.772189 12166 tablet_bootstrap.cc:492] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.772209 12219 raft_consensus.cc:2802] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.772262 12219 raft_consensus.cc:491] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.772298 12219 raft_consensus.cc:3058] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.772291 12166 ts_tablet_manager.cc:1397] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:52.772782 12166 raft_consensus.cc:357] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.772884 12166 raft_consensus.cc:383] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.772918 12166 raft_consensus.cc:738] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.773041 12166 consensus_queue.cc:260] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.773227 12219 raft_consensus.cc:513] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.773332 12166 ts_tablet_manager.cc:1428] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.773499 12166 tablet_bootstrap.cc:492] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.773571 12219 leader_election.cc:290] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:52.774209 12259 raft_consensus.cc:513] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.774464 12170 raft_consensus.cc:491] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.774544 12170 raft_consensus.cc:513] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.774919 12170 leader_election.cc:290] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.775210 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c37dd3f9883c41dd9a0255fd5060328e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.775323 11921 raft_consensus.cc:3058] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.775327 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c37dd3f9883c41dd9a0255fd5060328e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:52.775442 11784 raft_consensus.cc:3058] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.776077 12167 tablet_bootstrap.cc:492] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.776106 12259 leader_election.cc:290] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.776161 12167 ts_tablet_manager.cc:1397] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:52.776307 11921 raft_consensus.cc:2466] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:52.776423 11784 raft_consensus.cc:2466] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:52.776700 12167 raft_consensus.cc:357] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.776808 12172 tablet_bootstrap.cc:492] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.776806 12167 raft_consensus.cc:383] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.776854 12167 raft_consensus.cc:738] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.776896 12172 ts_tablet_manager.cc:1397] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.002s
I20250625 14:01:52.777022 12167 consensus_queue.cc:260] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.777277 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63f1676a2fc841f5b8fc60a6591b3824" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.777328 12167 ts_tablet_manager.cc:1428] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.777374 12057 raft_consensus.cc:3058] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.777422 12172 raft_consensus.cc:357] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.777513 12172 raft_consensus.cc:383] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.777551 12172 raft_consensus.cc:738] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.777659 12172 consensus_queue.cc:260] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.777848 11990 leader_election.cc:304] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.777904 12172 ts_tablet_manager.cc:1428] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:52.778023 12219 raft_consensus.cc:2802] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.778100 12219 raft_consensus.cc:695] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:52.778101 12172 tablet_bootstrap.cc:492] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.778204 12219 consensus_queue.cc:237] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.778390 12057 raft_consensus.cc:2466] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:52.778626 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e408ae7998546e3a8ea5fb1f8e2bbbf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.779064 12167 tablet_bootstrap.cc:492] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.779157 12166 tablet_bootstrap.cc:654] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.779398 12172 tablet_bootstrap.cc:654] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.780187 11855 leader_election.cc:304] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.780234 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e408ae7998546e3a8ea5fb1f8e2bbbf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:52.780341 12167 tablet_bootstrap.cc:654] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.780344 11784 raft_consensus.cc:2466] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
W20250625 14:01:52.780464 11855 leader_election.cc:343] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:52.780510 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "63f1676a2fc841f5b8fc60a6591b3824" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:52.780601 11783 raft_consensus.cc:3058] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.780723 12265 raft_consensus.cc:2802] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.780813 12265 raft_consensus.cc:695] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:52.781064 12265 consensus_queue.cc:237] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.781571 11783 raft_consensus.cc:2466] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:52.781663 12167 tablet_bootstrap.cc:492] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.781736 12167 ts_tablet_manager.cc:1397] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:52.782023 11858 leader_election.cc:304] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:52.782207 12265 raft_consensus.cc:2802] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.782267 12265 raft_consensus.cc:491] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.782217 12167 raft_consensus.cc:357] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.782333 12265 raft_consensus.cc:3058] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.782342 12167 raft_consensus.cc:383] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.782382 12167 raft_consensus.cc:738] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.782500 12167 consensus_queue.cc:260] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.782953 12167 ts_tablet_manager.cc:1428] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.783139 12167 tablet_bootstrap.cc:492] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.783310 12265 raft_consensus.cc:513] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.784144 12167 tablet_bootstrap.cc:654] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.784227 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e408ae7998546e3a8ea5fb1f8e2bbbf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:52.784322 11783 raft_consensus.cc:3058] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.785163 11783 raft_consensus.cc:2466] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:52.785508 11858 leader_election.cc:304] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.785619 12166 tablet_bootstrap.cc:492] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.785701 12166 ts_tablet_manager.cc:1397] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:52.786121 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6e408ae7998546e3a8ea5fb1f8e2bbbf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.786170 12265 leader_election.cc:290] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.786227 12056 raft_consensus.cc:3058] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.786290 12265 raft_consensus.cc:2802] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.786401 12265 raft_consensus.cc:695] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:52.786530 12265 consensus_queue.cc:237] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.786188 12166 raft_consensus.cc:357] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.786891 12166 raft_consensus.cc:383] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.786923 12166 raft_consensus.cc:738] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.787060 12166 consensus_queue.cc:260] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.787215 12056 raft_consensus.cc:2466] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:52.787433 12166 ts_tablet_manager.cc:1428] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:52.787618 12166 tablet_bootstrap.cc:492] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.789219 12166 tablet_bootstrap.cc:654] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:52.789238 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 195690ee34cb442ab8509e51140af31f has no consensus state
I20250625 14:01:52.790241 12166 tablet_bootstrap.cc:492] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.790364 12166 ts_tablet_manager.cc:1397] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:52.790797 12166 raft_consensus.cc:357] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.790899 12166 raft_consensus.cc:383] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.790936 12166 raft_consensus.cc:738] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.791049 12166 consensus_queue.cc:260] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.791316 12166 ts_tablet_manager.cc:1428] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:52.792313 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f5fdfb03404342778e33a9512004bec3
W20250625 14:01:52.792415 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 608f1a63442842ef8cba9ed4e9f85d88 has no consensus state
I20250625 14:01:52.793674 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet f5fdfb03404342778e33a9512004bec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.793865 12177 tablet_replica.cc:331] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.793993 12177 raft_consensus.cc:2241] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.794111 12177 raft_consensus.cc:2270] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.794664 12177 ts_tablet_manager.cc:1905] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:52.794718 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a3907e22505461a8df58ec339c342da consensus state has no leader
I20250625 14:01:52.795100 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet f5fdfb03404342778e33a9512004bec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.795447 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet f5fdfb03404342778e33a9512004bec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.795017 12172 tablet_bootstrap.cc:492] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.795606 12175 tablet_replica.cc:331] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.795605 12172 ts_tablet_manager.cc:1397] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20250625 14:01:52.795717 12175 raft_consensus.cc:2241] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.795816 12175 raft_consensus.cc:2270] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.796144 12172 raft_consensus.cc:357] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:52.796207 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f5fdfb03404342778e33a9512004bec3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5fdfb03404342778e33a9512004bec3 already in progress: creating tablet
I20250625 14:01:52.796254 12172 raft_consensus.cc:383] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.796285 12172 raft_consensus.cc:738] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.796429 12172 consensus_queue.cc:260] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.796429 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b736442acaca4a00b408d4fb0a3495aa" } modify_external_catalogs: true
I20250625 14:01:52.796525 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b736442acaca4a00b408d4fb0a3495aa" } modify_external_catalogs: true
I20250625 14:01:52.796739 12172 ts_tablet_manager.cc:1428] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:52.797289 12175 ts_tablet_manager.cc:1905] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.798926 12167 tablet_bootstrap.cc:492] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.799046 12167 ts_tablet_manager.cc:1397] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250625 14:01:52.799458 12175 ts_tablet_manager.cc:1918] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.799551 12175 log.cc:1199] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f5fdfb03404342778e33a9512004bec3
I20250625 14:01:52.799762 12175 ts_tablet_manager.cc:1939] T f5fdfb03404342778e33a9512004bec3 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.799762 12167 raft_consensus.cc:357] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.799880 12167 raft_consensus.cc:383] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.799916 12167 raft_consensus.cc:738] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.800040 12167 consensus_queue.cc:260] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.800462 12167 ts_tablet_manager.cc:1428] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:52.800666 12167 tablet_bootstrap.cc:492] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.800911 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f5fdfb03404342778e33a9512004bec3 (table default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]) successfully deleted
I20250625 14:01:52.801209 12177 ts_tablet_manager.cc:1918] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.801292 12177 log.cc:1199] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f5fdfb03404342778e33a9512004bec3
I20250625 14:01:52.801520 12177 ts_tablet_manager.cc:1939] T f5fdfb03404342778e33a9512004bec3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.801750 12167 tablet_bootstrap.cc:654] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.803190 12167 tablet_bootstrap.cc:492] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.803293 12167 ts_tablet_manager.cc:1397] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:52.803591 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f5fdfb03404342778e33a9512004bec3 (table default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]) successfully deleted
I20250625 14:01:52.803823 12167 raft_consensus.cc:357] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.803921 12167 raft_consensus.cc:383] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.803965 12167 raft_consensus.cc:738] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.804088 12167 consensus_queue.cc:260] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.805622 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 (DEFAULT_TABLE table=default.Table_b736442acaca4a00b408d4fb0a3495aa [id=2fd36596ea3941a4b6c415cf994e3768]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.805691 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (DEFAULT_TABLE table=default.Table_7fc376fdaa8b4298b06bcae3986df3c4 [id=396b9df84d604d29b6f720475255a184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.805905 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524dab39595247ce8bd82ec90fcf7b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.806061 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 0396f83e03b649d5a146ae13be8666d7 (DEFAULT_TABLE table=default.Table_843d36b395ad4352a622e69d12b0da1c [id=324214b8959145bfb8cd6917f4892c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.806124 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.806061 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 195690ee34cb442ab8509e51140af31f (DEFAULT_TABLE table=default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb [id=21738c97530c4f83b4b3ef65c7c51320]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.806411 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0396f83e03b649d5a146ae13be8666d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.806658 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195690ee34cb442ab8509e51140af31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.808308 12172 tablet_bootstrap.cc:492] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.808295 11525 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 63f1676a2fc841f5b8fc60a6591b3824 (table default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]). Expected version 1 got 0
I20250625 14:01:52.809414 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c707e7e992654147b71f75352a1c484d
I20250625 14:01:52.809494 12172 tablet_bootstrap.cc:654] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.810176 12167 ts_tablet_manager.cc:1428] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:01:52.810604 12167 tablet_bootstrap.cc:492] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.810673 12172 tablet_bootstrap.cc:492] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.810748 12172 ts_tablet_manager.cc:1397] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:52.811252 12172 raft_consensus.cc:357] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.811370 12172 raft_consensus.cc:383] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.811388 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet c707e7e992654147b71f75352a1c484d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.811404 12172 raft_consensus.cc:738] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.811777 12167 tablet_bootstrap.cc:654] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.811753 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 (DEFAULT_TABLE table=default.Table_b736442acaca4a00b408d4fb0a3495aa [id=2fd36596ea3941a4b6c415cf994e3768]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.811898 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 0396f83e03b649d5a146ae13be8666d7 (DEFAULT_TABLE table=default.Table_843d36b395ad4352a622e69d12b0da1c [id=324214b8959145bfb8cd6917f4892c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.812022 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524dab39595247ce8bd82ec90fcf7b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.811998 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (DEFAULT_TABLE table=default.Table_7fc376fdaa8b4298b06bcae3986df3c4 [id=396b9df84d604d29b6f720475255a184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.812179 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.812305 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0396f83e03b649d5a146ae13be8666d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.812520 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 195690ee34cb442ab8509e51140af31f (DEFAULT_TABLE table=default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb [id=21738c97530c4f83b4b3ef65c7c51320]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.812709 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195690ee34cb442ab8509e51140af31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.812247 12172 consensus_queue.cc:260] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.814491 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet c707e7e992654147b71f75352a1c484d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.814659 12173 tablet_replica.cc:331] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.814769 12173 raft_consensus.cc:2241] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.814860 12173 raft_consensus.cc:2270] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.815321 12173 ts_tablet_manager.cc:1905] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.816511 12205 raft_consensus.cc:491] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.816603 12205 raft_consensus.cc:513] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.816964 12205 leader_election.cc:290] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.817654 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (DEFAULT_TABLE table=default.Table_7fc376fdaa8b4298b06bcae3986df3c4 [id=396b9df84d604d29b6f720475255a184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.817710 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 195690ee34cb442ab8509e51140af31f (DEFAULT_TABLE table=default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb [id=21738c97530c4f83b4b3ef65c7c51320]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.817931 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.817749 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 (DEFAULT_TABLE table=default.Table_b736442acaca4a00b408d4fb0a3495aa [id=2fd36596ea3941a4b6c415cf994e3768]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.818152 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524dab39595247ce8bd82ec90fcf7b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.818401 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 0396f83e03b649d5a146ae13be8666d7 (DEFAULT_TABLE table=default.Table_843d36b395ad4352a622e69d12b0da1c [id=324214b8959145bfb8cd6917f4892c0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.818611 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0396f83e03b649d5a146ae13be8666d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.820057 12173 ts_tablet_manager.cc:1918] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.820134 12173 log.cc:1199] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c707e7e992654147b71f75352a1c484d
I20250625 14:01:52.820371 12173 ts_tablet_manager.cc:1939] T c707e7e992654147b71f75352a1c484d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.820549 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet c707e7e992654147b71f75352a1c484d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.820624 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195690ee34cb442ab8509e51140af31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.820713 12175 tablet_replica.cc:331] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.820839 12175 raft_consensus.cc:2241] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.820989 12175 raft_consensus.cc:2270] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.821496 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c707e7e992654147b71f75352a1c484d (table default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]) successfully deleted
I20250625 14:01:52.822777 12175 ts_tablet_manager.cc:1905] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.823432 12177 tablet_replica.cc:331] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.823614 12177 raft_consensus.cc:2241] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.824061 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44e926ec00614c31b2112c28ec546706" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:52.824128 12172 ts_tablet_manager.cc:1428] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.013s user 0.000s sys 0.001s
I20250625 14:01:52.824126 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44e926ec00614c31b2112c28ec546706" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.824196 11921 raft_consensus.cc:2466] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.824271 12056 raft_consensus.cc:2466] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:52.824502 11717 leader_election.cc:304] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.824550 12177 raft_consensus.cc:2270] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.824707 12205 raft_consensus.cc:2802] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.824756 12205 raft_consensus.cc:491] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.824796 12205 raft_consensus.cc:3058] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.825006 12166 tablet_bootstrap.cc:492] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.825748 12175 ts_tablet_manager.cc:1918] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.825804 12175 log.cc:1199] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c707e7e992654147b71f75352a1c484d
I20250625 14:01:52.825817 12205 raft_consensus.cc:513] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.825989 12175 ts_tablet_manager.cc:1939] T c707e7e992654147b71f75352a1c484d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.826041 12172 tablet_bootstrap.cc:492] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.826184 12205 leader_election.cc:290] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.826670 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44e926ec00614c31b2112c28ec546706" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.826794 12056 raft_consensus.cc:3058] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.826984 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44e926ec00614c31b2112c28ec546706" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:52.827101 11921 raft_consensus.cc:3058] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.827162 12172 tablet_bootstrap.cc:654] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.827816 11921 raft_consensus.cc:2466] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.827971 12056 raft_consensus.cc:2466] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:52.828179 11717 leader_election.cc:304] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.828389 12172 tablet_bootstrap.cc:492] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.828466 12172 ts_tablet_manager.cc:1397] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:52.828657 12205 raft_consensus.cc:2802] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.828672 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c707e7e992654147b71f75352a1c484d (table default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]) successfully deleted
I20250625 14:01:52.828748 12205 raft_consensus.cc:695] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:52.828893 12205 consensus_queue.cc:237] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.829007 12166 tablet_bootstrap.cc:654] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.829067 12172 raft_consensus.cc:357] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.829141 12172 raft_consensus.cc:383] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.829162 12172 raft_consensus.cc:738] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.829282 12172 consensus_queue.cc:260] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.829566 12172 ts_tablet_manager.cc:1428] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.829739 12172 tablet_bootstrap.cc:492] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.832103 12172 tablet_bootstrap.cc:654] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.832096 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 524dab39595247ce8bd82ec90fcf7b54
I20250625 14:01:52.832262 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 63f1676a2fc841f5b8fc60a6591b3824
I20250625 14:01:52.832329 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 1a3907e22505461a8df58ec339c342da (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]). Expected version 1 got 0
I20250625 14:01:52.833441 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]). Expected version 2 got 0
I20250625 14:01:52.833632 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 63f1676a2fc841f5b8fc60a6591b3824 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.833568 11524 catalog_manager.cc:5582] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:52.833834 12175 tablet_replica.cc:331] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.833978 12175 raft_consensus.cc:2241] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:52.835362 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 873a1c1cdef5407c99dc2da1a77822bc
I20250625 14:01:52.836082 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.836083 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.836683 12175 pending_rounds.cc:70] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:52.836779 12175 pending_rounds.cc:77] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523021954281472 op_type: NO_OP noop_request { }
I20250625 14:01:52.836879 12175 raft_consensus.cc:2887] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:52.836915 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 873a1c1cdef5407c99dc2da1a77822bc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.836962 12175 raft_consensus.cc:2270] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.837800 12175 ts_tablet_manager.cc:1905] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.838101 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.838142 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 63f1676a2fc841f5b8fc60a6591b3824 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.838446 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 873a1c1cdef5407c99dc2da1a77822bc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.838481 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 0eb159c2babe400386e250da3a177c79 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.838737 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 63f1676a2fc841f5b8fc60a6591b3824 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.839359 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 873a1c1cdef5407c99dc2da1a77822bc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.839515 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 63f1676a2fc841f5b8fc60a6591b3824 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.840201 12175 ts_tablet_manager.cc:1918] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:52.840287 12175 log.cc:1199] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/63f1676a2fc841f5b8fc60a6591b3824
I20250625 14:01:52.840538 12175 ts_tablet_manager.cc:1939] T 63f1676a2fc841f5b8fc60a6591b3824 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.840621 12173 tablet_replica.cc:331] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:01:52.840716 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 524dab39595247ce8bd82ec90fcf7b54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 524dab39595247ce8bd82ec90fcf7b54 already in progress: creating tablet
I20250625 14:01:52.840790 12173 raft_consensus.cc:2241] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 14:01:52.840878 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 873a1c1cdef5407c99dc2da1a77822bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 873a1c1cdef5407c99dc2da1a77822bc already in progress: creating tablet
I20250625 14:01:52.840901 12173 raft_consensus.cc:2270] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.841312 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 63f1676a2fc841f5b8fc60a6591b3824 (table default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]) successfully deleted
I20250625 14:01:52.841482 12173 ts_tablet_manager.cc:1905] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:52.841739 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 524dab39595247ce8bd82ec90fcf7b54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 524dab39595247ce8bd82ec90fcf7b54 already in progress: creating tablet
I20250625 14:01:52.841922 12175 tablet_replica.cc:331] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.842058 12175 raft_consensus.cc:2241] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.842154 12175 raft_consensus.cc:2270] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.843461 12175 ts_tablet_manager.cc:1905] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.844369 12173 ts_tablet_manager.cc:1918] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.844491 12173 log.cc:1199] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/63f1676a2fc841f5b8fc60a6591b3824
I20250625 14:01:52.844738 12173 ts_tablet_manager.cc:1939] T 63f1676a2fc841f5b8fc60a6591b3824 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.845587 12175 ts_tablet_manager.cc:1918] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.845695 12175 log.cc:1199] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/873a1c1cdef5407c99dc2da1a77822bc
I20250625 14:01:52.845772 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 63f1676a2fc841f5b8fc60a6591b3824 (table default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]) successfully deleted
I20250625 14:01:52.846076 12175 ts_tablet_manager.cc:1939] T 873a1c1cdef5407c99dc2da1a77822bc P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.847792 12177 ts_tablet_manager.cc:1905] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.850780 12177 ts_tablet_manager.cc:1918] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.850873 12177 log.cc:1199] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c707e7e992654147b71f75352a1c484d
I20250625 14:01:52.851084 12177 ts_tablet_manager.cc:1939] T c707e7e992654147b71f75352a1c484d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.851670 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 63f1676a2fc841f5b8fc60a6591b3824 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.851814 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 3b578aeacb9743eb8c66de64117e54c0 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.852128 12177 tablet_replica.cc:331] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.852283 12177 raft_consensus.cc:2241] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.852391 12177 raft_consensus.cc:2270] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.852736 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 873a1c1cdef5407c99dc2da1a77822bc (table default.Table_41aff179ef0647bf861346e6d19e185f [id=32c6f57d20774d9b9bf27f8aea055cb7]) successfully deleted
I20250625 14:01:52.853440 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c707e7e992654147b71f75352a1c484d (table default.Table_3520facf466e4d6ebff18fc900b4f46e [id=80fb33dcf5074e76a1c5e45298907700]) successfully deleted
I20250625 14:01:52.853588 12166 tablet_bootstrap.cc:492] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.853681 12166 ts_tablet_manager.cc:1397] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250625 14:01:52.854283 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 1a3907e22505461a8df58ec339c342da (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]). Expected version 1 got 0
I20250625 14:01:52.854341 12166 raft_consensus.cc:357] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.854455 12166 raft_consensus.cc:383] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.854491 12166 raft_consensus.cc:738] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.854468 11531 catalog_manager.cc:5582] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:52.854625 12166 consensus_queue.cc:260] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.854768 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]). Expected version 2 got 0
I20250625 14:01:52.854931 12166 ts_tablet_manager.cc:1428] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.855048 12172 tablet_bootstrap.cc:492] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.855141 12166 tablet_bootstrap.cc:492] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.855157 12172 ts_tablet_manager.cc:1397] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20250625 14:01:52.855522 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020] alter complete (version 3)
I20250625 14:01:52.855615 12172 raft_consensus.cc:357] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.855716 12172 raft_consensus.cc:383] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.855746 12172 raft_consensus.cc:738] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.856420 12166 tablet_bootstrap.cc:654] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.857246 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 812d9a36acf644c99edfbf55086f9b25 (DEFAULT_TABLE table=default.Table_3edd1f01767d41b5a77323b7403ded25 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.857355 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 910f1645f58b4066ae5c7c61e966e64c (DEFAULT_TABLE table=default.Table_f07dddb6ca7a448985331ebf73b3cee3 [id=d1a9808588a74a90be4afc3e4205373e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.857398 12035 tablet_service.cc:1468] Processing CreateTablet for tablet f4e293a800f24030b7f52f707a3b40a8 (DEFAULT_TABLE table=default.Table_3b6fd368b65440c98670d7ad05b554bf [id=c62025e9d42b4db78e9c63a6ed7f9803]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.857443 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet c707e7e992654147b71f75352a1c484d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.857532 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812d9a36acf644c99edfbf55086f9b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.857755 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910f1645f58b4066ae5c7c61e966e64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.858052 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet f5fdfb03404342778e33a9512004bec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.858096 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 608f1a63442842ef8cba9ed4e9f85d88 (DEFAULT_TABLE table=default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.858350 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608f1a63442842ef8cba9ed4e9f85d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.858484 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 910f1645f58b4066ae5c7c61e966e64c (DEFAULT_TABLE table=default.Table_f07dddb6ca7a448985331ebf73b3cee3 [id=d1a9808588a74a90be4afc3e4205373e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.857246 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 608f1a63442842ef8cba9ed4e9f85d88 (DEFAULT_TABLE table=default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.858713 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910f1645f58b4066ae5c7c61e966e64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.860208 12173 tablet_replica.cc:331] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.860327 12173 raft_consensus.cc:2241] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.860455 12173 raft_consensus.cc:2270] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.860532 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 812d9a36acf644c99edfbf55086f9b25 (DEFAULT_TABLE table=default.Table_3edd1f01767d41b5a77323b7403ded25 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.860754 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812d9a36acf644c99edfbf55086f9b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.860853 11762 tablet_service.cc:1468] Processing CreateTablet for tablet f4e293a800f24030b7f52f707a3b40a8 (DEFAULT_TABLE table=default.Table_3b6fd368b65440c98670d7ad05b554bf [id=c62025e9d42b4db78e9c63a6ed7f9803]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.860921 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 812d9a36acf644c99edfbf55086f9b25 (DEFAULT_TABLE table=default.Table_3edd1f01767d41b5a77323b7403ded25 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.861088 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e293a800f24030b7f52f707a3b40a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.861210 12177 ts_tablet_manager.cc:1905] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.861187 11901 tablet_service.cc:1468] Processing CreateTablet for tablet f4e293a800f24030b7f52f707a3b40a8 (DEFAULT_TABLE table=default.Table_3b6fd368b65440c98670d7ad05b554bf [id=c62025e9d42b4db78e9c63a6ed7f9803]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.861409 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e293a800f24030b7f52f707a3b40a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.862979 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 910f1645f58b4066ae5c7c61e966e64c (DEFAULT_TABLE table=default.Table_f07dddb6ca7a448985331ebf73b3cee3 [id=d1a9808588a74a90be4afc3e4205373e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.863323 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812d9a36acf644c99edfbf55086f9b25. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.863546 12173 ts_tablet_manager.cc:1905] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:52.863546 11517 catalog_manager.cc:4895] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c707e7e992654147b71f75352a1c484d because the tablet was not found. No further retry: Not found: Tablet not found: c707e7e992654147b71f75352a1c484d
I20250625 14:01:52.863633 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910f1645f58b4066ae5c7c61e966e64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.863823 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608f1a63442842ef8cba9ed4e9f85d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.863319 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 608f1a63442842ef8cba9ed4e9f85d88 (DEFAULT_TABLE table=default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.864267 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608f1a63442842ef8cba9ed4e9f85d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.865681 12173 ts_tablet_manager.cc:1918] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.865751 12173 log.cc:1199] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f5fdfb03404342778e33a9512004bec3
I20250625 14:01:52.865980 12173 ts_tablet_manager.cc:1939] T f5fdfb03404342778e33a9512004bec3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.866150 12177 ts_tablet_manager.cc:1918] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.866231 12177 log.cc:1199] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/524dab39595247ce8bd82ec90fcf7b54
I20250625 14:01:52.866587 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e293a800f24030b7f52f707a3b40a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.866994 12177 ts_tablet_manager.cc:1939] T 524dab39595247ce8bd82ec90fcf7b54 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.869017 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f5fdfb03404342778e33a9512004bec3 (table default.Table_203f3bd31394469a94a5fbbc34f6be42 [id=3b7ea9b9f58e4a788fbb7c3fb47483fb]) successfully deleted
I20250625 14:01:52.869134 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 873a1c1cdef5407c99dc2da1a77822bc from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:52.869357 12172 consensus_queue.cc:260] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.869710 12172 ts_tablet_manager.cc:1428] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20250625 14:01:52.871903 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 524dab39595247ce8bd82ec90fcf7b54 (table default.Table_b736442acaca4a00b408d4fb0a3495aa [id=2fd36596ea3941a4b6c415cf994e3768]) successfully deleted
I20250625 14:01:52.872012 12166 tablet_bootstrap.cc:492] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.872109 12166 ts_tablet_manager.cc:1397] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:52.872161 12177 tablet_replica.cc:331] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.872298 12177 raft_consensus.cc:2241] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.872658 12166 raft_consensus.cc:357] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.872774 12166 raft_consensus.cc:383] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.872813 12166 raft_consensus.cc:738] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.872944 12166 consensus_queue.cc:260] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.872397 12177 raft_consensus.cc:2270] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.873256 12166 ts_tablet_manager.cc:1428] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:52.873464 12166 tablet_bootstrap.cc:492] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.873622 12177 ts_tablet_manager.cc:1905] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.875211 12166 tablet_bootstrap.cc:654] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.876055 12177 ts_tablet_manager.cc:1918] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.875968 11524 catalog_manager.cc:5582] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:52.876127 12177 log.cc:1199] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/63f1676a2fc841f5b8fc60a6591b3824
I20250625 14:01:52.876165 11524 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]). Expected version 2 got 0
I20250625 14:01:52.876341 12177 ts_tablet_manager.cc:1939] T 63f1676a2fc841f5b8fc60a6591b3824 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.877656 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3b578aeacb9743eb8c66de64117e54c0
I20250625 14:01:52.877933 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 3b578aeacb9743eb8c66de64117e54c0 deleted and replaced by tablet 0e6599cf920c4c8b8ed17ecad1a31338
I20250625 14:01:52.878908 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 63f1676a2fc841f5b8fc60a6591b3824 (table default.Table_83c625f3606a4d38881343f54bb21815 [id=265a5a30a83e4554a26fd5d40434a153]) successfully deleted
I20250625 14:01:52.879350 12166 tablet_bootstrap.cc:492] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.879443 12166 ts_tablet_manager.cc:1397] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:52.879993 12166 raft_consensus.cc:357] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.880120 12166 raft_consensus.cc:383] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.880151 12166 raft_consensus.cc:738] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.880290 12166 consensus_queue.cc:260] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.880383 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 873a1c1cdef5407c99dc2da1a77822bc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.880637 12166 ts_tablet_manager.cc:1428] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.880618 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 3b578aeacb9743eb8c66de64117e54c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6599cf920c4c8b8ed17ecad1a31338) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.880383 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 3b578aeacb9743eb8c66de64117e54c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6599cf920c4c8b8ed17ecad1a31338) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.880823 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 3b578aeacb9743eb8c66de64117e54c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 0e6599cf920c4c8b8ed17ecad1a31338) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.880908 12173 tablet_replica.cc:331] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.881088 12173 raft_consensus.cc:2241] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:52.881349 12173 raft_consensus.cc:2270] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.881753 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 19c33ee6404a43edbbedb843fd072148 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.882416 12167 tablet_bootstrap.cc:492] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.882529 12167 ts_tablet_manager.cc:1397] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.000s
I20250625 14:01:52.883085 12173 ts_tablet_manager.cc:1905] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.883140 12167 raft_consensus.cc:357] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.883271 12167 raft_consensus.cc:383] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.883301 12167 raft_consensus.cc:738] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.883533 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 63f1676a2fc841f5b8fc60a6591b3824 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.883842 12167 consensus_queue.cc:260] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.885855 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f433ff8fc284bb8b71f9d7d2b160d2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:52.885898 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 873a1c1cdef5407c99dc2da1a77822bc because the tablet was not found. No further retry: Not found: Tablet not found: 873a1c1cdef5407c99dc2da1a77822bc
I20250625 14:01:52.885792 12175 tablet_replica.cc:331] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.886386 12175 raft_consensus.cc:2241] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.886612 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 1a3907e22505461a8df58ec339c342da (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]). Expected version 1 got 0
I20250625 14:01:52.886682 12175 raft_consensus.cc:2270] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.887478 12167 ts_tablet_manager.cc:1428] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:01:52.887964 12175 ts_tablet_manager.cc:1905] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.888566 12172 tablet_bootstrap.cc:492] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.888830 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 1a3907e22505461a8df58ec339c342da (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]). Expected version 1 got 0
I20250625 14:01:52.889652 12167 tablet_bootstrap.cc:492] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.889876 12172 tablet_bootstrap.cc:654] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.890799 12167 tablet_bootstrap.cc:654] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.892736 12173 ts_tablet_manager.cc:1918] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:52.892849 12173 log.cc:1199] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/3b578aeacb9743eb8c66de64117e54c0
I20250625 14:01:52.893069 12175 ts_tablet_manager.cc:1918] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:52.893177 12175 log.cc:1199] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/3b578aeacb9743eb8c66de64117e54c0
I20250625 14:01:52.893297 12173 ts_tablet_manager.cc:1939] T 3b578aeacb9743eb8c66de64117e54c0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.893443 12175 ts_tablet_manager.cc:1939] T 3b578aeacb9743eb8c66de64117e54c0 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.894037 12175 tablet_replica.cc:331] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:52.894121 12166 tablet_bootstrap.cc:492] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.894178 12175 raft_consensus.cc:2241] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.894204 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 3b578aeacb9743eb8c66de64117e54c0 (table default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:52.894273 12175 raft_consensus.cc:2270] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.894565 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 3b578aeacb9743eb8c66de64117e54c0 (table default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:52.896083 12167 tablet_bootstrap.cc:492] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:52.896190 12167 ts_tablet_manager.cc:1397] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:52.896726 12167 raft_consensus.cc:357] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.896854 12167 raft_consensus.cc:383] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.896888 12167 raft_consensus.cc:738] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.897038 12167 consensus_queue.cc:260] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.897791 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0eb159c2babe400386e250da3a177c79
I20250625 14:01:52.898093 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 0eb159c2babe400386e250da3a177c79 deleted and replaced by tablet de2c07609c4847cc916776be3546cba1
I20250625 14:01:52.898092 12167 ts_tablet_manager.cc:1428] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:52.898586 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 0eb159c2babe400386e250da3a177c79 with delete_type TABLET_DATA_DELETED (replaced by tablet de2c07609c4847cc916776be3546cba1) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.898759 12173 tablet_replica.cc:331] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.898908 12173 raft_consensus.cc:2241] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.899060 12173 raft_consensus.cc:2270] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.899155 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 0eb159c2babe400386e250da3a177c79 with delete_type TABLET_DATA_DELETED (replaced by tablet de2c07609c4847cc916776be3546cba1) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.899525 12167 tablet_bootstrap.cc:492] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:52.899780 12173 ts_tablet_manager.cc:1905] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.900149 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:52.895282 12166 tablet_bootstrap.cc:654] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.901018 12167 tablet_bootstrap.cc:654] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.901767 12177 tablet_replica.cc:331] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.901932 12177 raft_consensus.cc:2241] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.902055 12177 raft_consensus.cc:2270] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.902334 12173 ts_tablet_manager.cc:1918] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250625 14:01:52.902424 12173 log.cc:1199] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0eb159c2babe400386e250da3a177c79
I20250625 14:01:52.902688 12173 ts_tablet_manager.cc:1939] T 0eb159c2babe400386e250da3a177c79 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.903154 12177 ts_tablet_manager.cc:1905] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.904484 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:52.904922 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 0eb159c2babe400386e250da3a177c79 with delete_type TABLET_DATA_DELETED (replaced by tablet de2c07609c4847cc916776be3546cba1) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.904965 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:52.906124 12177 ts_tablet_manager.cc:1918] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.906208 12177 log.cc:1199] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/873a1c1cdef5407c99dc2da1a77822bc
I20250625 14:01:52.906515 12177 ts_tablet_manager.cc:1939] T 873a1c1cdef5407c99dc2da1a77822bc P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.907248 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 873a1c1cdef5407c99dc2da1a77822bc (table default.Table_41aff179ef0647bf861346e6d19e185f [id=32c6f57d20774d9b9bf27f8aea055cb7]) successfully deleted
I20250625 14:01:52.907569 12175 ts_tablet_manager.cc:1905] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.907992 12177 tablet_replica.cc:331] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.908164 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 873a1c1cdef5407c99dc2da1a77822bc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:52.908186 12177 raft_consensus.cc:2241] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.908316 12177 raft_consensus.cc:2270] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.908433 12173 tablet_replica.cc:331] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:52.908567 12173 raft_consensus.cc:2241] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.908670 12173 raft_consensus.cc:2270] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.909102 12173 ts_tablet_manager.cc:1905] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.911243 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 0e6599cf920c4c8b8ed17ecad1a31338 (DEFAULT_TABLE table=default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.911588 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6599cf920c4c8b8ed17ecad1a31338. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.911590 12173 ts_tablet_manager.cc:1918] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.911671 12173 log.cc:1199] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/873a1c1cdef5407c99dc2da1a77822bc
I20250625 14:01:52.911883 12173 ts_tablet_manager.cc:1939] T 873a1c1cdef5407c99dc2da1a77822bc P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:52.912896 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 0e6599cf920c4c8b8ed17ecad1a31338 (DEFAULT_TABLE table=default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.912897 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 0e6599cf920c4c8b8ed17ecad1a31338 (DEFAULT_TABLE table=default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.913152 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6599cf920c4c8b8ed17ecad1a31338. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.913153 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6599cf920c4c8b8ed17ecad1a31338. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.914356 12177 ts_tablet_manager.cc:1905] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.914867 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 873a1c1cdef5407c99dc2da1a77822bc (table default.Table_41aff179ef0647bf861346e6d19e185f [id=32c6f57d20774d9b9bf27f8aea055cb7]) successfully deleted
I20250625 14:01:52.915580 12172 tablet_bootstrap.cc:492] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.915688 12172 ts_tablet_manager.cc:1397] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:01:52.916760 12177 ts_tablet_manager.cc:1918] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:52.916900 12177 log.cc:1199] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/3b578aeacb9743eb8c66de64117e54c0
I20250625 14:01:52.917125 12056 raft_consensus.cc:1273] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.917100 12172 raft_consensus.cc:357] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.917204 12172 raft_consensus.cc:383] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.917244 12172 raft_consensus.cc:738] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.917449 12177 ts_tablet_manager.cc:1939] T 3b578aeacb9743eb8c66de64117e54c0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.917865 11921 raft_consensus.cc:1273] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.918011 12177 tablet_replica.cc:331] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:52.918205 12177 raft_consensus.cc:2241] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:52.918452 12177 raft_consensus.cc:2270] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.918452 12208 consensus_queue.cc:1035] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:52.917364 12172 consensus_queue.cc:260] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.918574 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 3b578aeacb9743eb8c66de64117e54c0 (table default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:52.918622 12205 consensus_queue.cc:1035] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:52.919145 12177 ts_tablet_manager.cc:1905] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.920527 12265 raft_consensus.cc:491] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:52.920640 12265 raft_consensus.cc:513] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.921231 12265 leader_election.cc:290] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.921728 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e5a715b432704be2a9ca8bdca624bf70" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:52.921869 11783 raft_consensus.cc:2466] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:52.921885 12172 ts_tablet_manager.cc:1428] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250625 14:01:52.922137 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]). Expected version 2 got 0
I20250625 14:01:52.922201 11858 leader_election.cc:304] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.922405 12265 raft_consensus.cc:2802] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:52.922459 12265 raft_consensus.cc:491] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:52.922436 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e5a715b432704be2a9ca8bdca624bf70" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:52.922498 12265 raft_consensus.cc:3058] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.922567 12057 raft_consensus.cc:2466] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:52.923638 12265 raft_consensus.cc:513] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.924077 12265 leader_election.cc:290] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:52.924176 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]). Expected version 2 got 0
I20250625 14:01:52.924672 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e5a715b432704be2a9ca8bdca624bf70" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:52.924794 12057 raft_consensus.cc:3058] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.924783 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e5a715b432704be2a9ca8bdca624bf70" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:52.924925 11783 raft_consensus.cc:3058] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:52.925863 12057 raft_consensus.cc:2466] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:52.925872 11783 raft_consensus.cc:2466] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:52.926185 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e53d81926e0e417ba5d76a39c20f93f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.926420 11858 leader_election.cc:304] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:52.926527 12177 ts_tablet_manager.cc:1918] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250625 14:01:52.926595 12177 log.cc:1199] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0eb159c2babe400386e250da3a177c79
W20250625 14:01:52.926766 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e53d81926e0e417ba5d76a39c20f93f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.926846 12177 ts_tablet_manager.cc:1939] T 0eb159c2babe400386e250da3a177c79 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:52.927644 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:52.928332 12265 raft_consensus.cc:2802] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:52.928450 12265 raft_consensus.cc:695] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:52.928411 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d6499e060ded4ec98aac7fd0f4476b1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.928655 12175 ts_tablet_manager.cc:1918] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:52.928725 12175 log.cc:1199] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/19c33ee6404a43edbbedb843fd072148
W20250625 14:01:52.928747 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6499e060ded4ec98aac7fd0f4476b1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.929042 12175 ts_tablet_manager.cc:1939] T 19c33ee6404a43edbbedb843fd072148 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:52.928606 12265 consensus_queue.cc:237] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:52.929589 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_54578c11cecd4aac98ae5f4fb3c180b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.931082 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54578c11cecd4aac98ae5f4fb3c180b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.931432 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 195690ee34cb442ab8509e51140af31f (table default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb [id=21738c97530c4f83b4b3ef65c7c51320]). Expected version 1 got 0
I20250625 14:01:52.930612 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 19c33ee6404a43edbbedb843fd072148 (table default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]) successfully deleted
I20250625 14:01:52.933149 12035 tablet_service.cc:1468] Processing CreateTablet for tablet de2c07609c4847cc916776be3546cba1 (DEFAULT_TABLE table=default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.933214 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c5c82cbb5bd4477fb342ccc243e798a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.933449 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2c07609c4847cc916776be3546cba1. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:52.933573 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5c82cbb5bd4477fb342ccc243e798a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.934441 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_43289caf2dd34648b1bf4a3e765bc278"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.934816 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43289caf2dd34648b1bf4a3e765bc278 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.935696 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5341f9ce3c654f6f8e4dcd6d31b5e1c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.933578 11528 catalog_manager.cc:5582] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
W20250625 14:01:52.936051 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5341f9ce3c654f6f8e4dcd6d31b5e1c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.936440 11899 tablet_service.cc:1468] Processing CreateTablet for tablet de2c07609c4847cc916776be3546cba1 (DEFAULT_TABLE table=default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.937620 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 195690ee34cb442ab8509e51140af31f (table default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb [id=21738c97530c4f83b4b3ef65c7c51320]). Expected version 1 got 0
I20250625 14:01:52.932241 12172 tablet_bootstrap.cc:492] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.938380 12236 tablet.cc:1722] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:52.939513 12172 tablet_bootstrap.cc:654] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.936815 12233 tablet.cc:1722] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250625 14:01:52.939978 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 524dab39595247ce8bd82ec90fcf7b54 because the tablet was not found. No further retry: Not found: Tablet not found: 524dab39595247ce8bd82ec90fcf7b54
I20250625 14:01:52.940721 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]). Expected version 2 got 0
I20250625 14:01:52.935261 11760 tablet_service.cc:1468] Processing CreateTablet for tablet de2c07609c4847cc916776be3546cba1 (DEFAULT_TABLE table=default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.941471 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2c07609c4847cc916776be3546cba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.945335 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8d003fa42e2a4a85b64e842f0199c525"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.945749 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7841efec8726433bb8558a603229a0af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.945809 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d003fa42e2a4a85b64e842f0199c525 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:52.946111 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7841efec8726433bb8558a603229a0af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.946056 12241 tablet.cc:1722] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:52.946475 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2c07609c4847cc916776be3546cba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.949863 12175 tablet_replica.cc:331] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:01:52.949901 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 63f1676a2fc841f5b8fc60a6591b3824 because the tablet was not found. No further retry: Not found: Tablet not found: 63f1676a2fc841f5b8fc60a6591b3824
I20250625 14:01:52.950106 12175 raft_consensus.cc:2241] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:52.950250 12175 raft_consensus.cc:2270] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:52.955819 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6c2e6fedb8a74a829bc14d61bf626ed8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:52.956367 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c2e6fedb8a74a829bc14d61bf626ed8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.956877 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d] alter complete (version 2)
I20250625 14:01:52.960706 12172 tablet_bootstrap.cc:492] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.960839 12172 ts_tablet_manager.cc:1397] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.002s
I20250625 14:01:52.961340 12172 raft_consensus.cc:357] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.961463 12172 raft_consensus.cc:383] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.961496 12172 raft_consensus.cc:738] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.961496 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_43289caf2dd34648b1bf4a3e765bc278" } new_table_name: "default.Table_232d767d55f44fd694aa78ba3b83f1ac" modify_external_catalogs: true
I20250625 14:01:52.961699 12172 consensus_queue.cc:260] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.963593 12172 ts_tablet_manager.cc:1428] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:01:52.963974 12172 tablet_bootstrap.cc:492] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.965054 12172 tablet_bootstrap.cc:654] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.965294 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 36da902c99bf4416aa0769438182e443 (DEFAULT_TABLE table=default.Table_e53d81926e0e417ba5d76a39c20f93f7 [id=a32feaf4c2f74d1bbd361e7680395682]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.965564 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36da902c99bf4416aa0769438182e443. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.966734 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_209865c613024f86a2947aa757e43d68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:52.967022 12172 tablet_bootstrap.cc:492] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:52.967096 12172 ts_tablet_manager.cc:1397] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
W20250625 14:01:52.967118 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_209865c613024f86a2947aa757e43d68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:52.967581 12172 raft_consensus.cc:357] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.967675 12172 raft_consensus.cc:383] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.967707 12172 raft_consensus.cc:738] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.967825 12172 consensus_queue.cc:260] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:52.968839 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 36da902c99bf4416aa0769438182e443 (DEFAULT_TABLE table=default.Table_e53d81926e0e417ba5d76a39c20f93f7 [id=a32feaf4c2f74d1bbd361e7680395682]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.969135 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36da902c99bf4416aa0769438182e443. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:52.970014 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c36e99b2e83141ff9923478ca7a13a2c has no consensus state
I20250625 14:01:52.970286 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4b8d606f8c3e424994ec2f294d0c1ef6" } new_table_name: "default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581" modify_external_catalogs: true
I20250625 14:01:52.970744 12175 ts_tablet_manager.cc:1905] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:52.971621 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 36da902c99bf4416aa0769438182e443 (DEFAULT_TABLE table=default.Table_e53d81926e0e417ba5d76a39c20f93f7 [id=a32feaf4c2f74d1bbd361e7680395682]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.971926 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36da902c99bf4416aa0769438182e443. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.974524 12172 ts_tablet_manager.cc:1428] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:01:52.974952 12172 tablet_bootstrap.cc:492] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:52.976006 11899 tablet_service.cc:1468] Processing CreateTablet for tablet b9af043f465d41cd9dd63607eb4e8230 (DEFAULT_TABLE table=default.Table_7841efec8726433bb8558a603229a0af [id=f9324275818c4e7a9b39e0d31e2dc12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.976433 12035 tablet_service.cc:1468] Processing CreateTablet for tablet b9af043f465d41cd9dd63607eb4e8230 (DEFAULT_TABLE table=default.Table_7841efec8726433bb8558a603229a0af [id=f9324275818c4e7a9b39e0d31e2dc12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.976445 11901 tablet_service.cc:1468] Processing CreateTablet for tablet f2748c24d9804c41b8d03156c1587e93 (DEFAULT_TABLE table=default.Table_8d003fa42e2a4a85b64e842f0199c525 [id=4111545cc6b44021b0bd7881cfb57a7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.976693 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9af043f465d41cd9dd63607eb4e8230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.976794 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 9f306b943fbf4ccebc4e1c89934c7d88 (DEFAULT_TABLE table=default.Table_54578c11cecd4aac98ae5f4fb3c180b7 [id=e5011c6ffb3947b4a72edfde26b3374c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.976835 12034 tablet_service.cc:1468] Processing CreateTablet for tablet f2748c24d9804c41b8d03156c1587e93 (DEFAULT_TABLE table=default.Table_8d003fa42e2a4a85b64e842f0199c525 [id=4111545cc6b44021b0bd7881cfb57a7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.976893 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 9f306b943fbf4ccebc4e1c89934c7d88 (DEFAULT_TABLE table=default.Table_54578c11cecd4aac98ae5f4fb3c180b7 [id=e5011c6ffb3947b4a72edfde26b3374c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.977223 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2748c24d9804c41b8d03156c1587e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.977296 11898 tablet_service.cc:1468] Processing CreateTablet for tablet dce48b28d6634330bcfa6e28d9f0c49d (DEFAULT_TABLE table=default.Table_d6499e060ded4ec98aac7fd0f4476b1d [id=5f1140a89f654aa0874f801a35ffa3e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.977425 12033 tablet_service.cc:1468] Processing CreateTablet for tablet dce48b28d6634330bcfa6e28d9f0c49d (DEFAULT_TABLE table=default.Table_d6499e060ded4ec98aac7fd0f4476b1d [id=5f1140a89f654aa0874f801a35ffa3e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.977638 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce48b28d6634330bcfa6e28d9f0c49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.978156 12036 tablet_service.cc:1468] Processing CreateTablet for tablet c36e99b2e83141ff9923478ca7a13a2c (DEFAULT_TABLE table=default.Table_232d767d55f44fd694aa78ba3b83f1ac [id=4f84fd8318e04f02961fee283b12d934]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.978382 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36e99b2e83141ff9923478ca7a13a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.979467 12032 tablet_service.cc:1468] Processing CreateTablet for tablet d5229b608b084c4d9198fccd25bed935 (DEFAULT_TABLE table=default.Table_c5c82cbb5bd4477fb342ccc243e798a9 [id=8d5c6093ab50409e9367b95e9cad2f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.979717 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5229b608b084c4d9198fccd25bed935. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.979684 11900 tablet_service.cc:1468] Processing CreateTablet for tablet d5229b608b084c4d9198fccd25bed935 (DEFAULT_TABLE table=default.Table_c5c82cbb5bd4477fb342ccc243e798a9 [id=8d5c6093ab50409e9367b95e9cad2f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.980050 11897 tablet_service.cc:1468] Processing CreateTablet for tablet c36e99b2e83141ff9923478ca7a13a2c (DEFAULT_TABLE table=default.Table_232d767d55f44fd694aa78ba3b83f1ac [id=4f84fd8318e04f02961fee283b12d934]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.980566 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 09a197bdabd24d7c96febe1fd5352a14 (DEFAULT_TABLE table=default.Table_5341f9ce3c654f6f8e4dcd6d31b5e1c5 [id=eb9c04f498934429a3cbc198525b7489]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.981652 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f306b943fbf4ccebc4e1c89934c7d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.981968 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 09a197bdabd24d7c96febe1fd5352a14 (DEFAULT_TABLE table=default.Table_5341f9ce3c654f6f8e4dcd6d31b5e1c5 [id=eb9c04f498934429a3cbc198525b7489]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.982216 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a197bdabd24d7c96febe1fd5352a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.985716 11921 raft_consensus.cc:1273] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.985738 11764 tablet_service.cc:1468] Processing CreateTablet for tablet b9af043f465d41cd9dd63607eb4e8230 (DEFAULT_TABLE table=default.Table_7841efec8726433bb8558a603229a0af [id=f9324275818c4e7a9b39e0d31e2dc12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.986186 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9af043f465d41cd9dd63607eb4e8230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.986824 11762 tablet_service.cc:1468] Processing CreateTablet for tablet dce48b28d6634330bcfa6e28d9f0c49d (DEFAULT_TABLE table=default.Table_d6499e060ded4ec98aac7fd0f4476b1d [id=5f1140a89f654aa0874f801a35ffa3e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.987078 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce48b28d6634330bcfa6e28d9f0c49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.988541 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2748c24d9804c41b8d03156c1587e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.988592 11761 tablet_service.cc:1468] Processing CreateTablet for tablet d5229b608b084c4d9198fccd25bed935 (DEFAULT_TABLE table=default.Table_c5c82cbb5bd4477fb342ccc243e798a9 [id=8d5c6093ab50409e9367b95e9cad2f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.988799 12166 tablet_bootstrap.cc:492] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:52.988812 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5229b608b084c4d9198fccd25bed935. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.988891 12166 ts_tablet_manager.cc:1397] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.095s user 0.002s sys 0.000s
I20250625 14:01:52.988909 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f306b943fbf4ccebc4e1c89934c7d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.989195 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce48b28d6634330bcfa6e28d9f0c49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.989317 11759 tablet_service.cc:1468] Processing CreateTablet for tablet c36e99b2e83141ff9923478ca7a13a2c (DEFAULT_TABLE table=default.Table_232d767d55f44fd694aa78ba3b83f1ac [id=4f84fd8318e04f02961fee283b12d934]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.989473 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5229b608b084c4d9198fccd25bed935. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.989408 12166 raft_consensus.cc:357] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.989516 12166 raft_consensus.cc:383] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:52.989547 12166 raft_consensus.cc:738] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:52.989566 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36e99b2e83141ff9923478ca7a13a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.989675 12166 consensus_queue.cc:260] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:52.989744 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36e99b2e83141ff9923478ca7a13a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.989962 12166 ts_tablet_manager.cc:1428] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:52.990015 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a197bdabd24d7c96febe1fd5352a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.990195 12166 tablet_bootstrap.cc:492] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:52.991142 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.188:43359
--webserver_interface=127.11.39.188
--webserver_port=37561
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250625 14:01:52.991271 12166 tablet_bootstrap.cc:654] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:52.991765 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 09a197bdabd24d7c96febe1fd5352a14 (DEFAULT_TABLE table=default.Table_5341f9ce3c654f6f8e4dcd6d31b5e1c5 [id=eb9c04f498934429a3cbc198525b7489]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.992041 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a197bdabd24d7c96febe1fd5352a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.992215 11783 raft_consensus.cc:1273] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:52.992516 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 9f306b943fbf4ccebc4e1c89934c7d88 (DEFAULT_TABLE table=default.Table_54578c11cecd4aac98ae5f4fb3c180b7 [id=e5011c6ffb3947b4a72edfde26b3374c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.992715 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f306b943fbf4ccebc4e1c89934c7d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.993175 12219 consensus_queue.cc:1035] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:52.995329 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7fc376fdaa8b4298b06bcae3986df3c4" } new_table_name: "default.Table_97ce3b23ba19450597e36481cac5bbbc" modify_external_catalogs: true
I20250625 14:01:52.996758 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb" } modify_external_catalogs: true
I20250625 14:01:52.996925 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6531b22f10ff4322a646715bb910c654" } new_table_name: "default.Table_55c8f809888047139f479c0a5d5bafa0" modify_external_catalogs: true
I20250625 14:01:52.997448 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f07dddb6ca7a448985331ebf73b3cee3" } new_table_name: "default.Table_8362aee5a9b14f48828ee6d0a7a1ee03" modify_external_catalogs: true
I20250625 14:01:52.997581 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb" } modify_external_catalogs: true
I20250625 14:01:52.998327 11760 tablet_service.cc:1468] Processing CreateTablet for tablet f2748c24d9804c41b8d03156c1587e93 (DEFAULT_TABLE table=default.Table_8d003fa42e2a4a85b64e842f0199c525 [id=4111545cc6b44021b0bd7881cfb57a7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:52.998726 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2748c24d9804c41b8d03156c1587e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:52.998710 12236 tablet.cc:1722] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.000136 12175 ts_tablet_manager.cc:1918] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.000216 12175 log.cc:1199] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/3f433ff8fc284bb8b71f9d7d2b160d2d
I20250625 14:01:53.000460 12175 ts_tablet_manager.cc:1939] T 3f433ff8fc284bb8b71f9d7d2b160d2d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.001092 12175 tablet_replica.cc:331] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.001237 12175 raft_consensus.cc:2241] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.001345 12175 raft_consensus.cc:2270] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.002739 12175 ts_tablet_manager.cc:1905] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.003597 12233 tablet.cc:1722] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.004648 12175 ts_tablet_manager.cc:1918] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250625 14:01:53.004717 12175 log.cc:1199] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0eb159c2babe400386e250da3a177c79
I20250625 14:01:53.004957 12175 ts_tablet_manager.cc:1939] T 0eb159c2babe400386e250da3a177c79 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.005208 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 3f433ff8fc284bb8b71f9d7d2b160d2d (table default.Table_3702c1a05762460794ae97100930f18c [id=0b415260a5134ff6ba2666d34d17b0b3]) successfully deleted
I20250625 14:01:53.005730 12167 tablet_bootstrap.cc:492] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.005824 12167 ts_tablet_manager.cc:1397] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.108s user 0.002s sys 0.000s
I20250625 14:01:53.008859 12208 consensus_queue.cc:1035] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.010622 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9af043f465d41cd9dd63607eb4e8230. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.010953 12166 tablet_bootstrap.cc:492] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.011067 12166 ts_tablet_manager.cc:1397] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:01:53.011703 12166 raft_consensus.cc:357] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.011811 12166 raft_consensus.cc:383] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.011843 12166 raft_consensus.cc:738] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.011853 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_232d767d55f44fd694aa78ba3b83f1ac" } modify_external_catalogs: true
I20250625 14:01:53.011969 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_232d767d55f44fd694aa78ba3b83f1ac" } modify_external_catalogs: true
I20250625 14:01:53.011962 12166 consensus_queue.cc:260] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.012292 12166 ts_tablet_manager.cc:1428] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.013628 12175 tablet_replica.cc:331] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.013980 12175 raft_consensus.cc:2241] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.014225 12175 raft_consensus.cc:2270] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.015838 12166 tablet_bootstrap.cc:492] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:53.016134 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 consensus state has no leader
W20250625 14:01:53.016515 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 910f1645f58b4066ae5c7c61e966e64c consensus state has no leader
I20250625 14:01:53.016935 12172 tablet_bootstrap.cc:654] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.016970 12166 tablet_bootstrap.cc:654] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.018713 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 608f1a63442842ef8cba9ed4e9f85d88 (table default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]). Expected version 1 got 0
I20250625 14:01:53.016490 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 195690ee34cb442ab8509e51140af31f
I20250625 14:01:53.020215 12175 ts_tablet_manager.cc:1905] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.020789 12265 raft_consensus.cc:491] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.020915 12265 raft_consensus.cc:513] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.021327 12265 leader_election.cc:290] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.022806 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "992a9f1bc92a4d5bbfb56bda19e6c4c9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.023629 11783 raft_consensus.cc:2466] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:53.024063 11858 leader_election.cc:304] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.024260 12265 raft_consensus.cc:2802] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.024307 12265 raft_consensus.cc:491] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.024346 12265 raft_consensus.cc:3058] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.024516 12166 tablet_bootstrap.cc:492] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.024590 12166 ts_tablet_manager.cc:1397] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:53.025147 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c36e99b2e83141ff9923478ca7a13a2c
I20250625 14:01:53.025352 12166 raft_consensus.cc:357] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.025477 12166 raft_consensus.cc:383] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.025514 12166 raft_consensus.cc:738] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.025527 12265 raft_consensus.cc:513] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.025671 12166 consensus_queue.cc:260] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.025895 12265 leader_election.cc:290] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.027325 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "992a9f1bc92a4d5bbfb56bda19e6c4c9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.027417 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_8362aee5a9b14f48828ee6d0a7a1ee03 [id=d1a9808588a74a90be4afc3e4205373e]). Expected version 1 got 0
I20250625 14:01:53.027573 11783 raft_consensus.cc:3058] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.027765 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 082a46d213c545b18acbcac1b699d140 (DEFAULT_TABLE table=default.Table_6c2e6fedb8a74a829bc14d61bf626ed8 [id=68e1633962a6404c94ddcdde634c23e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.028097 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082a46d213c545b18acbcac1b699d140. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.029189 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 195690ee34cb442ab8509e51140af31f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.029565 12166 ts_tablet_manager.cc:1428] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:01:53.029717 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 195690ee34cb442ab8509e51140af31f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.030122 11784 raft_consensus.cc:1273] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.030406 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet c36e99b2e83141ff9923478ca7a13a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.030802 11897 tablet_service.cc:1468] Processing CreateTablet for tablet d8e509824fc94993b1676f5b68515002 (DEFAULT_TABLE table=default.Table_209865c613024f86a2947aa757e43d68 [id=250ef151258b4c7da08be26888e9ecf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.030890 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0eb159c2babe400386e250da3a177c79 (table default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:53.031070 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e509824fc94993b1676f5b68515002. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.031062 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_8362aee5a9b14f48828ee6d0a7a1ee03 [id=d1a9808588a74a90be4afc3e4205373e]). Expected version 1 got 0
I20250625 14:01:53.032188 11783 raft_consensus.cc:2466] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.032488 12166 tablet_bootstrap.cc:492] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.032488 11858 leader_election.cc:304] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.032840 12265 raft_consensus.cc:2802] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.032925 12265 raft_consensus.cc:695] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:53.033069 12265 consensus_queue.cc:237] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.030817 12170 consensus_queue.cc:1035] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20250625 14:01:53.035614 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0c9a35c9dec84d4fa377b3db9d47a265" } modify_external_catalogs: true
I20250625 14:01:53.035737 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0c9a35c9dec84d4fa377b3db9d47a265" } modify_external_catalogs: true
I20250625 14:01:53.035859 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 082a46d213c545b18acbcac1b699d140 (DEFAULT_TABLE table=default.Table_6c2e6fedb8a74a829bc14d61bf626ed8 [id=68e1633962a6404c94ddcdde634c23e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.035971 11758 tablet_service.cc:1468] Processing CreateTablet for tablet d8e509824fc94993b1676f5b68515002 (DEFAULT_TABLE table=default.Table_209865c613024f86a2947aa757e43d68 [id=250ef151258b4c7da08be26888e9ecf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.036116 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082a46d213c545b18acbcac1b699d140. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.036238 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet c36e99b2e83141ff9923478ca7a13a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.036442 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e509824fc94993b1676f5b68515002. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.037797 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c5c82cbb5bd4477fb342ccc243e798a9" } modify_external_catalogs: true
I20250625 14:01:53.037896 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c5c82cbb5bd4477fb342ccc243e798a9" } modify_external_catalogs: true
I20250625 14:01:53.038367 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 195690ee34cb442ab8509e51140af31f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.039587 12177 tablet_replica.cc:331] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.039789 12177 raft_consensus.cc:2241] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.039959 12177 raft_consensus.cc:2270] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.039987 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8d003fa42e2a4a85b64e842f0199c525" } modify_external_catalogs: true
I20250625 14:01:53.040099 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8d003fa42e2a4a85b64e842f0199c525" } modify_external_catalogs: true
I20250625 14:01:53.040525 12177 ts_tablet_manager.cc:1905] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:53.040771 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c36e99b2e83141ff9923478ca7a13a2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c36e99b2e83141ff9923478ca7a13a2c already in progress: creating tablet
I20250625 14:01:53.035586 11529 catalog_manager.cc:5582] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:53.041117 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (table default.Table_97ce3b23ba19450597e36481cac5bbbc [id=396b9df84d604d29b6f720475255a184]). Expected version 1 got 0
I20250625 14:01:53.041312 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4] alter complete (version 1)
I20250625 14:01:53.041628 12175 ts_tablet_manager.cc:1918] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.042006 12175 log.cc:1199] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/524dab39595247ce8bd82ec90fcf7b54
I20250625 14:01:53.042410 12175 ts_tablet_manager.cc:1939] T 524dab39595247ce8bd82ec90fcf7b54 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.043413 12175 tablet_replica.cc:331] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.043588 12175 raft_consensus.cc:2241] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.043725 12175 raft_consensus.cc:2270] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.045953 12175 ts_tablet_manager.cc:1905] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.048017 12175 ts_tablet_manager.cc:1918] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.048096 12175 log.cc:1199] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/195690ee34cb442ab8509e51140af31f
I20250625 14:01:53.048300 12175 ts_tablet_manager.cc:1939] T 195690ee34cb442ab8509e51140af31f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.050565 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 524dab39595247ce8bd82ec90fcf7b54 (table default.Table_b736442acaca4a00b408d4fb0a3495aa [id=2fd36596ea3941a4b6c415cf994e3768]) successfully deleted
I20250625 14:01:53.050691 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 195690ee34cb442ab8509e51140af31f (table default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb [id=21738c97530c4f83b4b3ef65c7c51320]) successfully deleted
W20250625 14:01:53.050786 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 195690ee34cb442ab8509e51140af31f because the tablet was not found. No further retry: Not found: Tablet not found: 195690ee34cb442ab8509e51140af31f
I20250625 14:01:53.050810 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf
W20250625 14:01:53.050889 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c36e99b2e83141ff9923478ca7a13a2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c36e99b2e83141ff9923478ca7a13a2c already in progress: creating tablet
W20250625 14:01:53.051499 11993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.39.129:44223, user_credentials={real_user=slave}} blocked reactor thread for 44737.5us
I20250625 14:01:53.051730 12166 tablet_bootstrap.cc:654] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.052098 12178 consensus_queue.cc:1035] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.052340 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 082a46d213c545b18acbcac1b699d140 (DEFAULT_TABLE table=default.Table_6c2e6fedb8a74a829bc14d61bf626ed8 [id=68e1633962a6404c94ddcdde634c23e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.052585 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "992a9f1bc92a4d5bbfb56bda19e6c4c9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.052735 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 195690ee34cb442ab8509e51140af31f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.052763 12037 tablet_service.cc:1468] Processing CreateTablet for tablet d8e509824fc94993b1676f5b68515002 (DEFAULT_TABLE table=default.Table_209865c613024f86a2947aa757e43d68 [id=250ef151258b4c7da08be26888e9ecf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.052839 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "992a9f1bc92a4d5bbfb56bda19e6c4c9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.052891 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet c36e99b2e83141ff9923478ca7a13a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.053166 12054 raft_consensus.cc:1273] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.053346 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.053835 12173 tablet_replica.cc:331] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.053956 12173 raft_consensus.cc:2241] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.054069 12173 raft_consensus.cc:2270] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.054234 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.054700 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d5229b608b084c4d9198fccd25bed935
I20250625 14:01:53.055294 12241 tablet.cc:1722] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.052597 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082a46d213c545b18acbcac1b699d140. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:53.055915 11855 leader_election.cc:343] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:53.056121 11855 leader_election.cc:343] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.056361 12265 consensus_queue.cc:1035] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.056983 12173 ts_tablet_manager.cc:1905] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.057106 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.058027 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e509824fc94993b1676f5b68515002. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.061239 12173 ts_tablet_manager.cc:1918] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.061331 12173 log.cc:1199] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6e408ae7998546e3a8ea5fb1f8e2bbbf
I20250625 14:01:53.061547 12173 ts_tablet_manager.cc:1939] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.062393 12177 ts_tablet_manager.cc:1918] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.062536 12177 log.cc:1199] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/195690ee34cb442ab8509e51140af31f
I20250625 14:01:53.062829 12177 ts_tablet_manager.cc:1939] T 195690ee34cb442ab8509e51140af31f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.063263 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet d5229b608b084c4d9198fccd25bed935 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.063784 12167 raft_consensus.cc:357] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.063905 12167 raft_consensus.cc:383] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.063946 12167 raft_consensus.cc:738] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.064081 12177 tablet_replica.cc:331] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.064265 12177 raft_consensus.cc:2241] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.064428 12177 raft_consensus.cc:2270] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.065011 12177 ts_tablet_manager.cc:1905] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.065542 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet d5229b608b084c4d9198fccd25bed935 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:53.064575 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 195690ee34cb442ab8509e51140af31f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 195690ee34cb442ab8509e51140af31f already in progress: creating tablet
W20250625 14:01:53.066500 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c36e99b2e83141ff9923478ca7a13a2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c36e99b2e83141ff9923478ca7a13a2c already in progress: creating tablet
I20250625 14:01:53.066689 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf (table default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]) successfully deleted
I20250625 14:01:53.066838 12239 tablet.cc:1722] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.067482 12167 consensus_queue.cc:260] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.068161 12233 tablet.cc:1722] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.068742 12167 ts_tablet_manager.cc:1428] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.063s user 0.002s sys 0.000s
I20250625 14:01:53.068938 12167 tablet_bootstrap.cc:492] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:53.070399 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d5229b608b084c4d9198fccd25bed935 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5229b608b084c4d9198fccd25bed935 already in progress: creating tablet
I20250625 14:01:53.071659 11530 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e5a715b432704be2a9ca8bdca624bf70 (table default.Table_55c8f809888047139f479c0a5d5bafa0 [id=b3553dc46c8440619049d4adc450e003]). Expected version 1 got 0
I20250625 14:01:53.072124 12166 tablet_bootstrap.cc:492] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.072235 12166 ts_tablet_manager.cc:1397] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250625 14:01:53.072932 12167 tablet_bootstrap.cc:654] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.073788 12166 raft_consensus.cc:357] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.073901 12166 raft_consensus.cc:383] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.073935 12166 raft_consensus.cc:738] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.074098 12259 raft_consensus.cc:491] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.074182 12259 raft_consensus.cc:513] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.074616 12259 leader_election.cc:290] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.074748 12177 ts_tablet_manager.cc:1918] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.075305 12175 tablet_replica.cc:331] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.075731 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1a3907e22505461a8df58ec339c342da" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.075711 12166 consensus_queue.cc:260] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.075855 12056 raft_consensus.cc:2466] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:53.075953 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet e5a715b432704be2a9ca8bdca624bf70 (table default.Table_55c8f809888047139f479c0a5d5bafa0 [id=b3553dc46c8440619049d4adc450e003]). Expected version 1 got 0
I20250625 14:01:53.076437 11855 leader_election.cc:304] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.076673 12259 raft_consensus.cc:2802] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.076697 12166 ts_tablet_manager.cc:1428] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:53.076740 12259 raft_consensus.cc:491] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.076781 12259 raft_consensus.cc:3058] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.076972 12166 tablet_bootstrap.cc:492] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.077850 12259 raft_consensus.cc:513] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.078177 12259 leader_election.cc:290] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.075703 12175 raft_consensus.cc:2241] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.078549 12175 pending_rounds.cc:70] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:53.078195 12166 tablet_bootstrap.cc:654] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.080494 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1a3907e22505461a8df58ec339c342da" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.080633 12056 raft_consensus.cc:3058] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.081707 12056 raft_consensus.cc:2466] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.082154 11855 leader_election.cc:304] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.082427 12259 raft_consensus.cc:2802] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.082522 12259 raft_consensus.cc:695] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:53.082651 12259 consensus_queue.cc:237] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.078581 12175 pending_rounds.cc:77] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523021976563712 op_type: NO_OP noop_request { }
I20250625 14:01:53.083508 12175 raft_consensus.cc:2887] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:53.083571 12175 raft_consensus.cc:2270] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.076702 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1a3907e22505461a8df58ec339c342da" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.080901 12180 raft_consensus.cc:491] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.085258 12180 raft_consensus.cc:513] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.085624 12180 leader_election.cc:290] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.081037 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1a3907e22505461a8df58ec339c342da" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.086165 11784 raft_consensus.cc:3058] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.086331 12238 consensus_queue.cc:1035] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.087338 11784 raft_consensus.cc:2466] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.087880 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f4e293a800f24030b7f52f707a3b40a8" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.088184 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f4e293a800f24030b7f52f707a3b40a8" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.089879 12177 log.cc:1199] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6e408ae7998546e3a8ea5fb1f8e2bbbf
I20250625 14:01:53.090268 12177 ts_tablet_manager.cc:1939] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:53.089660 11717 leader_election.cc:343] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:53.091315 11717 leader_election.cc:343] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.091382 11717 leader_election.cc:304] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:53.091533 12238 raft_consensus.cc:2747] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.092579 12236 tablet.cc:1722] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.095247 12175 ts_tablet_manager.cc:1905] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.097455 12175 ts_tablet_manager.cc:1918] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.097530 12175 log.cc:1199] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6e408ae7998546e3a8ea5fb1f8e2bbbf
I20250625 14:01:53.097767 12175 ts_tablet_manager.cc:1939] T 6e408ae7998546e3a8ea5fb1f8e2bbbf P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.098675 12172 tablet_bootstrap.cc:492] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.098767 12167 tablet_bootstrap.cc:492] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.098775 12172 ts_tablet_manager.cc:1397] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.124s user 0.002s sys 0.000s
I20250625 14:01:53.098850 12167 ts_tablet_manager.cc:1397] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250625 14:01:53.099311 12172 raft_consensus.cc:357] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.099311 12167 raft_consensus.cc:357] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.099427 12167 raft_consensus.cc:383] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.099427 12172 raft_consensus.cc:383] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.099460 12167 raft_consensus.cc:738] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.099460 12172 raft_consensus.cc:738] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.099614 12172 consensus_queue.cc:260] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.099639 12167 consensus_queue.cc:260] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.099910 12172 ts_tablet_manager.cc:1428] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.100039 12167 ts_tablet_manager.cc:1428] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.100108 12172 tablet_bootstrap.cc:492] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.100214 12167 tablet_bootstrap.cc:492] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.101301 12167 tablet_bootstrap.cc:654] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.101483 12172 tablet_bootstrap.cc:654] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.105094 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf (table default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]) successfully deleted
W20250625 14:01:53.106418 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d5229b608b084c4d9198fccd25bed935 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5229b608b084c4d9198fccd25bed935 already in progress: creating tablet
I20250625 14:01:53.107398 12172 tablet_bootstrap.cc:492] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.107498 12172 ts_tablet_manager.cc:1397] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:53.108043 12172 raft_consensus.cc:357] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.108161 12172 raft_consensus.cc:383] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.108192 12172 raft_consensus.cc:738] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.108319 12172 consensus_queue.cc:260] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.108606 12172 ts_tablet_manager.cc:1428] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.108777 12172 tablet_bootstrap.cc:492] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.109776 12172 tablet_bootstrap.cc:654] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.110026 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet d5229b608b084c4d9198fccd25bed935 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.111095 12167 tablet_bootstrap.cc:492] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.111208 12167 ts_tablet_manager.cc:1397] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:01:53.111781 12167 raft_consensus.cc:357] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.111882 12172 tablet_bootstrap.cc:492] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.111900 12167 raft_consensus.cc:383] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.111938 12167 raft_consensus.cc:738] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.111971 12172 ts_tablet_manager.cc:1397] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:53.112088 12167 consensus_queue.cc:260] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.112500 12167 ts_tablet_manager.cc:1428] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.112731 12167 tablet_bootstrap.cc:492] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.112792 12172 raft_consensus.cc:357] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.112967 12172 raft_consensus.cc:383] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.112998 12172 raft_consensus.cc:738] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.113404 12172 consensus_queue.cc:260] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.113711 12172 ts_tablet_manager.cc:1428] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:53.113837 12167 tablet_bootstrap.cc:654] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.114035 12172 tablet_bootstrap.cc:492] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.114933 12167 tablet_bootstrap.cc:492] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.115036 12167 ts_tablet_manager.cc:1397] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20250625 14:01:53.115084 12172 tablet_bootstrap.cc:654] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.115635 12167 raft_consensus.cc:357] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.115743 12167 raft_consensus.cc:383] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.115779 12167 raft_consensus.cc:738] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.115913 12167 consensus_queue.cc:260] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.116184 12167 ts_tablet_manager.cc:1428] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.116390 12167 tablet_bootstrap.cc:492] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.117506 12167 tablet_bootstrap.cc:654] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.119125 12167 tablet_bootstrap.cc:492] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.119233 12167 ts_tablet_manager.cc:1397] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250625 14:01:53.119716 12167 raft_consensus.cc:357] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.119853 12167 raft_consensus.cc:383] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.119904 12167 raft_consensus.cc:738] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.120059 12167 consensus_queue.cc:260] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.120352 12167 ts_tablet_manager.cc:1428] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.120569 12167 tablet_bootstrap.cc:492] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.121435 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 195690ee34cb442ab8509e51140af31f (table default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb [id=21738c97530c4f83b4b3ef65c7c51320]) successfully deleted
I20250625 14:01:53.121730 12167 tablet_bootstrap.cc:654] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.121713 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6e408ae7998546e3a8ea5fb1f8e2bbbf (table default.Table_0c9a35c9dec84d4fa377b3db9d47a265 [id=c63d5b5887ca48a6bcadf7b01a70071a]) successfully deleted
W20250625 14:01:53.121852 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d5229b608b084c4d9198fccd25bed935 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5229b608b084c4d9198fccd25bed935 already in progress: creating tablet
I20250625 14:01:53.122414 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f2748c24d9804c41b8d03156c1587e93
I20250625 14:01:53.122812 12172 tablet_bootstrap.cc:492] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.122929 12172 ts_tablet_manager.cc:1397] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:53.123505 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet f2748c24d9804c41b8d03156c1587e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.123472 12172 raft_consensus.cc:357] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.123586 12172 raft_consensus.cc:383] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.123636 12172 raft_consensus.cc:738] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.123764 12172 consensus_queue.cc:260] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:53.124023 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f2748c24d9804c41b8d03156c1587e93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2748c24d9804c41b8d03156c1587e93 already in progress: creating tablet
I20250625 14:01:53.124861 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet f2748c24d9804c41b8d03156c1587e93 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.124912 12172 ts_tablet_manager.cc:1428] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:53.125174 12172 tablet_bootstrap.cc:492] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.125366 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 608f1a63442842ef8cba9ed4e9f85d88 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.125394 11529 catalog_manager.cc:5582] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:53.125591 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 1a3907e22505461a8df58ec339c342da (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]). Expected version 1 got 0
I20250625 14:01:53.126194 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet c37dd3f9883c41dd9a0255fd5060328e from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.126370 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 99dd8205e438423f84792df3d651c7a9 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.126427 12178 raft_consensus.cc:491] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.126521 12178 raft_consensus.cc:513] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.126722 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet de2c07609c4847cc916776be3546cba1 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.126812 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet f2748c24d9804c41b8d03156c1587e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.126966 12178 leader_election.cc:290] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.128023 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f2748c24d9804c41b8d03156c1587e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.128170 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "608f1a63442842ef8cba9ed4e9f85d88" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.128310 11784 raft_consensus.cc:2466] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:01:53.128407 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f2748c24d9804c41b8d03156c1587e93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2748c24d9804c41b8d03156c1587e93 already in progress: creating tablet
I20250625 14:01:53.128737 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "608f1a63442842ef8cba9ed4e9f85d88" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.128870 11920 raft_consensus.cc:2466] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:53.129190 11990 leader_election.cc:304] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:53.129418 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f2748c24d9804c41b8d03156c1587e93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2748c24d9804c41b8d03156c1587e93 already in progress: creating tablet
I20250625 14:01:53.129588 12178 raft_consensus.cc:2802] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.129654 12178 raft_consensus.cc:491] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.129706 12178 raft_consensus.cc:3058] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.129994 12172 tablet_bootstrap.cc:654] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.130930 12178 raft_consensus.cc:513] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.131311 12167 tablet_bootstrap.cc:492] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.131347 12178 leader_election.cc:290] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.131398 12167 ts_tablet_manager.cc:1397] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20250625 14:01:53.131945 12167 raft_consensus.cc:357] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.132066 12167 raft_consensus.cc:383] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.132112 12167 raft_consensus.cc:738] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.132241 12167 consensus_queue.cc:260] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.132565 12167 ts_tablet_manager.cc:1428] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.132793 12167 tablet_bootstrap.cc:492] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.133877 12167 tablet_bootstrap.cc:654] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.134603 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "608f1a63442842ef8cba9ed4e9f85d88" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.134735 11920 raft_consensus.cc:3058] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.135622 11920 raft_consensus.cc:2466] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:53.135902 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "608f1a63442842ef8cba9ed4e9f85d88" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.136029 11784 raft_consensus.cc:3058] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.137223 12166 tablet_bootstrap.cc:492] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.137321 12166 ts_tablet_manager.cc:1397] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.000s
I20250625 14:01:53.137343 11784 raft_consensus.cc:2466] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:53.137512 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_55c8f809888047139f479c0a5d5bafa0 [id=b3553dc46c8440619049d4adc450e003] alter complete (version 1)
I20250625 14:01:53.137683 12170 raft_consensus.cc:491] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.137727 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 608f1a63442842ef8cba9ed4e9f85d88
I20250625 14:01:53.137770 12170 raft_consensus.cc:513] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.137991 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet de2c07609c4847cc916776be3546cba1
I20250625 14:01:53.138036 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 608f1a63442842ef8cba9ed4e9f85d88 deleted and replaced by tablet 33c895ed888b4cb8836f6a415d170c3e
I20250625 14:01:53.138221 12170 leader_election.cc:290] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.138238 11526 catalog_manager.cc:6652] ReplaceTablet: tablet de2c07609c4847cc916776be3546cba1 deleted and replaced by tablet da2c9696938143f69ea1305ee076d84d
I20250625 14:01:53.138753 11993 leader_election.cc:304] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:01:53.138788 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 608f1a63442842ef8cba9ed4e9f85d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 33c895ed888b4cb8836f6a415d170c3e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.138862 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet de2c07609c4847cc916776be3546cba1 with delete_type TABLET_DATA_DELETED (replaced by tablet da2c9696938143f69ea1305ee076d84d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.138953 12175 tablet_replica.cc:331] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.139037 12171 raft_consensus.cc:2802] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.139089 12175 raft_consensus.cc:2241] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.139124 12171 raft_consensus.cc:695] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:53.139210 12175 raft_consensus.cc:2270] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.139277 12171 consensus_queue.cc:237] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.139047 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "812d9a36acf644c99edfbf55086f9b25" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.140378 12175 ts_tablet_manager.cc:1905] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.140344 12166 raft_consensus.cc:357] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.140480 12166 raft_consensus.cc:383] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.140511 12166 raft_consensus.cc:738] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.140625 12166 consensus_queue.cc:260] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.140951 12166 ts_tablet_manager.cc:1428] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:53.141157 12166 tablet_bootstrap.cc:492] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.142798 12175 ts_tablet_manager.cc:1918] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.142870 12175 log.cc:1199] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/608f1a63442842ef8cba9ed4e9f85d88
I20250625 14:01:53.143057 12175 ts_tablet_manager.cc:1939] T 608f1a63442842ef8cba9ed4e9f85d88 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.143349 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "812d9a36acf644c99edfbf55086f9b25" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.143491 11784 raft_consensus.cc:2466] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
W20250625 14:01:53.143730 11855 leader_election.cc:343] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.143827 11858 leader_election.cc:304] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.144057 12170 raft_consensus.cc:2802] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.144105 12170 raft_consensus.cc:491] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.144142 12170 raft_consensus.cc:3058] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.145139 12170 raft_consensus.cc:513] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.145539 12170 leader_election.cc:290] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.146761 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "812d9a36acf644c99edfbf55086f9b25" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.146797 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "812d9a36acf644c99edfbf55086f9b25" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.146906 11784 raft_consensus.cc:3058] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.147076 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet de2c07609c4847cc916776be3546cba1 with delete_type TABLET_DATA_DELETED (replaced by tablet da2c9696938143f69ea1305ee076d84d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.147243 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 608f1a63442842ef8cba9ed4e9f85d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 33c895ed888b4cb8836f6a415d170c3e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.147460 12173 tablet_replica.cc:331] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:01:53.147511 11855 leader_election.cc:343] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.147583 12173 raft_consensus.cc:2241] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.147727 12173 pending_rounds.cc:70] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:01:53.147760 12173 pending_rounds.cc:77] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523023419879424 op_type: NO_OP noop_request { }
I20250625 14:01:53.147819 12173 raft_consensus.cc:2887] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:53.147881 12173 raft_consensus.cc:2270] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.147975 11784 raft_consensus.cc:2466] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.148351 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 608f1a63442842ef8cba9ed4e9f85d88 (table default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]) successfully deleted
I20250625 14:01:53.148358 11858 leader_election.cc:304] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:01:53.148545 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet de2c07609c4847cc916776be3546cba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de2c07609c4847cc916776be3546cba1 already in progress: creating tablet
I20250625 14:01:53.148579 12170 raft_consensus.cc:2802] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.148653 12170 raft_consensus.cc:695] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:53.148782 12170 consensus_queue.cc:237] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.149793 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cf032fd9d44e45eba5453bab85a976bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.149891 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 608f1a63442842ef8cba9ed4e9f85d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 33c895ed888b4cb8836f6a415d170c3e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.149969 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet de2c07609c4847cc916776be3546cba1 with delete_type TABLET_DATA_DELETED (replaced by tablet da2c9696938143f69ea1305ee076d84d) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:53.150122 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet de2c07609c4847cc916776be3546cba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de2c07609c4847cc916776be3546cba1 already in progress: creating tablet
I20250625 14:01:53.150147 12177 tablet_replica.cc:331] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.142273 12166 tablet_bootstrap.cc:654] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:53.150255 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf032fd9d44e45eba5453bab85a976bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.150288 12177 raft_consensus.cc:2241] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.150434 12177 raft_consensus.cc:2270] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.150997 12177 ts_tablet_manager.cc:1905] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.152354 12172 tablet_bootstrap.cc:492] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.152439 12172 ts_tablet_manager.cc:1397] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:01:53.152954 12172 raft_consensus.cc:357] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.153056 12172 raft_consensus.cc:383] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.153090 12172 raft_consensus.cc:738] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.153224 12172 consensus_queue.cc:260] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.153313 12177 ts_tablet_manager.cc:1918] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.153379 12177 log.cc:1199] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/608f1a63442842ef8cba9ed4e9f85d88
I20250625 14:01:53.153589 12177 ts_tablet_manager.cc:1939] T 608f1a63442842ef8cba9ed4e9f85d88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.153743 12172 ts_tablet_manager.cc:1428] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.153949 12172 tablet_bootstrap.cc:492] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.154182 12177 tablet_replica.cc:331] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.155639 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 608f1a63442842ef8cba9ed4e9f85d88 (table default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]) successfully deleted
I20250625 14:01:53.154294 12177 raft_consensus.cc:2241] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.156038 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_29b36939592445fa8336a104142a6d44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.156087 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_75ec00556aa0458f86b7c08e673576c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.156481 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75ec00556aa0458f86b7c08e673576c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:53.156481 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29b36939592445fa8336a104142a6d44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.156658 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_154ef6ebeb3243549454095410cf6797"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.156980 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_154ef6ebeb3243549454095410cf6797 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.157449 12172 tablet_bootstrap.cc:654] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.157655 12166 tablet_bootstrap.cc:492] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.157761 12166 ts_tablet_manager.cc:1397] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:53.158354 12166 raft_consensus.cc:357] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.158481 12166 raft_consensus.cc:383] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.158519 12166 raft_consensus.cc:738] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.158638 12166 consensus_queue.cc:260] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.158674 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cba0c23c2d6d4dfdb990086dc9ed2834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.158946 12166 ts_tablet_manager.cc:1428] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:53.159032 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cba0c23c2d6d4dfdb990086dc9ed2834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.159130 12166 tablet_bootstrap.cc:492] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.159732 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c37dd3f9883c41dd9a0255fd5060328e
I20250625 14:01:53.158550 12177 raft_consensus.cc:2270] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.159983 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 99dd8205e438423f84792df3d651c7a9
I20250625 14:01:53.160037 11524 catalog_manager.cc:6652] ReplaceTablet: tablet c37dd3f9883c41dd9a0255fd5060328e deleted and replaced by tablet 59c3dd659e8048edac846083a0ff03aa
I20250625 14:01:53.160233 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 99dd8205e438423f84792df3d651c7a9 deleted and replaced by tablet 20fb7745d76c431f822258879e7d7134
I20250625 14:01:53.160451 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7f1415a5baff45288950d6b31c93d71a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.160535 12320 consensus_queue.cc:1162] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87a003e25dbf461ebec24a29ad7016ed" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
W20250625 14:01:53.160763 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f1415a5baff45288950d6b31c93d71a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.161756 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 99dd8205e438423f84792df3d651c7a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fb7745d76c431f822258879e7d7134) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.162287 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet c37dd3f9883c41dd9a0255fd5060328e with delete_type TABLET_DATA_DELETED (replaced by tablet 59c3dd659e8048edac846083a0ff03aa) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.162441 12175 tablet_replica.cc:331] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.162460 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 99dd8205e438423f84792df3d651c7a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fb7745d76c431f822258879e7d7134) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.162560 12175 raft_consensus.cc:2241] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.162659 12175 raft_consensus.cc:2270] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.162782 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet c37dd3f9883c41dd9a0255fd5060328e with delete_type TABLET_DATA_DELETED (replaced by tablet 59c3dd659e8048edac846083a0ff03aa) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.163731 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 99dd8205e438423f84792df3d651c7a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fb7745d76c431f822258879e7d7134) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.163846 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet c37dd3f9883c41dd9a0255fd5060328e with delete_type TABLET_DATA_DELETED (replaced by tablet 59c3dd659e8048edac846083a0ff03aa) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.164065 11763 tablet_service.cc:1468] Processing CreateTablet for tablet da2c9696938143f69ea1305ee076d84d (DEFAULT_TABLE table=default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.164126 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 33c895ed888b4cb8836f6a415d170c3e (DEFAULT_TABLE table=default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.164353 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2c9696938143f69ea1305ee076d84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.164565 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c895ed888b4cb8836f6a415d170c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.160240 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_657545d883ec472983269ce0bbcd63ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.165464 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_657545d883ec472983269ce0bbcd63ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.167025 12175 ts_tablet_manager.cc:1905] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.167405 12177 ts_tablet_manager.cc:1905] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.167678 12035 tablet_service.cc:1468] Processing CreateTablet for tablet da2c9696938143f69ea1305ee076d84d (DEFAULT_TABLE table=default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.167928 12265 raft_consensus.cc:491] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.168005 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2c9696938143f69ea1305ee076d84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.168020 12265 raft_consensus.cc:513] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.168450 12265 leader_election.cc:290] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.169737 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 33c895ed888b4cb8836f6a415d170c3e (DEFAULT_TABLE table=default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.170053 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c895ed888b4cb8836f6a415d170c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.170756 11897 tablet_service.cc:1468] Processing CreateTablet for tablet da2c9696938143f69ea1305ee076d84d (DEFAULT_TABLE table=default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.170851 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f4e293a800f24030b7f52f707a3b40a8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.171025 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2c9696938143f69ea1305ee076d84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.171262 12175 ts_tablet_manager.cc:1918] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.171326 12175 log.cc:1199] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/99dd8205e438423f84792df3d651c7a9
I20250625 14:01:53.171574 12175 ts_tablet_manager.cc:1939] T 99dd8205e438423f84792df3d651c7a9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.172290 12175 tablet_replica.cc:331] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.172379 12177 ts_tablet_manager.cc:1918] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.172416 12175 raft_consensus.cc:2241] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.172453 12177 log.cc:1199] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/de2c07609c4847cc916776be3546cba1
I20250625 14:01:53.172521 12175 raft_consensus.cc:2270] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.172667 12177 ts_tablet_manager.cc:1939] T de2c07609c4847cc916776be3546cba1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.173285 12173 ts_tablet_manager.cc:1905] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.173460 12177 tablet_replica.cc:331] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:01:53.173507 11855 leader_election.cc:343] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.173514 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 33c895ed888b4cb8836f6a415d170c3e (DEFAULT_TABLE table=default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.173578 12177 raft_consensus.cc:2241] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.173755 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c895ed888b4cb8836f6a415d170c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.173776 12177 raft_consensus.cc:2270] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.174384 12177 ts_tablet_manager.cc:1905] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.174471 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet de2c07609c4847cc916776be3546cba1 (table default.Table_c40f23fe758c45e6a212b6500d7c6b03 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:53.175560 12173 ts_tablet_manager.cc:1918] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.175626 12173 log.cc:1199] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/608f1a63442842ef8cba9ed4e9f85d88
I20250625 14:01:53.175879 12173 ts_tablet_manager.cc:1939] T 608f1a63442842ef8cba9ed4e9f85d88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.176187 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f4e293a800f24030b7f52f707a3b40a8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.176345 11784 raft_consensus.cc:2466] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:53.176384 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 99dd8205e438423f84792df3d651c7a9 (table default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]) successfully deleted
I20250625 14:01:53.176671 11858 leader_election.cc:304] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.176936 12265 raft_consensus.cc:2802] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.176992 12265 raft_consensus.cc:491] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.177031 12265 raft_consensus.cc:3058] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.177117 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_72fe4368faa447cb81e9db0cad9a87e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.177524 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72fe4368faa447cb81e9db0cad9a87e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.177732 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3edd1f01767d41b5a77323b7403ded25" } new_table_name: "default.Table_27b5da1267634910a47dcb65db17b755" modify_external_catalogs: true
I20250625 14:01:53.178035 12265 raft_consensus.cc:513] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.178460 12265 leader_election.cc:290] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.178627 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_717daef53a3946009baaef6869682ce3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.178951 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_717daef53a3946009baaef6869682ce3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.179145 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f4e293a800f24030b7f52f707a3b40a8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.179284 11784 raft_consensus.cc:3058] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.179296 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8d66b17e7a3948dfa0c312c5c07ea57d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.179606 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d66b17e7a3948dfa0c312c5c07ea57d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.180265 12166 tablet_bootstrap.cc:654] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.180327 11784 raft_consensus.cc:2466] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.180641 11858 leader_election.cc:304] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.180696 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f4e293a800f24030b7f52f707a3b40a8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.181212 12259 raft_consensus.cc:2802] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.181382 12259 raft_consensus.cc:695] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:53.181536 12173 tablet_replica.cc:331] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.181533 12259 consensus_queue.cc:237] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:53.181557 11855 leader_election.cc:343] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.181670 12173 raft_consensus.cc:2241] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.181864 12173 raft_consensus.cc:2270] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.182159 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 608f1a63442842ef8cba9ed4e9f85d88 (table default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]) successfully deleted
I20250625 14:01:53.182200 12175 ts_tablet_manager.cc:1905] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.183027 12173 ts_tablet_manager.cc:1905] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.184643 11784 raft_consensus.cc:1273] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.185235 12265 consensus_queue.cc:1035] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.186242 12173 ts_tablet_manager.cc:1918] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.186424 12173 log.cc:1199] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c37dd3f9883c41dd9a0255fd5060328e
I20250625 14:01:53.186652 12054 raft_consensus.cc:3058] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.187912 12054 raft_consensus.cc:1273] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.188035 12175 ts_tablet_manager.cc:1918] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.188110 12175 log.cc:1199] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c37dd3f9883c41dd9a0255fd5060328e
I20250625 14:01:53.188457 12173 ts_tablet_manager.cc:1939] T c37dd3f9883c41dd9a0255fd5060328e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.188473 12175 ts_tablet_manager.cc:1939] T c37dd3f9883c41dd9a0255fd5060328e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.189065 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c809e7c1c3894a12aa1504b30c0e4497" } new_table_name: "default.Table_986e9f5739b448869ad00a6a519c2b3b" modify_external_catalogs: true
I20250625 14:01:53.189849 12173 tablet_replica.cc:331] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.189962 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c37dd3f9883c41dd9a0255fd5060328e (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:53.190048 12173 raft_consensus.cc:2241] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.190049 12265 consensus_queue.cc:1035] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.190143 12173 raft_consensus.cc:2270] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.191987 12239 tablet.cc:1722] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.194000 12173 ts_tablet_manager.cc:1905] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.194999 12233 tablet.cc:1722] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.196131 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (table default.Table_97ce3b23ba19450597e36481cac5bbbc [id=396b9df84d604d29b6f720475255a184]). Expected version 1 got 0
I20250625 14:01:53.196272 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_8362aee5a9b14f48828ee6d0a7a1ee03 [id=d1a9808588a74a90be4afc3e4205373e]). Expected version 1 got 0
I20250625 14:01:53.196875 12173 ts_tablet_manager.cc:1918] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.196961 12173 log.cc:1199] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/99dd8205e438423f84792df3d651c7a9
I20250625 14:01:53.197227 12173 ts_tablet_manager.cc:1939] T 99dd8205e438423f84792df3d651c7a9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.197676 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0e6599cf920c4c8b8ed17ecad1a31338 (table default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]). Expected version 2 got 0
I20250625 14:01:53.198033 12177 ts_tablet_manager.cc:1918] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.198115 12177 log.cc:1199] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/99dd8205e438423f84792df3d651c7a9
W20250625 14:01:53.198773 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 812d9a36acf644c99edfbf55086f9b25 consensus state has no leader
I20250625 14:01:53.199254 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 608f1a63442842ef8cba9ed4e9f85d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 33c895ed888b4cb8836f6a415d170c3e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.199399 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 524dab39595247ce8bd82ec90fcf7b54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.199399 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 195690ee34cb442ab8509e51140af31f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:52 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.199844 12173 tablet_replica.cc:331] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.199872 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 99dd8205e438423f84792df3d651c7a9 (table default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]) successfully deleted
I20250625 14:01:53.199999 12173 raft_consensus.cc:2241] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.200032 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c37dd3f9883c41dd9a0255fd5060328e (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:53.200114 12173 raft_consensus.cc:2270] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:53.200307 11517 catalog_manager.cc:4895] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 608f1a63442842ef8cba9ed4e9f85d88 because the tablet was not found. No further retry: Not found: Tablet not found: 608f1a63442842ef8cba9ed4e9f85d88
I20250625 14:01:53.200404 11533 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (table default.Table_97ce3b23ba19450597e36481cac5bbbc [id=396b9df84d604d29b6f720475255a184]). Expected version 1 got 0
I20250625 14:01:53.200651 12173 ts_tablet_manager.cc:1905] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.201331 12166 tablet_bootstrap.cc:492] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.201422 12166 ts_tablet_manager.cc:1397] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.001s
I20250625 14:01:53.201879 12166 raft_consensus.cc:357] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.202030 12166 raft_consensus.cc:383] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.202064 12166 raft_consensus.cc:738] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.202193 12166 consensus_queue.cc:260] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.203424 12166 ts_tablet_manager.cc:1428] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:53.203644 12166 tablet_bootstrap.cc:492] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.203855 12177 ts_tablet_manager.cc:1939] T 99dd8205e438423f84792df3d651c7a9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.204481 12177 tablet_replica.cc:331] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.205054 12166 tablet_bootstrap.cc:654] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.205847 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 59c3dd659e8048edac846083a0ff03aa (DEFAULT_TABLE table=default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.205886 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 20fb7745d76c431f822258879e7d7134 (DEFAULT_TABLE table=default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.206132 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c3dd659e8048edac846083a0ff03aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.206435 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 59c3dd659e8048edac846083a0ff03aa (DEFAULT_TABLE table=default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.206702 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c3dd659e8048edac846083a0ff03aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.207724 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 99dd8205e438423f84792df3d651c7a9 (table default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]) successfully deleted
I20250625 14:01:53.208421 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 20fb7745d76c431f822258879e7d7134 (DEFAULT_TABLE table=default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.208694 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fb7745d76c431f822258879e7d7134. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.209163 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fb7745d76c431f822258879e7d7134. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.209125 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 20fb7745d76c431f822258879e7d7134 (DEFAULT_TABLE table=default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.209372 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fb7745d76c431f822258879e7d7134. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.210584 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 59c3dd659e8048edac846083a0ff03aa (DEFAULT_TABLE table=default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.210842 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c3dd659e8048edac846083a0ff03aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.204627 12177 raft_consensus.cc:2241] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.211802 12177 raft_consensus.cc:2270] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.216224 12236 tablet.cc:1722] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.217419 12173 ts_tablet_manager.cc:1918] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.217502 12173 log.cc:1199] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/524dab39595247ce8bd82ec90fcf7b54
I20250625 14:01:53.217725 12173 ts_tablet_manager.cc:1939] T 524dab39595247ce8bd82ec90fcf7b54 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.218508 12173 tablet_replica.cc:331] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.218645 12173 raft_consensus.cc:2241] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.218760 12173 raft_consensus.cc:2270] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.219167 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 524dab39595247ce8bd82ec90fcf7b54 (table default.Table_b736442acaca4a00b408d4fb0a3495aa [id=2fd36596ea3941a4b6c415cf994e3768]) successfully deleted
I20250625 14:01:53.220250 12173 ts_tablet_manager.cc:1905] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.222445 12173 ts_tablet_manager.cc:1918] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.222540 12173 log.cc:1199] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/195690ee34cb442ab8509e51140af31f
I20250625 14:01:53.222831 12173 ts_tablet_manager.cc:1939] T 195690ee34cb442ab8509e51140af31f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.222872 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_97ce3b23ba19450597e36481cac5bbbc" } new_table_name: "default.Table_d9bfb4dd53e542688a7732a9c4850e38" modify_external_catalogs: true
I20250625 14:01:53.222896 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c40f23fe758c45e6a212b6500d7c6b03" } new_table_name: "default.Table_10c989b9d71841c59c66d2a9c4f77021" modify_external_catalogs: true
I20250625 14:01:53.223520 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 195690ee34cb442ab8509e51140af31f (table default.Table_d01cbb4beb144fa1bad7bbab7e64e7cb [id=21738c97530c4f83b4b3ef65c7c51320]) successfully deleted
I20250625 14:01:53.223937 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5341f9ce3c654f6f8e4dcd6d31b5e1c5" } new_table_name: "default.Table_28d60bb833d14dcf97370422a7f67317" modify_external_catalogs: true
I20250625 14:01:53.224828 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7841efec8726433bb8558a603229a0af" } modify_external_catalogs: true
I20250625 14:01:53.225073 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7841efec8726433bb8558a603229a0af" } modify_external_catalogs: true
I20250625 14:01:53.225634 12177 ts_tablet_manager.cc:1905] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.227658 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3b6fd368b65440c98670d7ad05b554bf" } modify_external_catalogs: true
I20250625 14:01:53.227775 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3b6fd368b65440c98670d7ad05b554bf" } modify_external_catalogs: true
W20250625 14:01:53.229817 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09a197bdabd24d7c96febe1fd5352a14 consensus state has no leader
W20250625 14:01:53.230084 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da2c9696938143f69ea1305ee076d84d consensus state has no leader
I20250625 14:01:53.231115 12172 tablet_bootstrap.cc:492] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.231257 12172 ts_tablet_manager.cc:1397] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.077s user 0.000s sys 0.002s
I20250625 14:01:53.231797 12172 raft_consensus.cc:357] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.231904 12172 raft_consensus.cc:383] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.231938 12172 raft_consensus.cc:738] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.232087 12172 consensus_queue.cc:260] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.232349 12172 ts_tablet_manager.cc:1428] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.232573 12172 tablet_bootstrap.cc:492] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.233594 12172 tablet_bootstrap.cc:654] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.234514 12166 tablet_bootstrap.cc:492] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.234634 12166 ts_tablet_manager.cc:1397] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:01:53.235153 12166 raft_consensus.cc:357] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.235265 12166 raft_consensus.cc:383] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.235294 12166 raft_consensus.cc:738] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.235411 12166 consensus_queue.cc:260] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.235683 12166 ts_tablet_manager.cc:1428] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.235888 12166 tablet_bootstrap.cc:492] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.236917 12166 tablet_bootstrap.cc:654] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.238042 12166 tablet_bootstrap.cc:492] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.238134 12166 ts_tablet_manager.cc:1397] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:53.238672 12166 raft_consensus.cc:357] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.238762 12166 raft_consensus.cc:383] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.238783 12166 raft_consensus.cc:738] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.239351 12166 consensus_queue.cc:260] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.239666 12166 ts_tablet_manager.cc:1428] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.239850 12166 tablet_bootstrap.cc:492] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.240460 12178 raft_consensus.cc:491] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.240552 12178 raft_consensus.cc:513] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.240934 12166 tablet_bootstrap.cc:654] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.242588 12178 leader_election.cc:290] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.242905 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0396f83e03b649d5a146ae13be8666d7" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.243033 11920 raft_consensus.cc:2466] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:53.243337 11990 leader_election.cc:304] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.243592 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0396f83e03b649d5a146ae13be8666d7" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.243721 11784 raft_consensus.cc:2466] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:53.243816 12178 raft_consensus.cc:2802] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.243875 12178 raft_consensus.cc:491] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.243911 12178 raft_consensus.cc:3058] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.244571 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b9af043f465d41cd9dd63607eb4e8230
I20250625 14:01:53.244931 12178 raft_consensus.cc:513] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.245355 12178 leader_election.cc:290] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.245368 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet b9af043f465d41cd9dd63607eb4e8230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.245699 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet b9af043f465d41cd9dd63607eb4e8230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.246042 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0396f83e03b649d5a146ae13be8666d7" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.246156 11920 raft_consensus.cc:3058] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.246623 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet b9af043f465d41cd9dd63607eb4e8230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:53.247177 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b9af043f465d41cd9dd63607eb4e8230 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9af043f465d41cd9dd63607eb4e8230 already in progress: creating tablet
I20250625 14:01:53.247265 11920 raft_consensus.cc:2466] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:53.247308 12037 tablet_service.cc:1468] Processing CreateTablet for tablet ff54429a3d3e40688aaea56b70dcdfae (DEFAULT_TABLE table=default.Table_8d66b17e7a3948dfa0c312c5c07ea57d [id=8302b2a44b004bdab1aa2f67bb82ad01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.247591 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff54429a3d3e40688aaea56b70dcdfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.247634 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0396f83e03b649d5a146ae13be8666d7" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.247574 11990 leader_election.cc:304] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.247759 11784 raft_consensus.cc:3058] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.247859 12178 raft_consensus.cc:2802] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.247952 12178 raft_consensus.cc:695] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:53.248086 12178 consensus_queue.cc:237] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.248807 11784 raft_consensus.cc:2466] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:53.250478 11529 catalog_manager.cc:5582] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:53.250689 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 812d9a36acf644c99edfbf55086f9b25 (table default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 1 got 0
I20250625 14:01:53.250814 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0e6599cf920c4c8b8ed17ecad1a31338 (table default.Table_c809e7c1c3894a12aa1504b30c0e4497 [id=47d8fe69c6c74648951544929540413d]). Expected version 2 got 0
I20250625 14:01:53.250886 11897 tablet_service.cc:1468] Processing CreateTablet for tablet cb7bbd1c627f4da6b2e1812eed472c83 (DEFAULT_TABLE table=default.Table_717daef53a3946009baaef6869682ce3 [id=9bd1814bba0a43fa8a66a50e91ef165f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.251197 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7bbd1c627f4da6b2e1812eed472c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.251328 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_97ce3b23ba19450597e36481cac5bbbc [id=396b9df84d604d29b6f720475255a184] alter complete (version 1)
I20250625 14:01:53.251322 12037 tablet_service.cc:1468] Processing CreateTablet for tablet cb7bbd1c627f4da6b2e1812eed472c83 (DEFAULT_TABLE table=default.Table_717daef53a3946009baaef6869682ce3 [id=9bd1814bba0a43fa8a66a50e91ef165f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.251415 11759 tablet_service.cc:1468] Processing CreateTablet for tablet ff54429a3d3e40688aaea56b70dcdfae (DEFAULT_TABLE table=default.Table_8d66b17e7a3948dfa0c312c5c07ea57d [id=8302b2a44b004bdab1aa2f67bb82ad01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.251555 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7bbd1c627f4da6b2e1812eed472c83. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:53.251628 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e6599cf920c4c8b8ed17ecad1a31338 consensus state has no leader
I20250625 14:01:53.251691 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff54429a3d3e40688aaea56b70dcdfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.253015 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f4e293a800f24030b7f52f707a3b40a8
I20250625 14:01:53.254544 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 608f1a63442842ef8cba9ed4e9f85d88 with delete_type TABLET_DATA_DELETED (replaced by tablet 33c895ed888b4cb8836f6a415d170c3e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.254686 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet f4e293a800f24030b7f52f707a3b40a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.254809 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet de2c07609c4847cc916776be3546cba1 with delete_type TABLET_DATA_DELETED (replaced by tablet da2c9696938143f69ea1305ee076d84d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.256438 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet f4e293a800f24030b7f52f707a3b40a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.257097 12167 tablet_bootstrap.cc:492] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.257181 12167 ts_tablet_manager.cc:1397] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.124s user 0.001s sys 0.001s
W20250625 14:01:53.257205 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b9af043f465d41cd9dd63607eb4e8230 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9af043f465d41cd9dd63607eb4e8230 already in progress: creating tablet
I20250625 14:01:53.257515 12175 tablet_replica.cc:331] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.257642 12175 raft_consensus.cc:2241] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.257666 12167 raft_consensus.cc:357] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.257678 11758 tablet_service.cc:1468] Processing CreateTablet for tablet cb7bbd1c627f4da6b2e1812eed472c83 (DEFAULT_TABLE table=default.Table_717daef53a3946009baaef6869682ce3 [id=9bd1814bba0a43fa8a66a50e91ef165f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.257767 12167 raft_consensus.cc:383] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.257795 12175 pending_rounds.cc:70] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:53.257795 12167 raft_consensus.cc:738] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.257824 12175 pending_rounds.cc:77] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523023593156608 op_type: NO_OP noop_request { }
I20250625 14:01:53.257884 12175 raft_consensus.cc:2887] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:53.257908 12167 consensus_queue.cc:260] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.257964 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7bbd1c627f4da6b2e1812eed472c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.257959 12175 raft_consensus.cc:2270] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.258155 12167 ts_tablet_manager.cc:1428] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.258378 12167 tablet_bootstrap.cc:492] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.259428 12167 tablet_bootstrap.cc:654] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.261134 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f4e293a800f24030b7f52f707a3b40a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.261224 12175 ts_tablet_manager.cc:1905] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.261328 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 470a4489d4284f909016c6c464a4ad12 (DEFAULT_TABLE table=default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.261597 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470a4489d4284f909016c6c464a4ad12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.263515 12175 ts_tablet_manager.cc:1918] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.263594 12175 log.cc:1199] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f4e293a800f24030b7f52f707a3b40a8
I20250625 14:01:53.263831 12175 ts_tablet_manager.cc:1939] T f4e293a800f24030b7f52f707a3b40a8 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.264106 12327 raft_consensus.cc:491] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.264197 12327 raft_consensus.cc:513] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:53.264365 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f4e293a800f24030b7f52f707a3b40a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4e293a800f24030b7f52f707a3b40a8 already in progress: creating tablet
I20250625 14:01:53.264812 12327 leader_election.cc:290] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:01:53.265364 11858 leader_election.cc:343] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: de2c07609c4847cc916776be3546cba1
I20250625 14:01:53.265949 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 99dd8205e438423f84792df3d651c7a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 20fb7745d76c431f822258879e7d7134) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.266234 12166 tablet_bootstrap.cc:492] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.266218 11899 tablet_service.cc:1468] Processing CreateTablet for tablet ff54429a3d3e40688aaea56b70dcdfae (DEFAULT_TABLE table=default.Table_8d66b17e7a3948dfa0c312c5c07ea57d [id=8302b2a44b004bdab1aa2f67bb82ad01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.266235 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "de2c07609c4847cc916776be3546cba1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.266369 12166 ts_tablet_manager.cc:1397] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:01:53.266513 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff54429a3d3e40688aaea56b70dcdfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.266633 11525 catalog_manager.cc:5582] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:53.266878 12166 raft_consensus.cc:357] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.266975 12166 raft_consensus.cc:383] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.267022 12166 raft_consensus.cc:738] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.267426 12166 consensus_queue.cc:260] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.267716 12166 ts_tablet_manager.cc:1428] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:53.268043 11855 leader_election.cc:343] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.268115 11855 leader_election.cc:304] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.268596 12327 raft_consensus.cc:2747] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.268826 12166 tablet_bootstrap.cc:492] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.270241 12166 tablet_bootstrap.cc:654] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.266119 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f4e293a800f24030b7f52f707a3b40a8 (table default.Table_3b6fd368b65440c98670d7ad05b554bf [id=c62025e9d42b4db78e9c63a6ed7f9803]) successfully deleted
I20250625 14:01:53.272403 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 470a4489d4284f909016c6c464a4ad12 (DEFAULT_TABLE table=default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.272744 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470a4489d4284f909016c6c464a4ad12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.272765 12054 raft_consensus.cc:3058] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.273281 11784 raft_consensus.cc:1273] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.273728 12327 consensus_queue.cc:1035] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.274009 12054 raft_consensus.cc:1273] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.274667 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 470a4489d4284f909016c6c464a4ad12 (DEFAULT_TABLE table=default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.274930 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 470a4489d4284f909016c6c464a4ad12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.276616 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 000aa8550a8b4f96922312e84c518978 (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.276882 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000aa8550a8b4f96922312e84c518978. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.277451 12327 consensus_queue.cc:1035] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.277688 12178 raft_consensus.cc:491] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.277777 12178 raft_consensus.cc:513] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.277940 12177 ts_tablet_manager.cc:1918] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.278008 12177 log.cc:1199] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c37dd3f9883c41dd9a0255fd5060328e
I20250625 14:01:53.278115 11763 tablet_service.cc:1468] Processing CreateTablet for tablet f40cfb7e1454489f9d01fd220e35b3e6 (DEFAULT_TABLE table=default.Table_cf032fd9d44e45eba5453bab85a976bb [id=f598d49003534886af0cbb8abcb424ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.278146 12178 leader_election.cc:290] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.278280 12177 ts_tablet_manager.cc:1939] T c37dd3f9883c41dd9a0255fd5060328e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.278375 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40cfb7e1454489f9d01fd220e35b3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.278429 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "812d9a36acf644c99edfbf55086f9b25" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.278756 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 0996320cbc83480cbb4d53248efacffd (DEFAULT_TABLE table=default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.278966 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0996320cbc83480cbb4d53248efacffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.280493 11761 tablet_service.cc:1468] Processing CreateTablet for tablet d9546e85eaa44e5f8150b46f556782bd (DEFAULT_TABLE table=default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.280692 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9546e85eaa44e5f8150b46f556782bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.282696 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "812d9a36acf644c99edfbf55086f9b25" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.282814 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 000aa8550a8b4f96922312e84c518978 (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.282814 12035 tablet_service.cc:1468] Processing CreateTablet for tablet f40cfb7e1454489f9d01fd220e35b3e6 (DEFAULT_TABLE table=default.Table_cf032fd9d44e45eba5453bab85a976bb [id=f598d49003534886af0cbb8abcb424ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.283139 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000aa8550a8b4f96922312e84c518978. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.283250 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40cfb7e1454489f9d01fd220e35b3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.283370 12032 tablet_service.cc:1468] Processing CreateTablet for tablet d9546e85eaa44e5f8150b46f556782bd (DEFAULT_TABLE table=default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.283592 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9546e85eaa44e5f8150b46f556782bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.284590 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 80f4e61e39894e88b3497328da8f7d01 (DEFAULT_TABLE table=default.Table_75ec00556aa0458f86b7c08e673576c4 [id=0071abfe5ba94050bfc65317fae65385]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.284819 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f4e61e39894e88b3497328da8f7d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.285068 11990 leader_election.cc:304] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:53.285229 12178 raft_consensus.cc:2747] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 14:01:53.285282 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 0996320cbc83480cbb4d53248efacffd (DEFAULT_TABLE table=default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.285542 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0996320cbc83480cbb4d53248efacffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.285763 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 0996320cbc83480cbb4d53248efacffd (DEFAULT_TABLE table=default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.285975 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0996320cbc83480cbb4d53248efacffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.286252 12167 tablet_bootstrap.cc:492] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.286383 12167 ts_tablet_manager.cc:1397] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20250625 14:01:53.286918 12167 raft_consensus.cc:357] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.287034 12167 raft_consensus.cc:383] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.287061 12167 raft_consensus.cc:738] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.287176 12167 consensus_queue.cc:260] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.287467 12167 ts_tablet_manager.cc:1428] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.287679 12167 tablet_bootstrap.cc:492] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.288682 12167 tablet_bootstrap.cc:654] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.288671 11896 tablet_service.cc:1468] Processing CreateTablet for tablet f40cfb7e1454489f9d01fd220e35b3e6 (DEFAULT_TABLE table=default.Table_cf032fd9d44e45eba5453bab85a976bb [id=f598d49003534886af0cbb8abcb424ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.288971 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40cfb7e1454489f9d01fd220e35b3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.289045 12177 tablet_replica.cc:331] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.289180 12177 raft_consensus.cc:2241] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.289289 12177 raft_consensus.cc:2270] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.289831 12177 ts_tablet_manager.cc:1905] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.289808 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c37dd3f9883c41dd9a0255fd5060328e (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:53.290640 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 80f4e61e39894e88b3497328da8f7d01 (DEFAULT_TABLE table=default.Table_75ec00556aa0458f86b7c08e673576c4 [id=0071abfe5ba94050bfc65317fae65385]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.291787 12172 tablet_bootstrap.cc:492] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.291862 12172 ts_tablet_manager.cc:1397] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.000s
I20250625 14:01:53.292302 12172 raft_consensus.cc:357] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.292395 12172 raft_consensus.cc:383] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.292423 12172 raft_consensus.cc:738] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.292518 12172 consensus_queue.cc:260] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.292759 12172 ts_tablet_manager.cc:1428] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.292762 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 88261e6c75b24755852c22f3d9385347 (DEFAULT_TABLE table=default.Table_29b36939592445fa8336a104142a6d44 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.292943 12172 tablet_bootstrap.cc:492] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.288671 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 000aa8550a8b4f96922312e84c518978 (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.293601 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000aa8550a8b4f96922312e84c518978. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.293941 12172 tablet_bootstrap.cc:654] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.294690 12177 ts_tablet_manager.cc:1918] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.294759 12177 log.cc:1199] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b9af043f465d41cd9dd63607eb4e8230
I20250625 14:01:53.294960 12177 ts_tablet_manager.cc:1939] T b9af043f465d41cd9dd63607eb4e8230 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.295899 11525 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (table default.Table_d9bfb4dd53e542688a7732a9c4850e38 [id=396b9df84d604d29b6f720475255a184]). Expected version 2 got 1
I20250625 14:01:53.295974 11900 tablet_service.cc:1468] Processing CreateTablet for tablet d9546e85eaa44e5f8150b46f556782bd (DEFAULT_TABLE table=default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.296198 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9546e85eaa44e5f8150b46f556782bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.296623 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b9af043f465d41cd9dd63607eb4e8230 (table default.Table_7841efec8726433bb8558a603229a0af [id=f9324275818c4e7a9b39e0d31e2dc12d]) successfully deleted
W20250625 14:01:53.297407 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 608f1a63442842ef8cba9ed4e9f85d88 because the tablet was not found. No further retry: Not found: Tablet not found: 608f1a63442842ef8cba9ed4e9f85d88
I20250625 14:01:53.297464 11761 tablet_service.cc:1468] Processing CreateTablet for tablet fb8c57c541114222b81dff868b1529f6 (DEFAULT_TABLE table=default.Table_cba0c23c2d6d4dfdb990086dc9ed2834 [id=83f715a6270c49f7b0986d2b05d73b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.297691 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8c57c541114222b81dff868b1529f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.298417 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet b9af043f465d41cd9dd63607eb4e8230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.299075 12239 tablet.cc:1722] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.299968 12167 tablet_bootstrap.cc:492] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.300060 12167 ts_tablet_manager.cc:1397] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:53.300541 12167 raft_consensus.cc:357] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.300642 12167 raft_consensus.cc:383] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.300670 12167 raft_consensus.cc:738] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.300783 12167 consensus_queue.cc:260] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.301220 12031 tablet_service.cc:1468] Processing CreateTablet for tablet fb8c57c541114222b81dff868b1529f6 (DEFAULT_TABLE table=default.Table_cba0c23c2d6d4dfdb990086dc9ed2834 [id=83f715a6270c49f7b0986d2b05d73b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.301594 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 88261e6c75b24755852c22f3d9385347 (DEFAULT_TABLE table=default.Table_29b36939592445fa8336a104142a6d44 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.301995 12167 ts_tablet_manager.cc:1428] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:53.304155 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 88261e6c75b24755852c22f3d9385347 (DEFAULT_TABLE table=default.Table_29b36939592445fa8336a104142a6d44 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.304445 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88261e6c75b24755852c22f3d9385347. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.304668 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 80f4e61e39894e88b3497328da8f7d01 (DEFAULT_TABLE table=default.Table_75ec00556aa0458f86b7c08e673576c4 [id=0071abfe5ba94050bfc65317fae65385]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.304870 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f4e61e39894e88b3497328da8f7d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.305248 12172 tablet_bootstrap.cc:492] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.305339 12172 ts_tablet_manager.cc:1397] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20250625 14:01:53.305827 12172 raft_consensus.cc:357] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.305961 12172 raft_consensus.cc:383] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.305994 12172 raft_consensus.cc:738] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.306121 12172 consensus_queue.cc:260] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.306351 12177 tablet_replica.cc:331] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.306384 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet de2c07609c4847cc916776be3546cba1 with delete_type TABLET_DATA_DELETED (replaced by tablet da2c9696938143f69ea1305ee076d84d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.306443 12172 ts_tablet_manager.cc:1428] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.306519 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet f2748c24d9804c41b8d03156c1587e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.306787 11895 tablet_service.cc:1468] Processing CreateTablet for tablet fb8c57c541114222b81dff868b1529f6 (DEFAULT_TABLE table=default.Table_cba0c23c2d6d4dfdb990086dc9ed2834 [id=83f715a6270c49f7b0986d2b05d73b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.307036 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8c57c541114222b81dff868b1529f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.307116 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet f4e293a800f24030b7f52f707a3b40a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.307920 12236 tablet.cc:1722] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.308578 12177 raft_consensus.cc:2241] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.308939 12177 raft_consensus.cc:2270] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.309352 12175 tablet_replica.cc:331] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.309473 12175 raft_consensus.cc:2241] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.309541 12177 ts_tablet_manager.cc:1905] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.309576 12175 raft_consensus.cc:2270] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.310746 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_493a555ade1e403cbd43a86a1c2dcbb2" } modify_external_catalogs: true
I20250625 14:01:53.310879 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_493a555ade1e403cbd43a86a1c2dcbb2" } modify_external_catalogs: true
I20250625 14:01:53.311818 12177 ts_tablet_manager.cc:1918] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.311882 12177 log.cc:1199] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f4e293a800f24030b7f52f707a3b40a8
I20250625 14:01:53.312093 12177 ts_tablet_manager.cc:1939] T f4e293a800f24030b7f52f707a3b40a8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.313482 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f4e61e39894e88b3497328da8f7d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.313607 12239 tablet.cc:1722] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:53.314520 12233 tablet.cc:1722] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:53.315831 12167 tablet_bootstrap.cc:492] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.316154 12236 tablet.cc:1722] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:53.316915 12167 tablet_bootstrap.cc:654] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.318025 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8c57c541114222b81dff868b1529f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.318408 12175 ts_tablet_manager.cc:1905] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.320726 12175 ts_tablet_manager.cc:1918] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.320811 12175 log.cc:1199] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/de2c07609c4847cc916776be3546cba1
I20250625 14:01:53.321028 12175 ts_tablet_manager.cc:1939] T de2c07609c4847cc916776be3546cba1 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.321350 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88261e6c75b24755852c22f3d9385347. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.321652 12175 tablet_replica.cc:331] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.321767 12175 raft_consensus.cc:2241] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.321861 12175 raft_consensus.cc:2270] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.324862 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6c2e6fedb8a74a829bc14d61bf626ed8" } modify_external_catalogs: true
I20250625 14:01:53.324999 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6c2e6fedb8a74a829bc14d61bf626ed8" } modify_external_catalogs: true
I20250625 14:01:53.326582 12166 tablet_bootstrap.cc:492] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.326676 12166 ts_tablet_manager.cc:1397] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.000s
I20250625 14:01:53.327142 12166 raft_consensus.cc:357] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.327244 12166 raft_consensus.cc:383] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.327271 12166 raft_consensus.cc:738] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.327386 12167 tablet_bootstrap.cc:492] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.327371 12166 consensus_queue.cc:260] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.327477 12167 ts_tablet_manager.cc:1397] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:53.327608 12166 ts_tablet_manager.cc:1428] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.327775 12166 tablet_bootstrap.cc:492] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.328047 12167 raft_consensus.cc:357] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.328153 12167 raft_consensus.cc:383] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.328187 12167 raft_consensus.cc:738] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.328322 12167 consensus_queue.cc:260] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.328804 12166 tablet_bootstrap.cc:654] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.329221 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ed4f16f35df243efae3f4c6bfff51566" } modify_external_catalogs: true
I20250625 14:01:53.329339 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ed4f16f35df243efae3f4c6bfff51566" } modify_external_catalogs: true
I20250625 14:01:53.329756 12233 tablet.cc:1722] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.331512 12167 ts_tablet_manager.cc:1428] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:53.331998 12167 tablet_bootstrap.cc:492] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.332427 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 20fb7745d76c431f822258879e7d7134 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.333153 12167 tablet_bootstrap.cc:654] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.333865 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 812d9a36acf644c99edfbf55086f9b25 (table default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 1 got 0
I20250625 14:01:53.333956 12265 raft_consensus.cc:491] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.334040 12265 raft_consensus.cc:513] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.334412 12265 leader_election.cc:290] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.334910 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet de2c07609c4847cc916776be3546cba1 (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:53.334897 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f306b943fbf4ccebc4e1c89934c7d88" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:53.335276 11855 leader_election.cc:343] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.335650 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f306b943fbf4ccebc4e1c89934c7d88" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:53.336006 11858 leader_election.cc:343] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.336077 11858 leader_election.cc:304] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.336467 12265 raft_consensus.cc:2747] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.337509 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88261e6c75b24755852c22f3d9385347. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.337589 12172 tablet_bootstrap.cc:492] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.337944 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11] alter complete (version 1)
I20250625 14:01:53.339478 12172 tablet_bootstrap.cc:654] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.341235 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f4e293a800f24030b7f52f707a3b40a8 (table default.Table_3b6fd368b65440c98670d7ad05b554bf [id=c62025e9d42b4db78e9c63a6ed7f9803]) successfully deleted
W20250625 14:01:53.341646 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet de2c07609c4847cc916776be3546cba1 because the tablet was not found. No further retry: Not found: Tablet not found: de2c07609c4847cc916776be3546cba1
W20250625 14:01:53.341955 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 99dd8205e438423f84792df3d651c7a9 because the tablet was not found. No further retry: Not found: Tablet not found: 99dd8205e438423f84792df3d651c7a9
W20250625 14:01:53.342283 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b9af043f465d41cd9dd63607eb4e8230 because the tablet was not found. No further retry: Not found: Tablet not found: b9af043f465d41cd9dd63607eb4e8230
I20250625 14:01:53.343024 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f4e293a800f24030b7f52f707a3b40a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.343204 12173 tablet_replica.cc:331] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.343345 12173 raft_consensus.cc:2241] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.343446 12173 raft_consensus.cc:2270] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.343886 12173 ts_tablet_manager.cc:1905] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.344218 12166 tablet_bootstrap.cc:492] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.344319 12166 ts_tablet_manager.cc:1397] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.001s
I20250625 14:01:53.344784 12166 raft_consensus.cc:357] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.344882 12166 raft_consensus.cc:383] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.344918 12166 raft_consensus.cc:738] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.345031 12166 consensus_queue.cc:260] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.345276 12166 ts_tablet_manager.cc:1428] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.345446 12166 tablet_bootstrap.cc:492] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.346346 12173 ts_tablet_manager.cc:1918] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.346424 12173 log.cc:1199] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f4e293a800f24030b7f52f707a3b40a8
I20250625 14:01:53.346647 12173 ts_tablet_manager.cc:1939] T f4e293a800f24030b7f52f707a3b40a8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.347443 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0e6599cf920c4c8b8ed17ecad1a31338 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:01:53.347548 12166 tablet_bootstrap.cc:654] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.348107 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f4e293a800f24030b7f52f707a3b40a8 (table default.Table_3b6fd368b65440c98670d7ad05b554bf [id=c62025e9d42b4db78e9c63a6ed7f9803]) successfully deleted
I20250625 14:01:53.348680 12166 tablet_bootstrap.cc:492] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.348773 12166 ts_tablet_manager.cc:1397] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:53.349251 12166 raft_consensus.cc:357] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.349368 12166 raft_consensus.cc:383] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.349403 12166 raft_consensus.cc:738] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.349527 12166 consensus_queue.cc:260] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.350517 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 33c895ed888b4cb8836f6a415d170c3e
I20250625 14:01:53.351007 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 20fb7745d76c431f822258879e7d7134
I20250625 14:01:53.351532 12166 ts_tablet_manager.cc:1428] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:53.351734 12166 tablet_bootstrap.cc:492] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.351836 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 082a46d213c545b18acbcac1b699d140
W20250625 14:01:53.352777 11520 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet da2c9696938143f69ea1305ee076d84d consensus state has no leader
I20250625 14:01:53.353140 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 33c895ed888b4cb8836f6a415d170c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.353307 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 33c895ed888b4cb8836f6a415d170c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.353117 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 20fb7745d76c431f822258879e7d7134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.353776 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 082a46d213c545b18acbcac1b699d140 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:53.353963 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 33c895ed888b4cb8836f6a415d170c3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33c895ed888b4cb8836f6a415d170c3e already in progress: creating tablet
W20250625 14:01:53.354122 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 20fb7745d76c431f822258879e7d7134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20fb7745d76c431f822258879e7d7134 already in progress: creating tablet
I20250625 14:01:53.354167 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet f2748c24d9804c41b8d03156c1587e93 from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:53.354406 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 082a46d213c545b18acbcac1b699d140 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 082a46d213c545b18acbcac1b699d140 already in progress: creating tablet
I20250625 14:01:53.355274 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 470a4489d4284f909016c6c464a4ad12 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.355394 12166 tablet_bootstrap.cc:654] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.358155 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 33c895ed888b4cb8836f6a415d170c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.358457 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 20fb7745d76c431f822258879e7d7134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.358645 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 20fb7745d76c431f822258879e7d7134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.358997 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 082a46d213c545b18acbcac1b699d140 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:53.359102 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 33c895ed888b4cb8836f6a415d170c3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33c895ed888b4cb8836f6a415d170c3e already in progress: creating tablet
W20250625 14:01:53.359293 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 20fb7745d76c431f822258879e7d7134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20fb7745d76c431f822258879e7d7134 already in progress: creating tablet
W20250625 14:01:53.359447 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 082a46d213c545b18acbcac1b699d140 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 082a46d213c545b18acbcac1b699d140 already in progress: creating tablet
I20250625 14:01:53.359490 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 082a46d213c545b18acbcac1b699d140 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.360714 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_d9bfb4dd53e542688a7732a9c4850e38 [id=396b9df84d604d29b6f720475255a184] alter complete (version 2)
I20250625 14:01:53.361428 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet d5229b608b084c4d9198fccd25bed935 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.362143 12177 tablet_replica.cc:331] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.362344 12177 raft_consensus.cc:2241] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.362468 12177 raft_consensus.cc:2270] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.362980 12177 ts_tablet_manager.cc:1905] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.365195 12177 ts_tablet_manager.cc:1918] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.365294 12177 log.cc:1199] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d5229b608b084c4d9198fccd25bed935
I20250625 14:01:53.365517 12177 ts_tablet_manager.cc:1939] T d5229b608b084c4d9198fccd25bed935 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.365913 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d5229b608b084c4d9198fccd25bed935 (table default.Table_c5c82cbb5bd4477fb342ccc243e798a9 [id=8d5c6093ab50409e9367b95e9cad2f7a]) successfully deleted
I20250625 14:01:53.367592 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 20fb7745d76c431f822258879e7d7134 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.367945 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 59c3dd659e8048edac846083a0ff03aa from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.368716 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet d5229b608b084c4d9198fccd25bed935 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.369935 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet de2c07609c4847cc916776be3546cba1 with delete_type TABLET_DATA_DELETED (replaced by tablet da2c9696938143f69ea1305ee076d84d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.370013 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 470a4489d4284f909016c6c464a4ad12
I20250625 14:01:53.370177 12173 tablet_replica.cc:331] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.370354 12173 raft_consensus.cc:2241] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.370478 12173 raft_consensus.cc:2270] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.370800 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet c36e99b2e83141ff9923478ca7a13a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.371006 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 470a4489d4284f909016c6c464a4ad12 with delete_type TABLET_DATA_DELETED (replaced by tablet da88786d60c34c71b85abd0fca502b8d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.371295 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 470a4489d4284f909016c6c464a4ad12 with delete_type TABLET_DATA_DELETED (replaced by tablet da88786d60c34c71b85abd0fca502b8d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.371356 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 470a4489d4284f909016c6c464a4ad12 deleted and replaced by tablet da88786d60c34c71b85abd0fca502b8d
I20250625 14:01:53.371853 12173 ts_tablet_manager.cc:1905] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.372848 12175 ts_tablet_manager.cc:1905] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.374432 12173 ts_tablet_manager.cc:1918] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.374511 12173 log.cc:1199] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/de2c07609c4847cc916776be3546cba1
I20250625 14:01:53.374722 12173 ts_tablet_manager.cc:1939] T de2c07609c4847cc916776be3546cba1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.374956 12166 tablet_bootstrap.cc:492] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.375047 12166 ts_tablet_manager.cc:1397] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:53.375169 12175 ts_tablet_manager.cc:1918] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.375247 12175 log.cc:1199] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f2748c24d9804c41b8d03156c1587e93
I20250625 14:01:53.375461 12175 ts_tablet_manager.cc:1939] T f2748c24d9804c41b8d03156c1587e93 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.375602 12166 raft_consensus.cc:357] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.375749 12166 raft_consensus.cc:383] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.375789 12166 raft_consensus.cc:738] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.375963 12166 consensus_queue.cc:260] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.376250 12166 ts_tablet_manager.cc:1428] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.376451 12166 tablet_bootstrap.cc:492] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.377194 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 59c3dd659e8048edac846083a0ff03aa
I20250625 14:01:53.377398 12175 tablet_replica.cc:331] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.377506 12166 tablet_bootstrap.cc:654] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.377669 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 59c3dd659e8048edac846083a0ff03aa deleted and replaced by tablet 66cab8705ca2439abfa683f8b8b6dc45
I20250625 14:01:53.377717 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 59c3dd659e8048edac846083a0ff03aa with delete_type TABLET_DATA_DELETED (replaced by tablet 66cab8705ca2439abfa683f8b8b6dc45) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:53.378778 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 59c3dd659e8048edac846083a0ff03aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59c3dd659e8048edac846083a0ff03aa already in progress: creating tablet
I20250625 14:01:53.379166 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 59c3dd659e8048edac846083a0ff03aa with delete_type TABLET_DATA_DELETED (replaced by tablet 66cab8705ca2439abfa683f8b8b6dc45) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.379367 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 59c3dd659e8048edac846083a0ff03aa with delete_type TABLET_DATA_DELETED (replaced by tablet 66cab8705ca2439abfa683f8b8b6dc45) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.379384 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet de2c07609c4847cc916776be3546cba1 (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
W20250625 14:01:53.379523 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 470a4489d4284f909016c6c464a4ad12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 470a4489d4284f909016c6c464a4ad12 already in progress: creating tablet
I20250625 14:01:53.379629 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f2748c24d9804c41b8d03156c1587e93 (table default.Table_8d003fa42e2a4a85b64e842f0199c525 [id=4111545cc6b44021b0bd7881cfb57a7b]) successfully deleted
I20250625 14:01:53.380266 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 470a4489d4284f909016c6c464a4ad12 with delete_type TABLET_DATA_DELETED (replaced by tablet da88786d60c34c71b85abd0fca502b8d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.380806 12175 raft_consensus.cc:2241] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.380985 12175 raft_consensus.cc:2270] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.381896 12175 ts_tablet_manager.cc:1905] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.383416 12166 tablet_bootstrap.cc:492] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.383513 12166 ts_tablet_manager.cc:1397] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:53.384049 12166 raft_consensus.cc:357] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.384182 12166 raft_consensus.cc:383] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.384219 12166 raft_consensus.cc:738] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.384362 12166 consensus_queue.cc:260] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.384322 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_581755885025457ea3fe5fc8c847b994"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.384730 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_581755885025457ea3fe5fc8c847b994 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:53.384341 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 470a4489d4284f909016c6c464a4ad12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 470a4489d4284f909016c6c464a4ad12 already in progress: creating tablet
I20250625 14:01:53.385286 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fa9aec9800fe444086b8c3bbc7cf3523"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.385535 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c2f06be7a54e4be7b2ce6205ac8002dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.385643 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa9aec9800fe444086b8c3bbc7cf3523 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.385705 12166 ts_tablet_manager.cc:1428] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20250625 14:01:53.385847 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2f06be7a54e4be7b2ce6205ac8002dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.385921 12166 tablet_bootstrap.cc:492] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.386612 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8029b9c972e547b0aa052cd38040c777"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.386890 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8029b9c972e547b0aa052cd38040c777 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.386984 12166 tablet_bootstrap.cc:654] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.388679 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 1 got 0
I20250625 14:01:53.389776 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 66cab8705ca2439abfa683f8b8b6dc45 (DEFAULT_TABLE table=default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.390112 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cab8705ca2439abfa683f8b8b6dc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.391268 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 1 got 0
I20250625 14:01:53.386584 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a064bc3c05154988ba0d4f0db51024eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.391724 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a064bc3c05154988ba0d4f0db51024eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.391872 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a13429dfda614c5c98a33e244bef1ba3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.392199 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a13429dfda614c5c98a33e244bef1ba3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.393066 12238 raft_consensus.cc:491] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.393148 12238 raft_consensus.cc:513] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.393536 12238 leader_election.cc:290] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.393903 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "36da902c99bf4416aa0769438182e443" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.393903 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "36da902c99bf4416aa0769438182e443" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.394057 11920 raft_consensus.cc:2466] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.394482 11717 leader_election.cc:304] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.394665 12238 raft_consensus.cc:2802] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 14:01:53.394688 11717 leader_election.cc:343] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.394722 12238 raft_consensus.cc:491] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.394758 12238 raft_consensus.cc:3058] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:53.379734 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f4e293a800f24030b7f52f707a3b40a8 because the tablet was not found. No further retry: Not found: Tablet not found: f4e293a800f24030b7f52f707a3b40a8
W20250625 14:01:53.395576 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 33c895ed888b4cb8836f6a415d170c3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33c895ed888b4cb8836f6a415d170c3e already in progress: creating tablet
W20250625 14:01:53.395696 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 20fb7745d76c431f822258879e7d7134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20fb7745d76c431f822258879e7d7134 already in progress: creating tablet
W20250625 14:01:53.395798 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 082a46d213c545b18acbcac1b699d140 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 082a46d213c545b18acbcac1b699d140 already in progress: creating tablet
I20250625 14:01:53.395787 12238 raft_consensus.cc:513] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.396132 12238 leader_election.cc:290] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.396611 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "36da902c99bf4416aa0769438182e443" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.396741 11920 raft_consensus.cc:3058] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.396814 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "36da902c99bf4416aa0769438182e443" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.397756 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 66cab8705ca2439abfa683f8b8b6dc45 (DEFAULT_TABLE table=default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.397804 11920 raft_consensus.cc:2466] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.398053 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cab8705ca2439abfa683f8b8b6dc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.398162 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 66cab8705ca2439abfa683f8b8b6dc45 (DEFAULT_TABLE table=default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.398433 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cab8705ca2439abfa683f8b8b6dc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.400223 12166 tablet_bootstrap.cc:492] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.400314 12166 ts_tablet_manager.cc:1397] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20250625 14:01:53.400731 12037 tablet_service.cc:1468] Processing CreateTablet for tablet da88786d60c34c71b85abd0fca502b8d (DEFAULT_TABLE table=default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.400784 12166 raft_consensus.cc:357] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.400880 12166 raft_consensus.cc:383] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.400910 12166 raft_consensus.cc:738] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.400959 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da88786d60c34c71b85abd0fca502b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.401029 12166 consensus_queue.cc:260] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.401332 12166 ts_tablet_manager.cc:1428] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.401489 12166 tablet_bootstrap.cc:492] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.402429 12166 tablet_bootstrap.cc:654] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.403410 11717 leader_election.cc:304] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:53.403589 11717 leader_election.cc:343] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.403718 12238 raft_consensus.cc:2802] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.403808 12238 raft_consensus.cc:695] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.403937 12238 consensus_queue.cc:237] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:53.404441 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 59c3dd659e8048edac846083a0ff03aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59c3dd659e8048edac846083a0ff03aa already in progress: creating tablet
I20250625 14:01:53.406194 12175 ts_tablet_manager.cc:1918] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.406280 12175 log.cc:1199] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d5229b608b084c4d9198fccd25bed935
I20250625 14:01:53.406523 12175 ts_tablet_manager.cc:1939] T d5229b608b084c4d9198fccd25bed935 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.407140 12175 tablet_replica.cc:331] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.408854 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_54578c11cecd4aac98ae5f4fb3c180b7" } new_table_name: "default.Table_006ddbff8b0c4a23b5692e4712f0f230" modify_external_catalogs: true
I20250625 14:01:53.408782 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6cd4de10d95046caa0f949f76701914f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.408995 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_466564dce5b24b5bbfc5d0dad764862d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.409283 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cd4de10d95046caa0f949f76701914f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:53.409353 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_466564dce5b24b5bbfc5d0dad764862d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.408778 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3094232349684556b7c1c091fe59af2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.409783 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3094232349684556b7c1c091fe59af2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.409914 11758 tablet_service.cc:1468] Processing CreateTablet for tablet da88786d60c34c71b85abd0fca502b8d (DEFAULT_TABLE table=default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.410223 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da88786d60c34c71b85abd0fca502b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.414479 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4167bf88496040c69601a4c80246ce36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.414888 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4167bf88496040c69601a4c80246ce36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.423408 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d5229b608b084c4d9198fccd25bed935 (table default.Table_c5c82cbb5bd4477fb342ccc243e798a9 [id=8d5c6093ab50409e9367b95e9cad2f7a]) successfully deleted
I20250625 14:01:53.424888 12172 tablet_bootstrap.cc:492] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.425004 12172 ts_tablet_manager.cc:1397] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.087s user 0.002s sys 0.000s
I20250625 14:01:53.425453 12172 raft_consensus.cc:357] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.425559 12172 raft_consensus.cc:383] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.425580 12172 raft_consensus.cc:738] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.425701 12172 consensus_queue.cc:260] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.425993 12172 ts_tablet_manager.cc:1428] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.426190 12172 tablet_bootstrap.cc:492] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.427465 12172 tablet_bootstrap.cc:654] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:53.430814 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f306b943fbf4ccebc4e1c89934c7d88 consensus state has no leader
I20250625 14:01:53.407720 11898 tablet_service.cc:1468] Processing CreateTablet for tablet da88786d60c34c71b85abd0fca502b8d (DEFAULT_TABLE table=default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.412628 12265 raft_consensus.cc:491] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.433079 12265 raft_consensus.cc:513] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.433279 12175 raft_consensus.cc:2241] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.433377 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da88786d60c34c71b85abd0fca502b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.433423 12175 raft_consensus.cc:2270] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.433506 12265 leader_election.cc:290] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:53.413239 12166 tablet_bootstrap.cc:492] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.433663 12166 ts_tablet_manager.cc:1397] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.002s
I20250625 14:01:53.433892 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e6599cf920c4c8b8ed17ecad1a31338" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.434029 12054 raft_consensus.cc:2466] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:53.434152 12166 raft_consensus.cc:357] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.434216 12167 tablet_bootstrap.cc:492] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.434254 12166 raft_consensus.cc:383] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.434327 12167 ts_tablet_manager.cc:1397] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.103s user 0.001s sys 0.000s
I20250625 14:01:53.434361 12172 tablet_bootstrap.cc:492] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.434444 12172 ts_tablet_manager.cc:1397] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:53.434293 12166 raft_consensus.cc:738] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.434388 11855 leader_election.cc:304] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.434851 12166 consensus_queue.cc:260] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.434862 12167 raft_consensus.cc:357] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.434947 12265 raft_consensus.cc:2802] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.434913 12172 raft_consensus.cc:357] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.434978 12167 raft_consensus.cc:383] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.434988 12265 raft_consensus.cc:491] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.435002 12172 raft_consensus.cc:383] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.435014 12167 raft_consensus.cc:738] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.435025 12265 raft_consensus.cc:3058] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.435039 12172 raft_consensus.cc:738] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.435142 12167 consensus_queue.cc:260] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.435181 12166 ts_tablet_manager.cc:1428] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.435145 12172 consensus_queue.cc:260] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.435367 12166 tablet_bootstrap.cc:492] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.435401 12167 ts_tablet_manager.cc:1428] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.435410 12172 ts_tablet_manager.cc:1428] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.435583 12172 tablet_bootstrap.cc:492] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.435583 12167 tablet_bootstrap.cc:492] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.436007 12265 raft_consensus.cc:513] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.436353 12166 tablet_bootstrap.cc:654] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.436419 12265 leader_election.cc:290] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:53.436566 12172 tablet_bootstrap.cc:654] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.436566 12167 tablet_bootstrap.cc:654] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.437358 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e6599cf920c4c8b8ed17ecad1a31338" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.437482 11784 raft_consensus.cc:2466] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:53.439658 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_006ddbff8b0c4a23b5692e4712f0f230" } new_table_name: "default.Table_1992a377fa074076a3e2b67ad1cb336d" modify_external_catalogs: true
I20250625 14:01:53.440169 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet b9af043f465d41cd9dd63607eb4e8230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.440495 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e6599cf920c4c8b8ed17ecad1a31338" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.440541 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a064bc3c05154988ba0d4f0db51024eb" } new_table_name: "default.Table_78f8eff133eb479ab5b94eef76b4992e" modify_external_catalogs: true
I20250625 14:01:53.440603 12054 raft_consensus.cc:3058] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.441716 12054 raft_consensus.cc:2466] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.443212 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0e6599cf920c4c8b8ed17ecad1a31338" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.443354 11784 raft_consensus.cc:3058] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.444324 11784 raft_consensus.cc:2466] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.444622 11783 raft_consensus.cc:1273] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.445084 11855 leader_election.cc:304] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.445251 12170 raft_consensus.cc:491] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.445343 12170 raft_consensus.cc:513] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.445379 12054 raft_consensus.cc:1273] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.445712 12170 leader_election.cc:290] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.445827 12170 raft_consensus.cc:2802] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.445888 12170 raft_consensus.cc:695] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:53.445854 12327 consensus_queue.cc:1035] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.445951 12259 consensus_queue.cc:1035] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.446013 12170 consensus_queue.cc:237] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.446246 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "082a46d213c545b18acbcac1b699d140" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:53.446926 11855 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.448217 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "082a46d213c545b18acbcac1b699d140" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.448246 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8029b9c972e547b0aa052cd38040c777" } modify_external_catalogs: true
I20250625 14:01:53.448370 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8029b9c972e547b0aa052cd38040c777" } modify_external_catalogs: true
I20250625 14:01:53.449136 12175 ts_tablet_manager.cc:1905] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:53.451020 11858 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.451100 11858 leader_election.cc:304] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.451692 12327 raft_consensus.cc:2747] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.452312 12239 tablet.cc:1722] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.454089 12233 tablet.cc:1722] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.457158 11760 tablet_service.cc:1468] Processing CreateTablet for tablet f6b666bfd4f141db89a35fa818edb378 (DEFAULT_TABLE table=default.Table_8029b9c972e547b0aa052cd38040c777 [id=8e84fd2f33444bdf85d58b0721a0080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.457465 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b666bfd4f141db89a35fa818edb378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.458464 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_75ec00556aa0458f86b7c08e673576c4" } new_table_name: "default.Table_49966ab9cf1c45feb28e95ae79153e6e" modify_external_catalogs: true
I20250625 14:01:53.458446 12205 raft_consensus.cc:491] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.458738 12205 raft_consensus.cc:513] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.459101 12205 leader_election.cc:290] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.459336 12166 tablet_bootstrap.cc:492] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.459420 12166 ts_tablet_manager.cc:1397] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.001s
I20250625 14:01:53.459851 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_843d36b395ad4352a622e69d12b0da1c" } modify_external_catalogs: true
I20250625 14:01:53.459869 12166 raft_consensus.cc:357] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.459952 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_843d36b395ad4352a622e69d12b0da1c" } modify_external_catalogs: true
I20250625 14:01:53.459975 12166 raft_consensus.cc:383] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.460004 12166 raft_consensus.cc:738] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.460119 12166 consensus_queue.cc:260] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.460367 12166 ts_tablet_manager.cc:1428] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.460518 12166 tablet_bootstrap.cc:492] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.461467 12166 tablet_bootstrap.cc:654] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.462177 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "910f1645f58b4066ae5c7c61e966e64c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.462327 11920 raft_consensus.cc:2466] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.462443 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "910f1645f58b4066ae5c7c61e966e64c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.462570 12056 raft_consensus.cc:2466] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.462857 11717 leader_election.cc:304] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.463030 12205 raft_consensus.cc:2802] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.463075 12205 raft_consensus.cc:491] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.463110 12205 raft_consensus.cc:3058] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.463120 11761 tablet_service.cc:1468] Processing CreateTablet for tablet bb24e0ce060c486bae8135e46827d956 (DEFAULT_TABLE table=default.Table_581755885025457ea3fe5fc8c847b994 [id=518547b2a04a411da963ce5d4cb09184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.463375 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb24e0ce060c486bae8135e46827d956. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.464041 12205 raft_consensus.cc:513] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.464407 12205 leader_election.cc:290] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.464964 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "910f1645f58b4066ae5c7c61e966e64c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.465075 11920 raft_consensus.cc:3058] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.466125 11920 raft_consensus.cc:2466] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.466377 12172 tablet_bootstrap.cc:492] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.466482 12172 ts_tablet_manager.cc:1397] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:01:53.466929 12172 raft_consensus.cc:357] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.467032 12172 raft_consensus.cc:383] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.467063 12172 raft_consensus.cc:738] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.467072 11717 leader_election.cc:304] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.467202 12172 consensus_queue.cc:260] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.467480 12172 ts_tablet_manager.cc:1428] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.467602 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "910f1645f58b4066ae5c7c61e966e64c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.467664 12172 tablet_bootstrap.cc:492] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.467721 12056 raft_consensus.cc:3058] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.467998 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 (DEFAULT_TABLE table=default.Table_c2f06be7a54e4be7b2ce6205ac8002dc [id=4473873b77254ad28c73714b5f6e84d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.468218 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0221dbcbca5f44df8612fc5d1714b9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.468703 12172 tablet_bootstrap.cc:654] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.468740 12056 raft_consensus.cc:2466] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.467214 12205 raft_consensus.cc:2802] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.469456 12205 raft_consensus.cc:695] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.469587 12205 consensus_queue.cc:237] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.470180 11759 tablet_service.cc:1468] Processing CreateTablet for tablet d69d6037befe407fb135b49a041c690a (DEFAULT_TABLE table=default.Table_a13429dfda614c5c98a33e244bef1ba3 [id=a8a101206e2e4a35a3123e6f8a2074ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.470439 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69d6037befe407fb135b49a041c690a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.472689 12345 tablet.cc:1722] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.473071 12166 tablet_bootstrap.cc:492] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.473178 12166 ts_tablet_manager.cc:1397] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250625 14:01:53.473579 12172 tablet_bootstrap.cc:492] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.473656 12172 ts_tablet_manager.cc:1397] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:53.473732 12166 raft_consensus.cc:357] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.473837 12166 raft_consensus.cc:383] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.473875 12166 raft_consensus.cc:738] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.473999 12166 consensus_queue.cc:260] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.474081 12172 raft_consensus.cc:357] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.474186 12172 raft_consensus.cc:383] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.474218 12172 raft_consensus.cc:738] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.474344 12166 ts_tablet_manager.cc:1428] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:53.474534 12166 tablet_bootstrap.cc:492] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.474654 12172 consensus_queue.cc:260] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.474936 12172 ts_tablet_manager.cc:1428] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.475116 12172 tablet_bootstrap.cc:492] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.475062 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 53bea49e49d64c7a82c96535db09c87d (DEFAULT_TABLE table=default.Table_fa9aec9800fe444086b8c3bbc7cf3523 [id=4bdc41d7138c4a099d95a82864c85d8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.475335 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bea49e49d64c7a82c96535db09c87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.475442 12035 tablet_service.cc:1468] Processing CreateTablet for tablet d69d6037befe407fb135b49a041c690a (DEFAULT_TABLE table=default.Table_a13429dfda614c5c98a33e244bef1ba3 [id=a8a101206e2e4a35a3123e6f8a2074ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.475600 12166 tablet_bootstrap.cc:654] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.475647 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69d6037befe407fb135b49a041c690a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.476220 12172 tablet_bootstrap.cc:654] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.476725 12166 tablet_bootstrap.cc:492] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.476799 12166 ts_tablet_manager.cc:1397] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:53.477241 12166 raft_consensus.cc:357] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.477347 12166 raft_consensus.cc:383] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.477380 12166 raft_consensus.cc:738] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.477483 12166 consensus_queue.cc:260] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.477716 12166 ts_tablet_manager.cc:1428] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.477861 12166 tablet_bootstrap.cc:492] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.478507 11899 tablet_service.cc:1468] Processing CreateTablet for tablet d69d6037befe407fb135b49a041c690a (DEFAULT_TABLE table=default.Table_a13429dfda614c5c98a33e244bef1ba3 [id=a8a101206e2e4a35a3123e6f8a2074ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.478567 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 53bea49e49d64c7a82c96535db09c87d (DEFAULT_TABLE table=default.Table_fa9aec9800fe444086b8c3bbc7cf3523 [id=4bdc41d7138c4a099d95a82864c85d8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.478647 12035 tablet_service.cc:1468] Processing CreateTablet for tablet f6b666bfd4f141db89a35fa818edb378 (DEFAULT_TABLE table=default.Table_8029b9c972e547b0aa052cd38040c777 [id=8e84fd2f33444bdf85d58b0721a0080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.478749 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69d6037befe407fb135b49a041c690a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.478808 12166 tablet_bootstrap.cc:654] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.478837 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b666bfd4f141db89a35fa818edb378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.479364 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bea49e49d64c7a82c96535db09c87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.481783 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 (DEFAULT_TABLE table=default.Table_c2f06be7a54e4be7b2ce6205ac8002dc [id=4473873b77254ad28c73714b5f6e84d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.481889 11899 tablet_service.cc:1468] Processing CreateTablet for tablet f6b666bfd4f141db89a35fa818edb378 (DEFAULT_TABLE table=default.Table_8029b9c972e547b0aa052cd38040c777 [id=8e84fd2f33444bdf85d58b0721a0080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.482023 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0221dbcbca5f44df8612fc5d1714b9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.482144 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b666bfd4f141db89a35fa818edb378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.483966 12166 tablet_bootstrap.cc:492] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.484056 12166 ts_tablet_manager.cc:1397] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20250625 14:01:53.484273 11897 tablet_service.cc:1468] Processing CreateTablet for tablet bb24e0ce060c486bae8135e46827d956 (DEFAULT_TABLE table=default.Table_581755885025457ea3fe5fc8c847b994 [id=518547b2a04a411da963ce5d4cb09184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.484515 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb24e0ce060c486bae8135e46827d956. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.484755 12166 raft_consensus.cc:357] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.484855 12166 raft_consensus.cc:383] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.484884 12166 raft_consensus.cc:738] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.484994 12166 consensus_queue.cc:260] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.485250 12166 ts_tablet_manager.cc:1428] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.485430 12166 tablet_bootstrap.cc:492] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.486492 12166 tablet_bootstrap.cc:654] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.487619 12037 tablet_service.cc:1468] Processing CreateTablet for tablet bb24e0ce060c486bae8135e46827d956 (DEFAULT_TABLE table=default.Table_581755885025457ea3fe5fc8c847b994 [id=518547b2a04a411da963ce5d4cb09184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.487965 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb24e0ce060c486bae8135e46827d956. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.488111 12172 tablet_bootstrap.cc:492] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.488230 12172 ts_tablet_manager.cc:1397] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:01:53.488720 12172 raft_consensus.cc:357] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.488840 12172 raft_consensus.cc:383] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.488874 12172 raft_consensus.cc:738] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.489017 12172 consensus_queue.cc:260] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.489743 12172 ts_tablet_manager.cc:1428] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.489941 12172 tablet_bootstrap.cc:492] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.491094 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 53bea49e49d64c7a82c96535db09c87d (DEFAULT_TABLE table=default.Table_fa9aec9800fe444086b8c3bbc7cf3523 [id=4bdc41d7138c4a099d95a82864c85d8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.491341 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bea49e49d64c7a82c96535db09c87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.491360 12172 tablet_bootstrap.cc:654] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.492493 12172 tablet_bootstrap.cc:492] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.492589 12172 ts_tablet_manager.cc:1397] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:53.493124 12172 raft_consensus.cc:357] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.493258 12172 raft_consensus.cc:383] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.493302 12172 raft_consensus.cc:738] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.493435 12172 consensus_queue.cc:260] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.493939 12172 ts_tablet_manager.cc:1428] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.493975 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8362aee5a9b14f48828ee6d0a7a1ee03" } new_table_name: "default.Table_894409fe03824115b5539eec26f4d271" modify_external_catalogs: true
I20250625 14:01:53.494117 12172 tablet_bootstrap.cc:492] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.495168 12172 tablet_bootstrap.cc:654] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.495396 12180 raft_consensus.cc:491] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.495465 12180 raft_consensus.cc:513] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.495779 12180 leader_election.cc:290] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.496609 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f306b943fbf4ccebc4e1c89934c7d88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.496889 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f306b943fbf4ccebc4e1c89934c7d88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:01:53.497020 11717 leader_election.cc:343] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.497035 11920 raft_consensus.cc:2466] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.497609 11717 leader_election.cc:304] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.497771 12180 raft_consensus.cc:2802] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.497849 12180 raft_consensus.cc:491] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.497905 12180 raft_consensus.cc:3058] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.499034 12180 raft_consensus.cc:513] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.499397 12180 leader_election.cc:290] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:53.499962 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f306b943fbf4ccebc4e1c89934c7d88 consensus state has no leader
W20250625 14:01:53.500231 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4dfe24e8280c4675a5a6af9d32fa526e has no consensus state
I20250625 14:01:53.500636 12170 raft_consensus.cc:491] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.500738 12170 raft_consensus.cc:513] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.501157 12170 leader_election.cc:290] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.501457 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce48b28d6634330bcfa6e28d9f0c49d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:53.501839 11855 leader_election.cc:343] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.501947 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce48b28d6634330bcfa6e28d9f0c49d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.502094 11784 raft_consensus.cc:2466] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:53.502422 11858 leader_election.cc:304] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.502650 12170 raft_consensus.cc:2802] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.502713 12170 raft_consensus.cc:491] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.502763 12170 raft_consensus.cc:3058] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.503854 12170 raft_consensus.cc:513] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.504271 12170 leader_election.cc:290] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.504561 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce48b28d6634330bcfa6e28d9f0c49d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.504901 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce48b28d6634330bcfa6e28d9f0c49d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
W20250625 14:01:53.504928 11855 leader_election.cc:343] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.505021 11784 raft_consensus.cc:3058] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.506038 11784 raft_consensus.cc:2466] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.506477 11858 leader_election.cc:304] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.506911 12170 raft_consensus.cc:2802] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.507006 12170 raft_consensus.cc:695] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:53.507149 12170 consensus_queue.cc:237] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:53.508086 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80f4e61e39894e88b3497328da8f7d01 consensus state has no leader
I20250625 14:01:53.508193 12172 tablet_bootstrap.cc:492] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.508296 12172 ts_tablet_manager.cc:1397] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:01:53.508358 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f6b666bfd4f141db89a35fa818edb378
I20250625 14:01:53.508795 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0396f83e03b649d5a146ae13be8666d7
I20250625 14:01:53.508796 12172 raft_consensus.cc:357] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.508909 12172 raft_consensus.cc:383] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.508944 12172 raft_consensus.cc:738] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.509069 12172 consensus_queue.cc:260] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.509373 12172 ts_tablet_manager.cc:1428] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.509536 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f306b943fbf4ccebc4e1c89934c7d88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.509581 12172 tablet_bootstrap.cc:492] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.509644 11920 raft_consensus.cc:3058] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.510706 11920 raft_consensus.cc:2466] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.510746 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9f306b943fbf4ccebc4e1c89934c7d88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:53.511641 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 910f1645f58b4066ae5c7c61e966e64c consensus state has no leader
I20250625 14:01:53.511763 12172 tablet_bootstrap.cc:654] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:53.511883 11717 leader_election.cc:343] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.512028 11717 leader_election.cc:304] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.512203 12180 raft_consensus.cc:2802] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.512301 12180 raft_consensus.cc:695] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.512437 12180 consensus_queue.cc:237] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.513283 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 0396f83e03b649d5a146ae13be8666d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.513458 12177 tablet_replica.cc:331] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.513592 12177 raft_consensus.cc:2241] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.513691 12177 raft_consensus.cc:2270] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.514029 12177 ts_tablet_manager.cc:1905] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.516388 12177 ts_tablet_manager.cc:1918] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.516459 12177 log.cc:1199] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0396f83e03b649d5a146ae13be8666d7
I20250625 14:01:53.516672 12177 ts_tablet_manager.cc:1939] T 0396f83e03b649d5a146ae13be8666d7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.516992 11524 catalog_manager.cc:5582] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:53.517211 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0e6599cf920c4c8b8ed17ecad1a31338 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:01:53.518590 11526 catalog_manager.cc:5582] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:53.519217 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet f6b666bfd4f141db89a35fa818edb378 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.519598 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 0396f83e03b649d5a146ae13be8666d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.520236 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 165cc62292fc418890f253d87da10f51 (DEFAULT_TABLE table=default.Table_4167bf88496040c69601a4c80246ce36 [id=831b6f15f6e043fbb8a2d03425758576]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.520524 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165cc62292fc418890f253d87da10f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.521132 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 0396f83e03b649d5a146ae13be8666d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.521853 12173 tablet_replica.cc:331] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.521970 12173 raft_consensus.cc:2241] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.522116 12173 pending_rounds.cc:70] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:01:53.522140 12173 pending_rounds.cc:77] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523023865262080 op_type: NO_OP noop_request { }
I20250625 14:01:53.522202 12173 raft_consensus.cc:2887] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:53.522248 12173 raft_consensus.cc:2270] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.523022 12173 ts_tablet_manager.cc:1905] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.523145 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0396f83e03b649d5a146ae13be8666d7 (table default.Table_843d36b395ad4352a622e69d12b0da1c [id=324214b8959145bfb8cd6917f4892c0a]) successfully deleted
I20250625 14:01:53.523566 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 165cc62292fc418890f253d87da10f51 (DEFAULT_TABLE table=default.Table_4167bf88496040c69601a4c80246ce36 [id=831b6f15f6e043fbb8a2d03425758576]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.523752 11763 tablet_service.cc:1468] Processing CreateTablet for tablet c5e5954a01aa472999e9ac079f706f4b (DEFAULT_TABLE table=default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.523834 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165cc62292fc418890f253d87da10f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.523964 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e5954a01aa472999e9ac079f706f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.524456 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 165cc62292fc418890f253d87da10f51 (DEFAULT_TABLE table=default.Table_4167bf88496040c69601a4c80246ce36 [id=831b6f15f6e043fbb8a2d03425758576]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.524719 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 165cc62292fc418890f253d87da10f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.526484 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 169c59b473bd425296fa5bd9bbf2b616 (DEFAULT_TABLE table=default.Table_3094232349684556b7c1c091fe59af2b [id=f8e4990b036541f1b033de99bff1accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.526731 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169c59b473bd425296fa5bd9bbf2b616. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.527371 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e (DEFAULT_TABLE table=default.Table_78f8eff133eb479ab5b94eef76b4992e [id=73fae6a7414940f7ac920b6623c21704]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.527592 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfe24e8280c4675a5a6af9d32fa526e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.528117 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 64b3b045e4f3424f86f473c2ad351b9c (DEFAULT_TABLE table=default.Table_466564dce5b24b5bbfc5d0dad764862d [id=93046a99ed124c649143efbfceeda5ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.528330 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b3b045e4f3424f86f473c2ad351b9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:53.528625 12298 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:01:53.528944 12298 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:01:53.529037 12298 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250625 14:01:53.530009 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f6b666bfd4f141db89a35fa818edb378 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.532425 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 169c59b473bd425296fa5bd9bbf2b616 (DEFAULT_TABLE table=default.Table_3094232349684556b7c1c091fe59af2b [id=f8e4990b036541f1b033de99bff1accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.532727 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169c59b473bd425296fa5bd9bbf2b616. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.533514 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 169c59b473bd425296fa5bd9bbf2b616 (DEFAULT_TABLE table=default.Table_3094232349684556b7c1c091fe59af2b [id=f8e4990b036541f1b033de99bff1accc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.533767 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169c59b473bd425296fa5bd9bbf2b616. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:53.533825 12298 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250625 14:01:53.533875 12298 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:01:53.533902 12298 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250625 14:01:53.533927 12298 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250625 14:01:53.534806 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 4 got 0
I20250625 14:01:53.535038 11524 catalog_manager.cc:5582] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:53.535725 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e (DEFAULT_TABLE table=default.Table_78f8eff133eb479ab5b94eef76b4992e [id=73fae6a7414940f7ac920b6623c21704]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.536134 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfe24e8280c4675a5a6af9d32fa526e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.536198 12172 tablet_bootstrap.cc:492] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.536315 12172 ts_tablet_manager.cc:1397] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:01:53.536865 12172 raft_consensus.cc:357] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.536991 12172 raft_consensus.cc:383] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.537031 12172 raft_consensus.cc:738] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.537153 12172 consensus_queue.cc:260] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.537444 12172 ts_tablet_manager.cc:1428] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.537649 12172 tablet_bootstrap.cc:492] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.538942 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e (DEFAULT_TABLE table=default.Table_78f8eff133eb479ab5b94eef76b4992e [id=73fae6a7414940f7ac920b6623c21704]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.539311 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfe24e8280c4675a5a6af9d32fa526e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.540313 12172 tablet_bootstrap.cc:654] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.540452 12173 ts_tablet_manager.cc:1918] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.540570 12173 log.cc:1199] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0396f83e03b649d5a146ae13be8666d7
I20250625 14:01:53.540874 12173 ts_tablet_manager.cc:1939] T 0396f83e03b649d5a146ae13be8666d7 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.541843 12298 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.188:43359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.39.188
--webserver_port=37561
--never_fsync=true
--heap_profile_path=/tmp/kudu.12298
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:01:53.542902 12172 tablet_bootstrap.cc:492] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.542996 12172 ts_tablet_manager.cc:1397] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:53.543315 12298 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:01:53.543462 12172 raft_consensus.cc:357] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.543555 12172 raft_consensus.cc:383] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.543583 12172 raft_consensus.cc:738] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.543704 12172 consensus_queue.cc:260] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.543974 12172 ts_tablet_manager.cc:1428] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.544142 12172 tablet_bootstrap.cc:492] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.544235 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 64b3b045e4f3424f86f473c2ad351b9c (DEFAULT_TABLE table=default.Table_466564dce5b24b5bbfc5d0dad764862d [id=93046a99ed124c649143efbfceeda5ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.544498 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b3b045e4f3424f86f473c2ad351b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.544786 12298 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250625 14:01:53.545099 12172 tablet_bootstrap.cc:654] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.547804 12172 tablet_bootstrap.cc:492] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.547924 12172 ts_tablet_manager.cc:1397] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:53.548476 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 (DEFAULT_TABLE table=default.Table_c2f06be7a54e4be7b2ce6205ac8002dc [id=4473873b77254ad28c73714b5f6e84d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.548537 12172 raft_consensus.cc:357] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.548650 12172 raft_consensus.cc:383] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.548683 12172 raft_consensus.cc:738] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.548789 12172 consensus_queue.cc:260] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.549059 12172 ts_tablet_manager.cc:1428] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.549274 12172 tablet_bootstrap.cc:492] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.549013 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0221dbcbca5f44df8612fc5d1714b9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.550442 12172 tablet_bootstrap.cc:654] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.551606 12172 tablet_bootstrap.cc:492] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.551695 12172 ts_tablet_manager.cc:1397] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:01:53.552143 12172 raft_consensus.cc:357] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.552266 12172 raft_consensus.cc:383] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.552306 12172 raft_consensus.cc:738] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.552438 12172 consensus_queue.cc:260] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.552708 12172 ts_tablet_manager.cc:1428] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.552872 12172 tablet_bootstrap.cc:492] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.553166 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3] alter complete (version 1)
I20250625 14:01:53.554240 12172 tablet_bootstrap.cc:654] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.554736 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_78f8eff133eb479ab5b94eef76b4992e" } modify_external_catalogs: true
I20250625 14:01:53.554860 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_78f8eff133eb479ab5b94eef76b4992e" } modify_external_catalogs: true
I20250625 14:01:53.554883 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a13429dfda614c5c98a33e244bef1ba3" } modify_external_catalogs: true
I20250625 14:01:53.554944 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a13429dfda614c5c98a33e244bef1ba3" } modify_external_catalogs: true
I20250625 14:01:53.555691 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad" } modify_external_catalogs: true
I20250625 14:01:53.555790 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad" } modify_external_catalogs: true
I20250625 14:01:53.558019 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 44e926ec00614c31b2112c28ec546706 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.558454 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0396f83e03b649d5a146ae13be8666d7 (table default.Table_843d36b395ad4352a622e69d12b0da1c [id=324214b8959145bfb8cd6917f4892c0a]) successfully deleted
W20250625 14:01:53.558912 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f6b666bfd4f141db89a35fa818edb378 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6b666bfd4f141db89a35fa818edb378 already in progress: creating tablet
I20250625 14:01:53.559536 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 33c895ed888b4cb8836f6a415d170c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.560286 12175 ts_tablet_manager.cc:1918] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.560362 12175 log.cc:1199] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c36e99b2e83141ff9923478ca7a13a2c
I20250625 14:01:53.560585 12175 ts_tablet_manager.cc:1939] T c36e99b2e83141ff9923478ca7a13a2c P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.560717 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 20fb7745d76c431f822258879e7d7134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.561493 11784 raft_consensus.cc:1273] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.561609 11528 catalog_manager.cc:5582] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:53.561755 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet f6b666bfd4f141db89a35fa818edb378 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.561829 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 9f306b943fbf4ccebc4e1c89934c7d88 (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]). Expected version 2 got 0
I20250625 14:01:53.561965 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 1 got 0
I20250625 14:01:53.562057 12327 consensus_queue.cc:1035] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.562075 11528 catalog_manager.cc:5582] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:53.562167 11897 tablet_service.cc:1468] Processing CreateTablet for tablet c5e5954a01aa472999e9ac079f706f4b (DEFAULT_TABLE table=default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.562235 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_894409fe03824115b5539eec26f4d271 [id=d1a9808588a74a90be4afc3e4205373e]). Expected version 2 got 0
I20250625 14:01:53.562414 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 4 got 0
I20250625 14:01:53.562448 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e5954a01aa472999e9ac079f706f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.562925 12054 raft_consensus.cc:1273] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.563256 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet bb24e0ce060c486bae8135e46827d956 from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:53.563246 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f6b666bfd4f141db89a35fa818edb378 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6b666bfd4f141db89a35fa818edb378 already in progress: creating tablet
I20250625 14:01:53.563328 12327 consensus_queue.cc:1035] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.564442 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d69d6037befe407fb135b49a041c690a
I20250625 14:01:53.565227 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet d69d6037befe407fb135b49a041c690a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.565300 12175 tablet_replica.cc:331] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.565445 12175 raft_consensus.cc:2241] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.565538 12175 raft_consensus.cc:2270] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:53.565833 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d69d6037befe407fb135b49a041c690a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d69d6037befe407fb135b49a041c690a already in progress: creating tablet
I20250625 14:01:53.565883 12238 raft_consensus.cc:491] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.566016 12175 ts_tablet_manager.cc:1905] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.565980 12238 raft_consensus.cc:513] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.566396 12238 leader_election.cc:290] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.566799 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c36e99b2e83141ff9923478ca7a13a2c (table default.Table_232d767d55f44fd694aa78ba3b83f1ac [id=4f84fd8318e04f02961fee283b12d934]) successfully deleted
W20250625 14:01:53.566957 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 470a4489d4284f909016c6c464a4ad12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 470a4489d4284f909016c6c464a4ad12 already in progress: creating tablet
I20250625 14:01:53.567106 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c36e99b2e83141ff9923478ca7a13a2c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:53.567394 11717 leader_election.cc:343] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: c36e99b2e83141ff9923478ca7a13a2c
W20250625 14:01:53.567544 11717 leader_election.cc:343] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.567618 11717 leader_election.cc:304] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:53.568636 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet d69d6037befe407fb135b49a041c690a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:53.569370 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d69d6037befe407fb135b49a041c690a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d69d6037befe407fb135b49a041c690a already in progress: creating tablet
I20250625 14:01:53.569514 12167 tablet_bootstrap.cc:492] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.569603 12167 ts_tablet_manager.cc:1397] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.134s user 0.000s sys 0.002s
I20250625 14:01:53.569873 12175 ts_tablet_manager.cc:1918] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.569941 12175 log.cc:1199] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/59c3dd659e8048edac846083a0ff03aa
I20250625 14:01:53.570150 12238 raft_consensus.cc:2747] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.570108 12167 raft_consensus.cc:357] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.570220 12167 raft_consensus.cc:383] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.570255 12167 raft_consensus.cc:738] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.570427 12167 consensus_queue.cc:260] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.570477 12037 tablet_service.cc:1468] Processing CreateTablet for tablet c5e5954a01aa472999e9ac079f706f4b (DEFAULT_TABLE table=default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.570708 12167 ts_tablet_manager.cc:1428] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.570760 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e5954a01aa472999e9ac079f706f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.570887 12167 tablet_bootstrap.cc:492] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.571367 12239 tablet.cc:1722] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:53.571818 12167 tablet_bootstrap.cc:654] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.573112 12175 ts_tablet_manager.cc:1939] T 59c3dd659e8048edac846083a0ff03aa P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:01:53.573520 12382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:53.573778 12175 tablet_replica.cc:331] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.573900 12175 raft_consensus.cc:2241] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.574002 12175 raft_consensus.cc:2270] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.574366 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 64b3b045e4f3424f86f473c2ad351b9c (DEFAULT_TABLE table=default.Table_466564dce5b24b5bbfc5d0dad764862d [id=93046a99ed124c649143efbfceeda5ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.574638 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b3b045e4f3424f86f473c2ad351b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.574949 12298 server_base.cc:1048] running on GCE node
W20250625 14:01:53.575439 12384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:53.575588 12172 tablet_bootstrap.cc:492] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.575683 12172 ts_tablet_manager.cc:1397] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20250625 14:01:53.576205 12172 raft_consensus.cc:357] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.576565 12172 raft_consensus.cc:383] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.576613 12172 raft_consensus.cc:738] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.576745 12172 consensus_queue.cc:260] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.576905 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 59c3dd659e8048edac846083a0ff03aa (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:53.577046 12172 ts_tablet_manager.cc:1428] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.577236 12172 tablet_bootstrap.cc:492] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.577296 12180 raft_consensus.cc:491] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.577379 12180 raft_consensus.cc:513] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.577705 12166 tablet_bootstrap.cc:492] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.577790 12166 ts_tablet_manager.cc:1397] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.092s user 0.001s sys 0.001s
I20250625 14:01:53.577796 12180 leader_election.cc:290] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:53.578279 12166 raft_consensus.cc:357] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.578410 12166 raft_consensus.cc:383] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.578444 12166 raft_consensus.cc:738] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.578439 12233 tablet.cc:1722] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:53.578553 12166 consensus_queue.cc:260] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.578656 12172 tablet_bootstrap.cc:654] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.578811 12166 ts_tablet_manager.cc:1428] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.579005 12166 tablet_bootstrap.cc:492] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.579964 12166 tablet_bootstrap.cc:654] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.579948 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "20fb7745d76c431f822258879e7d7134" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.580087 11920 raft_consensus.cc:2466] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.580317 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "20fb7745d76c431f822258879e7d7134" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:53.580662 11717 leader_election.cc:343] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.580796 11717 leader_election.cc:304] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.580952 12238 raft_consensus.cc:2802] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.581012 12238 raft_consensus.cc:491] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.581053 12238 raft_consensus.cc:3058] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.581657 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet d69d6037befe407fb135b49a041c690a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.581792 12178 raft_consensus.cc:491] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.581887 12178 raft_consensus.cc:513] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.582084 12238 raft_consensus.cc:513] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.582273 12178 leader_election.cc:290] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.582664 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "36da902c99bf4416aa0769438182e443" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.582705 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "36da902c99bf4416aa0769438182e443" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.582824 11920 raft_consensus.cc:2391] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:53.583118 11993 leader_election.cc:304] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:53.583272 12178 raft_consensus.cc:3058] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.583282 12175 ts_tablet_manager.cc:1905] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.583847 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0e6599cf920c4c8b8ed17ecad1a31338 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:01:53.584240 12178 raft_consensus.cc:2747] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.585265 12180 raft_consensus.cc:491] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.585364 12180 raft_consensus.cc:513] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.585651 12175 ts_tablet_manager.cc:1918] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.585747 12180 leader_election.cc:290] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.585901 12175 log.cc:1199] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b9af043f465d41cd9dd63607eb4e8230
I20250625 14:01:53.586051 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33c895ed888b4cb8836f6a415d170c3e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.586194 12175 ts_tablet_manager.cc:1939] T b9af043f465d41cd9dd63607eb4e8230 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.586194 12238 leader_election.cc:290] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:53.586932 12172 tablet_bootstrap.cc:492] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.587067 12172 ts_tablet_manager.cc:1397] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:53.587296 12175 tablet_replica.cc:331] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.587368 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 0996320cbc83480cbb4d53248efacffd from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.587604 12175 raft_consensus.cc:2241] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.587760 12175 raft_consensus.cc:2270] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.587842 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "20fb7745d76c431f822258879e7d7134" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.587972 11921 raft_consensus.cc:3058] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.588223 12175 ts_tablet_manager.cc:1905] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.588907 11921 raft_consensus.cc:2466] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
W20250625 14:01:53.589046 11717 leader_election.cc:343] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.589226 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "20fb7745d76c431f822258879e7d7134" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:53.589790 11717 leader_election.cc:343] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.589912 11717 leader_election.cc:304] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.589934 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33c895ed888b4cb8836f6a415d170c3e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.590045 11920 raft_consensus.cc:2466] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.589521 12172 raft_consensus.cc:357] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.590108 12172 raft_consensus.cc:383] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.590148 12172 raft_consensus.cc:738] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.590288 11717 leader_election.cc:304] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.590555 12172 consensus_queue.cc:260] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.590874 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 44e926ec00614c31b2112c28ec546706
I20250625 14:01:53.590939 12208 raft_consensus.cc:2802] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.590992 12172 ts_tablet_manager.cc:1428] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:53.591013 12208 raft_consensus.cc:695] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.591188 12172 tablet_bootstrap.cc:492] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.591151 12208 consensus_queue.cc:237] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.591372 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4dfe24e8280c4675a5a6af9d32fa526e
I20250625 14:01:53.591843 12208 raft_consensus.cc:2802] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.591893 12208 raft_consensus.cc:491] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.591933 12208 raft_consensus.cc:3058] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.592278 12172 tablet_bootstrap.cc:654] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.592883 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.592924 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 44e926ec00614c31b2112c28ec546706 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.592970 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.592998 12208 raft_consensus.cc:513] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.593091 12177 tablet_replica.cc:331] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.593215 12177 raft_consensus.cc:2241] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.593324 12208 leader_election.cc:290] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.593379 12177 raft_consensus.cc:2270] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:53.593377 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4dfe24e8280c4675a5a6af9d32fa526e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dfe24e8280c4675a5a6af9d32fa526e already in progress: creating tablet
I20250625 14:01:53.593900 12177 ts_tablet_manager.cc:1905] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.596249 12177 ts_tablet_manager.cc:1918] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.596333 12177 log.cc:1199] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/44e926ec00614c31b2112c28ec546706
I20250625 14:01:53.596606 12177 ts_tablet_manager.cc:1939] T 44e926ec00614c31b2112c28ec546706 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.596717 12172 tablet_bootstrap.cc:492] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.596833 12172 ts_tablet_manager.cc:1397] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:53.597324 12172 raft_consensus.cc:357] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.597483 12172 raft_consensus.cc:383] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.597572 12172 raft_consensus.cc:738] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.597761 12172 consensus_queue.cc:260] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.598526 12172 ts_tablet_manager.cc:1428] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:53.598748 12172 tablet_bootstrap.cc:492] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.599049 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 44e926ec00614c31b2112c28ec546706 from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:53.599171 12381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:53.599849 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet c36e99b2e83141ff9923478ca7a13a2c from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.600049 12298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:01:53.600783 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]) successfully deleted
I20250625 14:01:53.600906 12172 tablet_bootstrap.cc:654] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:53.600984 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4dfe24e8280c4675a5a6af9d32fa526e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dfe24e8280c4675a5a6af9d32fa526e already in progress: creating tablet
I20250625 14:01:53.601548 12298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250625 14:01:53.601631 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bb24e0ce060c486bae8135e46827d956
I20250625 14:01:53.601859 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 59c3dd659e8048edac846083a0ff03aa with delete_type TABLET_DATA_DELETED (replaced by tablet 66cab8705ca2439abfa683f8b8b6dc45) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.601903 11533 catalog_manager.cc:6652] ReplaceTablet: tablet bb24e0ce060c486bae8135e46827d956 deleted and replaced by tablet a8d6c5552b204ec1b2f5e4bf9eba5640
I20250625 14:01:53.601903 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 33c895ed888b4cb8836f6a415d170c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.602025 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 20fb7745d76c431f822258879e7d7134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.602116 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet f2748c24d9804c41b8d03156c1587e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.602386 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0996320cbc83480cbb4d53248efacffd
I20250625 14:01:53.602349 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 44e926ec00614c31b2112c28ec546706 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.602624 11531 catalog_manager.cc:6652] ReplaceTablet: tablet 0996320cbc83480cbb4d53248efacffd deleted and replaced by tablet 44d41513c1d444cba5288a05f2c4652c
I20250625 14:01:53.602701 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet c36e99b2e83141ff9923478ca7a13a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.602802 12173 tablet_replica.cc:331] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.602818 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet bb24e0ce060c486bae8135e46827d956 with delete_type TABLET_DATA_DELETED (replaced by tablet a8d6c5552b204ec1b2f5e4bf9eba5640) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.602943 12173 raft_consensus.cc:2241] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.603103 12173 raft_consensus.cc:2270] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.603154 12177 tablet_replica.cc:331] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.603227 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 0996320cbc83480cbb4d53248efacffd with delete_type TABLET_DATA_DELETED (replaced by tablet 44d41513c1d444cba5288a05f2c4652c) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.603282 12177 raft_consensus.cc:2241] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.603379 12177 raft_consensus.cc:2270] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.603811 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33c895ed888b4cb8836f6a415d170c3e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.604069 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 0996320cbc83480cbb4d53248efacffd with delete_type TABLET_DATA_DELETED (replaced by tablet 44d41513c1d444cba5288a05f2c4652c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.604681 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet bb24e0ce060c486bae8135e46827d956 with delete_type TABLET_DATA_DELETED (replaced by tablet a8d6c5552b204ec1b2f5e4bf9eba5640) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.604662 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "33c895ed888b4cb8836f6a415d170c3e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.604794 11920 raft_consensus.cc:3058] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:53.605094 11717 leader_election.cc:343] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.605182 12177 ts_tablet_manager.cc:1905] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.605229 12167 tablet_bootstrap.cc:492] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.605319 12167 ts_tablet_manager.cc:1397] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.000s
I20250625 14:01:53.605840 11920 raft_consensus.cc:2466] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.605985 12167 raft_consensus.cc:357] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.606101 12167 raft_consensus.cc:383] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.606135 12167 raft_consensus.cc:738] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.606210 11717 leader_election.cc:304] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.606415 12238 raft_consensus.cc:2802] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.606492 12238 raft_consensus.cc:695] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.606526 12167 consensus_queue.cc:260] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.606616 12238 consensus_queue.cc:237] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.606829 12167 ts_tablet_manager.cc:1428] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.607020 12167 tablet_bootstrap.cc:492] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.607276 12173 ts_tablet_manager.cc:1905] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.608856 12167 tablet_bootstrap.cc:654] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.608901 12177 ts_tablet_manager.cc:1918] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.608951 12177 log.cc:1199] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/59c3dd659e8048edac846083a0ff03aa
I20250625 14:01:53.609102 12177 ts_tablet_manager.cc:1939] T 59c3dd659e8048edac846083a0ff03aa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.609563 12173 ts_tablet_manager.cc:1918] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.609624 12173 log.cc:1199] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/44e926ec00614c31b2112c28ec546706
I20250625 14:01:53.609871 12173 ts_tablet_manager.cc:1939] T 44e926ec00614c31b2112c28ec546706 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.609959 12167 tablet_bootstrap.cc:492] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.610033 12167 ts_tablet_manager.cc:1397] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:53.610251 12177 tablet_replica.cc:331] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.610397 12177 raft_consensus.cc:2241] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.610392 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 59c3dd659e8048edac846083a0ff03aa (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:53.610532 12177 pending_rounds.cc:70] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:53.610563 12177 pending_rounds.cc:77] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523025334116352 op_type: NO_OP noop_request { }
I20250625 14:01:53.610517 12167 raft_consensus.cc:357] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.610605 12177 raft_consensus.cc:2887] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:53.610625 12167 raft_consensus.cc:383] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.610646 12177 raft_consensus.cc:2270] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.610663 12167 raft_consensus.cc:738] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.610795 12167 consensus_queue.cc:260] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.611250 12177 ts_tablet_manager.cc:1905] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.611757 12167 ts_tablet_manager.cc:1428] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:53.612212 12167 tablet_bootstrap.cc:492] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.613068 12177 ts_tablet_manager.cc:1918] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.613138 12177 log.cc:1199] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/33c895ed888b4cb8836f6a415d170c3e
I20250625 14:01:53.613191 12167 tablet_bootstrap.cc:654] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.613430 12177 ts_tablet_manager.cc:1939] T 33c895ed888b4cb8836f6a415d170c3e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.613727 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]) successfully deleted
W20250625 14:01:53.613940 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 0996320cbc83480cbb4d53248efacffd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0996320cbc83480cbb4d53248efacffd already in progress: creating tablet
W20250625 14:01:53.614094 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet bb24e0ce060c486bae8135e46827d956 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb24e0ce060c486bae8135e46827d956 already in progress: creating tablet
I20250625 14:01:53.614377 12177 tablet_replica.cc:331] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.614542 12177 raft_consensus.cc:2241] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.614732 12177 pending_rounds.cc:70] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:53.614810 12177 pending_rounds.cc:77] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523025270882304 op_type: NO_OP noop_request { }
I20250625 14:01:53.614883 12167 tablet_bootstrap.cc:492] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.614979 12167 ts_tablet_manager.cc:1397] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:53.614918 12177 raft_consensus.cc:2887] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:53.615154 12177 raft_consensus.cc:2270] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.615329 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 33c895ed888b4cb8836f6a415d170c3e (table default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]) successfully deleted
I20250625 14:01:53.615526 12167 raft_consensus.cc:357] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.615648 12167 raft_consensus.cc:383] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.615641 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 082a46d213c545b18acbcac1b699d140 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.615685 12167 raft_consensus.cc:738] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.615831 12167 consensus_queue.cc:260] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.616103 12167 ts_tablet_manager.cc:1428] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.616134 12177 ts_tablet_manager.cc:1905] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.616318 12167 tablet_bootstrap.cc:492] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.617388 12167 tablet_bootstrap.cc:654] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.617753 12298 hybrid_clock.cc:648] HybridClock initialized: now 1750860113614138 us; error 3616 us; skew 500 ppm
I20250625 14:01:53.619377 12177 ts_tablet_manager.cc:1918] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:53.619448 12177 log.cc:1199] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/20fb7745d76c431f822258879e7d7134
I20250625 14:01:53.619701 12177 ts_tablet_manager.cc:1939] T 20fb7745d76c431f822258879e7d7134 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.619666 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_15fa1e0db4314493a834a5c7ff218574"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.620132 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15fa1e0db4314493a834a5c7ff218574 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.620208 12166 tablet_bootstrap.cc:492] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.620304 12166 ts_tablet_manager.cc:1397] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20250625 14:01:53.620375 12259 raft_consensus.cc:491] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.620455 12259 raft_consensus.cc:513] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.620826 12259 leader_election.cc:290] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.620776 12166 raft_consensus.cc:357] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.620891 12166 raft_consensus.cc:383] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.620889 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b9af043f465d41cd9dd63607eb4e8230 (table default.Table_7841efec8726433bb8558a603229a0af [id=f9324275818c4e7a9b39e0d31e2dc12d]) successfully deleted
I20250625 14:01:53.620935 12166 raft_consensus.cc:738] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:53.621049 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f6b666bfd4f141db89a35fa818edb378 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6b666bfd4f141db89a35fa818edb378 already in progress: creating tablet
I20250625 14:01:53.621037 12166 consensus_queue.cc:260] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.621268 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 0996320cbc83480cbb4d53248efacffd with delete_type TABLET_DATA_DELETED (replaced by tablet 44d41513c1d444cba5288a05f2c4652c) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.621342 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet bb24e0ce060c486bae8135e46827d956 with delete_type TABLET_DATA_DELETED (replaced by tablet a8d6c5552b204ec1b2f5e4bf9eba5640) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.621572 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_72b1422109ae43efb9f92971971dd01d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.621948 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72b1422109ae43efb9f92971971dd01d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.621996 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d8e509824fc94993b1676f5b68515002" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.622437 12166 ts_tablet_manager.cc:1428] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:53.622648 12166 tablet_bootstrap.cc:492] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.622949 12345 tablet.cc:1722] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:53.623767 12175 ts_tablet_manager.cc:1918] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.623857 12175 log.cc:1199] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0396f83e03b649d5a146ae13be8666d7
I20250625 14:01:53.623894 12166 tablet_bootstrap.cc:654] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.624090 12175 ts_tablet_manager.cc:1939] T 0396f83e03b649d5a146ae13be8666d7 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.624329 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 44e926ec00614c31b2112c28ec546706 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.624464 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.624460 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d8e509824fc94993b1676f5b68515002" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.624612 11784 raft_consensus.cc:2466] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:53.625029 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_af6a813837c847fbb898ab6c697f455b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.625119 12177 tablet_replica.cc:331] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.625267 12177 raft_consensus.cc:2241] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.625391 12177 raft_consensus.cc:2270] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.625381 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_73d3dbf418e2463ba09893538dd70097"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.625473 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af6a813837c847fbb898ab6c697f455b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:53.625612 11855 leader_election.cc:343] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:53.625722 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73d3dbf418e2463ba09893538dd70097 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.626099 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 20fb7745d76c431f822258879e7d7134 (table default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]) successfully deleted
I20250625 14:01:53.626111 12177 ts_tablet_manager.cc:1905] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.626644 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7c6da9796d8348998cef7efc15459128"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.626753 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c562bfdf6c0f4af8bc8fed3557145b52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.627008 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c6da9796d8348998cef7efc15459128 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:53.627127 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c562bfdf6c0f4af8bc8fed3557145b52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.628115 12167 tablet_bootstrap.cc:492] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.628208 12167 ts_tablet_manager.cc:1397] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20250625 14:01:53.628737 12167 raft_consensus.cc:357] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.628860 12167 raft_consensus.cc:383] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.628895 12167 raft_consensus.cc:738] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.629009 12167 consensus_queue.cc:260] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.629058 12177 ts_tablet_manager.cc:1918] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.629137 12177 log.cc:1199] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f2748c24d9804c41b8d03156c1587e93
I20250625 14:01:53.629325 12167 ts_tablet_manager.cc:1428] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.629371 12177 ts_tablet_manager.cc:1939] T f2748c24d9804c41b8d03156c1587e93 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.629541 12167 tablet_bootstrap.cc:492] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.630508 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f2748c24d9804c41b8d03156c1587e93 (table default.Table_8d003fa42e2a4a85b64e842f0199c525 [id=4111545cc6b44021b0bd7881cfb57a7b]) successfully deleted
I20250625 14:01:53.630546 12177 tablet_replica.cc:331] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.630543 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0396f83e03b649d5a146ae13be8666d7 (table default.Table_843d36b395ad4352a622e69d12b0da1c [id=324214b8959145bfb8cd6917f4892c0a]) successfully deleted
I20250625 14:01:53.630581 11858 leader_election.cc:304] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.630692 12177 raft_consensus.cc:2241] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.630792 12177 raft_consensus.cc:2270] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.630831 12327 raft_consensus.cc:2802] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.630900 12327 raft_consensus.cc:491] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.630950 12327 raft_consensus.cc:3058] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.630982 12178 raft_consensus.cc:491] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.631057 12178 raft_consensus.cc:513] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.631160 12175 tablet_replica.cc:331] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.631294 12175 raft_consensus.cc:2241] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.631335 12166 tablet_bootstrap.cc:492] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.631386 12175 raft_consensus.cc:2270] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.631409 12166 ts_tablet_manager.cc:1397] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:53.631423 12178 leader_election.cc:290] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.631903 12166 raft_consensus.cc:357] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.632005 12166 raft_consensus.cc:383] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.632036 12166 raft_consensus.cc:738] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.632109 12327 raft_consensus.cc:513] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.632158 12166 consensus_queue.cc:260] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.632222 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_717daef53a3946009baaef6869682ce3" } new_table_name: "default.Table_3a6be9f022c240baa90d4b38e252c01a" modify_external_catalogs: true
I20250625 14:01:53.632463 12166 ts_tablet_manager.cc:1428] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.632490 12327 leader_election.cc:290] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.632656 12166 tablet_bootstrap.cc:492] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.633235 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d8e509824fc94993b1676f5b68515002" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:53.633750 11855 leader_election.cc:343] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.633893 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce48b28d6634330bcfa6e28d9f0c49d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.634115 12166 tablet_bootstrap.cc:654] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.634500 12167 tablet_bootstrap.cc:654] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.635327 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce48b28d6634330bcfa6e28d9f0c49d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.635496 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d8e509824fc94993b1676f5b68515002" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.635628 11783 raft_consensus.cc:3058] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.635735 12298 webserver.cc:469] Webserver started at http://127.11.39.188:37561/ using document root <none> and password file <none>
I20250625 14:01:53.636708 11783 raft_consensus.cc:2466] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.636713 12177 ts_tablet_manager.cc:1905] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.635517 11784 raft_consensus.cc:2391] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:53.637126 11858 leader_election.cc:304] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.637355 12327 raft_consensus.cc:2802] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.637441 12327 raft_consensus.cc:695] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:53.637565 12327 consensus_queue.cc:237] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.638592 11993 leader_election.cc:304] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:53.639185 12171 raft_consensus.cc:3058] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.639431 12175 ts_tablet_manager.cc:1905] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.639472 12177 ts_tablet_manager.cc:1918] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.639540 12177 log.cc:1199] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c36e99b2e83141ff9923478ca7a13a2c
I20250625 14:01:53.639757 12177 ts_tablet_manager.cc:1939] T c36e99b2e83141ff9923478ca7a13a2c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.640318 12171 raft_consensus.cc:2747] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.641781 12298 fs_manager.cc:362] Metadata directory not provided
I20250625 14:01:53.641902 12298 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:01:53.642549 12175 ts_tablet_manager.cc:1918] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.642618 12175 log.cc:1199] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/33c895ed888b4cb8836f6a415d170c3e
I20250625 14:01:53.642966 12175 ts_tablet_manager.cc:1939] T 33c895ed888b4cb8836f6a415d170c3e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.643155 12172 tablet_bootstrap.cc:492] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.643260 12172 ts_tablet_manager.cc:1397] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.000s
I20250625 14:01:53.643779 12172 raft_consensus.cc:357] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.643913 12172 raft_consensus.cc:383] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.643901 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 33c895ed888b4cb8836f6a415d170c3e (table default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]) successfully deleted
I20250625 14:01:53.643965 12172 raft_consensus.cc:738] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.644148 12172 consensus_queue.cc:260] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.644338 12175 tablet_replica.cc:331] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.644444 12172 ts_tablet_manager.cc:1428] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.644654 12172 tablet_bootstrap.cc:492] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.645437 12037 tablet_service.cc:1468] Processing CreateTablet for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (DEFAULT_TABLE table=default.Table_581755885025457ea3fe5fc8c847b994 [id=518547b2a04a411da963ce5d4cb09184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.645748 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d6c5552b204ec1b2f5e4bf9eba5640. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.645900 12175 raft_consensus.cc:2241] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.645948 12172 tablet_bootstrap.cc:654] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.646158 12175 raft_consensus.cc:2270] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.646773 12175 ts_tablet_manager.cc:1905] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.648224 11759 tablet_service.cc:1468] Processing CreateTablet for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (DEFAULT_TABLE table=default.Table_581755885025457ea3fe5fc8c847b994 [id=518547b2a04a411da963ce5d4cb09184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.648520 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d6c5552b204ec1b2f5e4bf9eba5640. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.648505 11898 tablet_service.cc:1468] Processing CreateTablet for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (DEFAULT_TABLE table=default.Table_581755885025457ea3fe5fc8c847b994 [id=518547b2a04a411da963ce5d4cb09184]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.648780 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d6c5552b204ec1b2f5e4bf9eba5640. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.650038 12175 ts_tablet_manager.cc:1918] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.650169 12175 log.cc:1199] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/20fb7745d76c431f822258879e7d7134
I20250625 14:01:53.650549 12175 ts_tablet_manager.cc:1939] T 20fb7745d76c431f822258879e7d7134 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.651309 12172 tablet_bootstrap.cc:492] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.651403 12172 ts_tablet_manager.cc:1397] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20250625 14:01:53.651769 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 20fb7745d76c431f822258879e7d7134 (table default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]) successfully deleted
I20250625 14:01:53.651929 12056 raft_consensus.cc:3058] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.651942 12172 raft_consensus.cc:357] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.652063 12172 raft_consensus.cc:383] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.652112 12172 raft_consensus.cc:738] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.652238 12172 consensus_queue.cc:260] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.652530 12172 ts_tablet_manager.cc:1428] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20250625 14:01:53.652560 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d69d6037befe407fb135b49a041c690a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d69d6037befe407fb135b49a041c690a already in progress: creating tablet
I20250625 14:01:53.652725 12172 tablet_bootstrap.cc:492] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.653026 12175 tablet_replica.cc:331] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.653048 12056 raft_consensus.cc:1273] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.653280 12175 raft_consensus.cc:2241] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.653468 12175 raft_consensus.cc:2270] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.653489 12177 tablet_replica.cc:331] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.653607 12177 raft_consensus.cc:2241] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.653739 12177 raft_consensus.cc:2270] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.653847 12172 tablet_bootstrap.cc:654] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.654176 12238 consensus_queue.cc:1035] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.654336 12177 ts_tablet_manager.cc:1905] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.654528 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c36e99b2e83141ff9923478ca7a13a2c (table default.Table_232d767d55f44fd694aa78ba3b83f1ac [id=4f84fd8318e04f02961fee283b12d934]) successfully deleted
W20250625 14:01:53.654709 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet bb24e0ce060c486bae8135e46827d956 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb24e0ce060c486bae8135e46827d956 already in progress: creating tablet
I20250625 14:01:53.654963 12166 tablet_bootstrap.cc:492] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.655061 12166 ts_tablet_manager.cc:1397] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:01:53.655517 11920 raft_consensus.cc:1273] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.657580 12167 tablet_bootstrap.cc:492] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.657689 12167 ts_tablet_manager.cc:1397] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20250625 14:01:53.657784 12177 ts_tablet_manager.cc:1918] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.655527 12166 raft_consensus.cc:357] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.658047 12166 raft_consensus.cc:383] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.658083 12166 raft_consensus.cc:738] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.658216 12166 consensus_queue.cc:260] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.658241 12167 raft_consensus.cc:357] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.658354 12167 raft_consensus.cc:383] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.658387 12167 raft_consensus.cc:738] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.658524 12167 consensus_queue.cc:260] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.658576 12166 ts_tablet_manager.cc:1428] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:53.658771 12166 tablet_bootstrap.cc:492] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.658789 12167 ts_tablet_manager.cc:1428] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.658952 12167 tablet_bootstrap.cc:492] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.660008 12166 tablet_bootstrap.cc:654] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.660012 12167 tablet_bootstrap.cc:654] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.656472 12175 ts_tablet_manager.cc:1905] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.663398 12166 tablet_bootstrap.cc:492] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.663533 12166 ts_tablet_manager.cc:1397] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:53.663887 12175 ts_tablet_manager.cc:1918] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.663954 12175 log.cc:1199] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0996320cbc83480cbb4d53248efacffd
I20250625 14:01:53.664180 12175 ts_tablet_manager.cc:1939] T 0996320cbc83480cbb4d53248efacffd P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.664139 12166 raft_consensus.cc:357] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.664237 12166 raft_consensus.cc:383] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.664273 12166 raft_consensus.cc:738] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.664242 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dbd3da73c8ac4e928ab517816c17a64a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.664369 12177 log.cc:1199] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0996320cbc83480cbb4d53248efacffd
I20250625 14:01:53.664415 12166 consensus_queue.cc:260] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.664590 12177 ts_tablet_manager.cc:1939] T 0996320cbc83480cbb4d53248efacffd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:53.664712 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbd3da73c8ac4e928ab517816c17a64a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.664777 12166 ts_tablet_manager.cc:1428] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.664980 12166 tablet_bootstrap.cc:492] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.665241 12177 tablet_replica.cc:331] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.665383 12177 raft_consensus.cc:2241] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.666630 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b77e6933073d4d4eb6a1a937e5d0347e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.667008 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b77e6933073d4d4eb6a1a937e5d0347e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.667191 12298 fs_manager.cc:714] Time spent opening directory manager: real 0.023s user 0.003s sys 0.000s
I20250625 14:01:53.667843 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0996320cbc83480cbb4d53248efacffd (table default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]) successfully deleted
I20250625 14:01:53.668040 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_abd5285550f6481d993b832b604973fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.668393 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abd5285550f6481d993b832b604973fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.668604 12166 tablet_bootstrap.cc:654] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.662360 12172 tablet_bootstrap.cc:492] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.669449 12172 ts_tablet_manager.cc:1397] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20250625 14:01:53.660359 12180 consensus_queue.cc:1035] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.670038 12172 raft_consensus.cc:357] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.670174 12172 raft_consensus.cc:383] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.670238 12172 raft_consensus.cc:738] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.670393 12172 consensus_queue.cc:260] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.670604 12167 tablet_bootstrap.cc:492] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.670701 12167 ts_tablet_manager.cc:1397] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:53.670709 12172 ts_tablet_manager.cc:1428] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.670919 12172 tablet_bootstrap.cc:492] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.670971 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ac9132782f574ad8a5d69192e7168e79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.671209 12167 raft_consensus.cc:357] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.671326 12167 raft_consensus.cc:383] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250625 14:01:53.671355 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac9132782f574ad8a5d69192e7168e79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.671372 12167 raft_consensus.cc:738] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.671515 12167 consensus_queue.cc:260] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.671835 12167 ts_tablet_manager.cc:1428] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.672031 12167 tablet_bootstrap.cc:492] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.672268 12172 tablet_bootstrap.cc:654] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.673110 12177 raft_consensus.cc:2270] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.672217 12233 tablet.cc:1722] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:53.674252 12177 ts_tablet_manager.cc:1905] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.674224 12345 tablet.cc:1722] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:53.675616 12175 tablet_replica.cc:331] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.675765 12175 raft_consensus.cc:2241] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.675801 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0996320cbc83480cbb4d53248efacffd (table default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]) successfully deleted
I20250625 14:01:53.675875 12175 raft_consensus.cc:2270] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:53.676040 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet bb24e0ce060c486bae8135e46827d956 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb24e0ce060c486bae8135e46827d956 already in progress: creating tablet
I20250625 14:01:53.676200 12167 tablet_bootstrap.cc:654] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.677778 12177 ts_tablet_manager.cc:1918] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.677929 12175 ts_tablet_manager.cc:1905] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.678112 12177 log.cc:1199] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/082a46d213c545b18acbcac1b699d140
I20250625 14:01:53.678434 12177 ts_tablet_manager.cc:1939] T 082a46d213c545b18acbcac1b699d140 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.679944 12056 raft_consensus.cc:1273] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.680272 12175 ts_tablet_manager.cc:1918] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.680372 12175 log.cc:1199] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/44e926ec00614c31b2112c28ec546706
I20250625 14:01:53.680718 12175 ts_tablet_manager.cc:1939] T 44e926ec00614c31b2112c28ec546706 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.680864 12172 tablet_bootstrap.cc:492] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.680965 12172 ts_tablet_manager.cc:1397] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:53.681421 12172 raft_consensus.cc:357] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.681562 12172 raft_consensus.cc:383] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.681605 12172 raft_consensus.cc:738] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.681638 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 44e926ec00614c31b2112c28ec546706 (table default.Table_2e5b7e92af3b4f7d9eb9c439669f46ad [id=998d811ce0b248cabdf95ddf2f1d5f1d]) successfully deleted
I20250625 14:01:53.681747 12172 consensus_queue.cc:260] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:53.681955 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb7bbd1c627f4da6b2e1812eed472c83 consensus state has no leader
I20250625 14:01:53.682058 12172 ts_tablet_manager.cc:1428] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.682261 12172 tablet_bootstrap.cc:492] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.682384 12205 consensus_queue.cc:1035] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:53.682523 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 4dfe24e8280c4675a5a6af9d32fa526e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dfe24e8280c4675a5a6af9d32fa526e already in progress: creating tablet
I20250625 14:01:53.682245 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d] alter complete (version 3)
I20250625 14:01:53.683128 11921 raft_consensus.cc:1273] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.683415 12172 tablet_bootstrap.cc:654] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.684191 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 44d41513c1d444cba5288a05f2c4652c (DEFAULT_TABLE table=default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.684459 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d41513c1d444cba5288a05f2c4652c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.685101 12180 consensus_queue.cc:1035] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.686590 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 44d41513c1d444cba5288a05f2c4652c (DEFAULT_TABLE table=default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.686872 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d41513c1d444cba5288a05f2c4652c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.687883 12172 tablet_bootstrap.cc:492] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.688068 12172 ts_tablet_manager.cc:1397] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20250625 14:01:53.689127 12345 tablet.cc:1722] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:53.688752 12172 raft_consensus.cc:357] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.689292 12172 raft_consensus.cc:383] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.689337 12172 raft_consensus.cc:738] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.689456 12172 consensus_queue.cc:260] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.689692 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 082a46d213c545b18acbcac1b699d140 (table default.Table_6c2e6fedb8a74a829bc14d61bf626ed8 [id=68e1633962a6404c94ddcdde634c23e0]) successfully deleted
I20250625 14:01:53.690212 12172 ts_tablet_manager.cc:1428] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:53.690433 12172 tablet_bootstrap.cc:492] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.690614 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 44d41513c1d444cba5288a05f2c4652c (DEFAULT_TABLE table=default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.690899 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d41513c1d444cba5288a05f2c4652c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.691679 12172 tablet_bootstrap.cc:654] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.691740 12167 tablet_bootstrap.cc:492] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.691826 12167 ts_tablet_manager.cc:1397] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20250625 14:01:53.692341 12167 raft_consensus.cc:357] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.692427 12167 raft_consensus.cc:383] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.692448 12167 raft_consensus.cc:738] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.692559 12167 consensus_queue.cc:260] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.693094 12167 ts_tablet_manager.cc:1428] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.693531 12167 tablet_bootstrap.cc:492] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.696146 12171 raft_consensus.cc:491] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.696250 12171 raft_consensus.cc:513] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.696640 12171 leader_election.cc:290] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.697057 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09a197bdabd24d7c96febe1fd5352a14" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.697154 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09a197bdabd24d7c96febe1fd5352a14" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.697201 11922 raft_consensus.cc:2466] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:53.697233 12167 tablet_bootstrap.cc:654] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.697292 11784 raft_consensus.cc:2466] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:53.697602 11993 leader_election.cc:304] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:01:53.697754 12171 raft_consensus.cc:2802] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.697803 12171 raft_consensus.cc:491] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.697840 12171 raft_consensus.cc:3058] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.698772 12171 raft_consensus.cc:513] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.698833 12416 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:53.699112 12171 leader_election.cc:290] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.699956 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09a197bdabd24d7c96febe1fd5352a14" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.699980 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "09a197bdabd24d7c96febe1fd5352a14" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.700078 11784 raft_consensus.cc:3058] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.700110 11922 raft_consensus.cc:3058] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.700506 12298 fs_manager.cc:730] Time spent opening block manager: real 0.032s user 0.002s sys 0.000s
I20250625 14:01:53.701045 11784 raft_consensus.cc:2466] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:53.700625 12298 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:53.701112 11922 raft_consensus.cc:2466] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:53.701187 12298 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:01:53.701458 11990 leader_election.cc:304] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.701620 12171 raft_consensus.cc:2802] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.701686 12171 raft_consensus.cc:695] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:53.701819 12171 consensus_queue.cc:237] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.701965 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 20fb7745d76c431f822258879e7d7134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.702256 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 0996320cbc83480cbb4d53248efacffd with delete_type TABLET_DATA_DELETED (replaced by tablet 44d41513c1d444cba5288a05f2c4652c) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.702994 12233 tablet.cc:1722] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250625 14:01:53.703603 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 20fb7745d76c431f822258879e7d7134 because the tablet was not found. No further retry: Not found: Tablet not found: 20fb7745d76c431f822258879e7d7134
I20250625 14:01:53.703963 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_72b1422109ae43efb9f92971971dd01d" } new_table_name: "default.Table_8387efde7ac24eddb291cf6f17ec0041" modify_external_catalogs: true
W20250625 14:01:53.704154 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 0996320cbc83480cbb4d53248efacffd because the tablet was not found. No further retry: Not found: Tablet not found: 0996320cbc83480cbb4d53248efacffd
I20250625 14:01:53.705063 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e53d81926e0e417ba5d76a39c20f93f7" } new_table_name: "default.Table_18fd74110fdc485d839fae5cc2b22cfd" modify_external_catalogs: true
I20250625 14:01:53.714182 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_af6a813837c847fbb898ab6c697f455b" } new_table_name: "default.Table_090b46fb5d524097805d01616f53df78" modify_external_catalogs: true
I20250625 14:01:53.714237 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_581755885025457ea3fe5fc8c847b994" } new_table_name: "default.Table_55bf09a13eda41eeacbb9ef4a8473575" modify_external_catalogs: true
I20250625 14:01:53.714855 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_15fa1e0db4314493a834a5c7ff218574" } modify_external_catalogs: true
I20250625 14:01:53.714963 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_15fa1e0db4314493a834a5c7ff218574" } modify_external_catalogs: true
I20250625 14:01:53.714995 12166 tablet_bootstrap.cc:492] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.715096 12166 ts_tablet_manager.cc:1397] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.000s
I20250625 14:01:53.715629 12166 raft_consensus.cc:357] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.715744 12166 raft_consensus.cc:383] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.715778 12166 raft_consensus.cc:738] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.715898 12166 consensus_queue.cc:260] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.716212 12166 ts_tablet_manager.cc:1428] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.716435 12166 tablet_bootstrap.cc:492] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.717088 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c2f06be7a54e4be7b2ce6205ac8002dc" } modify_external_catalogs: true
I20250625 14:01:53.717182 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c2f06be7a54e4be7b2ce6205ac8002dc" } modify_external_catalogs: true
I20250625 14:01:53.717738 12166 tablet_bootstrap.cc:654] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.718973 12166 tablet_bootstrap.cc:492] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.719058 12166 ts_tablet_manager.cc:1397] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:53.719187 12167 tablet_bootstrap.cc:492] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.719316 12167 ts_tablet_manager.cc:1397] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20250625 14:01:53.719549 12166 raft_consensus.cc:357] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.719650 12166 raft_consensus.cc:383] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.719684 12166 raft_consensus.cc:738] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.719833 12166 consensus_queue.cc:260] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.720120 12166 ts_tablet_manager.cc:1428] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.720139 12167 raft_consensus.cc:357] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.720280 12167 raft_consensus.cc:383] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.720316 12166 tablet_bootstrap.cc:492] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.720322 12167 raft_consensus.cc:738] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.720463 12056 raft_consensus.cc:1273] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.720470 12167 consensus_queue.cc:260] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:53.720818 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4a281b2956124ce4b9fd12560bf3d5c1 has no consensus state
I20250625 14:01:53.721912 12167 ts_tablet_manager.cc:1428] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:53.722147 12166 tablet_bootstrap.cc:654] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.722270 12239 tablet.cc:1722] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:53.722400 12167 tablet_bootstrap.cc:492] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.722473 11922 raft_consensus.cc:1273] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:53.722708 12208 consensus_queue.cc:1035] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.723311 12166 tablet_bootstrap.cc:492] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.723392 12166 ts_tablet_manager.cc:1397] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:53.723754 12167 tablet_bootstrap.cc:654] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.723850 12166 raft_consensus.cc:357] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.723968 12166 raft_consensus.cc:383] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.724002 12166 raft_consensus.cc:738] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.724126 12166 consensus_queue.cc:260] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.724418 12166 ts_tablet_manager.cc:1428] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.724598 12166 tablet_bootstrap.cc:492] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.724982 12205 consensus_queue.cc:1035] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:53.725615 12166 tablet_bootstrap.cc:654] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.727200 12207 mvcc.cc:204] Tried to move back new op lower bound from 7171523025790746624 to 7171523024503894016. Current Snapshot: MvccSnapshot[applied={T|T < 7171523025790746624}]
W20250625 14:01:53.728031 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9cf278e5ff7f4e0c9b9b25610a76c74d has no consensus state
I20250625 14:01:53.728322 12345 tablet.cc:1722] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.729626 12166 tablet_bootstrap.cc:492] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.729849 12166 ts_tablet_manager.cc:1397] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:53.730966 12166 raft_consensus.cc:357] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.731101 12233 tablet.cc:1722] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.731302 12166 raft_consensus.cc:383] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.731354 12166 raft_consensus.cc:738] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.731526 12166 consensus_queue.cc:260] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.732095 12172 tablet_bootstrap.cc:492] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.732194 12172 ts_tablet_manager.cc:1397] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.000s
I20250625 14:01:53.732692 12172 raft_consensus.cc:357] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.732793 12172 raft_consensus.cc:383] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.732825 12172 raft_consensus.cc:738] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.732949 12172 consensus_queue.cc:260] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.733279 12172 ts_tablet_manager.cc:1428] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.733486 12172 tablet_bootstrap.cc:492] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.734098 12166 ts_tablet_manager.cc:1428] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:53.734628 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 6d1c412286d94eedac62cf4f1f939f68 (DEFAULT_TABLE table=default.Table_c562bfdf6c0f4af8bc8fed3557145b52 [id=5e5bed4c27814fc7b14d0c4d9e091890]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.734891 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1c412286d94eedac62cf4f1f939f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.734923 12172 tablet_bootstrap.cc:654] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.734915 12166 tablet_bootstrap.cc:492] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.736316 12166 tablet_bootstrap.cc:654] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.737046 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 6d1c412286d94eedac62cf4f1f939f68 (DEFAULT_TABLE table=default.Table_c562bfdf6c0f4af8bc8fed3557145b52 [id=5e5bed4c27814fc7b14d0c4d9e091890]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.737318 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1c412286d94eedac62cf4f1f939f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.737454 12166 tablet_bootstrap.cc:492] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.737504 12172 tablet_bootstrap.cc:492] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.737529 12166 ts_tablet_manager.cc:1397] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:53.737618 12172 ts_tablet_manager.cc:1397] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:53.737977 12166 raft_consensus.cc:357] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.738082 12166 raft_consensus.cc:383] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.738114 12166 raft_consensus.cc:738] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.738124 12172 raft_consensus.cc:357] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.738229 12172 raft_consensus.cc:383] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.738278 12172 raft_consensus.cc:738] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.738240 12166 consensus_queue.cc:260] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.738459 12172 consensus_queue.cc:260] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.738581 12166 ts_tablet_manager.cc:1428] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.738749 12172 ts_tablet_manager.cc:1428] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.738782 12166 tablet_bootstrap.cc:492] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.738940 12172 tablet_bootstrap.cc:492] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.739323 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 4031eab780324944bc63fc77848fb209 (DEFAULT_TABLE table=default.Table_73d3dbf418e2463ba09893538dd70097 [id=3ef8fa0543a14c90b4c42e770323f83f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.739538 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 4a281b2956124ce4b9fd12560bf3d5c1 (DEFAULT_TABLE table=default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.739605 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4031eab780324944bc63fc77848fb209. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.739758 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a281b2956124ce4b9fd12560bf3d5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.739952 12172 tablet_bootstrap.cc:654] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.739972 12166 tablet_bootstrap.cc:654] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.740721 11897 tablet_service.cc:1468] Processing CreateTablet for tablet b7eee5c995064aacb406daddb888edb6 (DEFAULT_TABLE table=default.Table_7c6da9796d8348998cef7efc15459128 [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.740947 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7eee5c995064aacb406daddb888edb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.741617 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d (DEFAULT_TABLE table=default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.741832 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.742125 12238 raft_consensus.cc:491] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.742204 12238 raft_consensus.cc:513] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.742617 12238 leader_election.cc:290] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.743229 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "80f4e61e39894e88b3497328da8f7d01" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.743434 12238 raft_consensus.cc:491] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.743510 12238 raft_consensus.cc:513] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.743654 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d (DEFAULT_TABLE table=default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.743817 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 (DEFAULT_TABLE table=default.Table_15fa1e0db4314493a834a5c7ff218574 [id=bf0cf9729bbd45619fd4c852f572bc60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.743898 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.744081 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b83658ba82e498fbd48134a6a6867b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.744216 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 6d1c412286d94eedac62cf4f1f939f68 (DEFAULT_TABLE table=default.Table_c562bfdf6c0f4af8bc8fed3557145b52 [id=5e5bed4c27814fc7b14d0c4d9e091890]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.744280 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 4031eab780324944bc63fc77848fb209 (DEFAULT_TABLE table=default.Table_73d3dbf418e2463ba09893538dd70097 [id=3ef8fa0543a14c90b4c42e770323f83f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.744421 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1c412286d94eedac62cf4f1f939f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.744645 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4031eab780324944bc63fc77848fb209. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.744928 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 (DEFAULT_TABLE table=default.Table_15fa1e0db4314493a834a5c7ff218574 [id=bf0cf9729bbd45619fd4c852f572bc60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.745165 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b83658ba82e498fbd48134a6a6867b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.746206 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 (DEFAULT_TABLE table=default.Table_15fa1e0db4314493a834a5c7ff218574 [id=bf0cf9729bbd45619fd4c852f572bc60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.746245 11761 tablet_service.cc:1468] Processing CreateTablet for tablet b7eee5c995064aacb406daddb888edb6 (DEFAULT_TABLE table=default.Table_7c6da9796d8348998cef7efc15459128 [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.746474 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7eee5c995064aacb406daddb888edb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.746474 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b83658ba82e498fbd48134a6a6867b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.748584 12035 tablet_service.cc:1468] Processing CreateTablet for tablet b7eee5c995064aacb406daddb888edb6 (DEFAULT_TABLE table=default.Table_7c6da9796d8348998cef7efc15459128 [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.748701 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 4a281b2956124ce4b9fd12560bf3d5c1 (DEFAULT_TABLE table=default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.748842 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7eee5c995064aacb406daddb888edb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.749130 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a281b2956124ce4b9fd12560bf3d5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.751011 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 4a281b2956124ce4b9fd12560bf3d5c1 (DEFAULT_TABLE table=default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.751035 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "80f4e61e39894e88b3497328da8f7d01" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.751173 11922 raft_consensus.cc:2466] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.751302 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a281b2956124ce4b9fd12560bf3d5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.753682 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 4031eab780324944bc63fc77848fb209 (DEFAULT_TABLE table=default.Table_73d3dbf418e2463ba09893538dd70097 [id=3ef8fa0543a14c90b4c42e770323f83f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.754022 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4031eab780324944bc63fc77848fb209. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.743865 12238 leader_election.cc:290] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.748585 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d (DEFAULT_TABLE table=default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.756702 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:53.758184 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8d6c5552b204ec1b2f5e4bf9eba5640 consensus state has no leader
I20250625 14:01:53.758268 11717 leader_election.cc:304] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:53.758487 11717 leader_election.cc:343] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.758705 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff54429a3d3e40688aaea56b70dcdfae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.758829 12238 raft_consensus.cc:2802] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.758879 12238 raft_consensus.cc:491] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.758921 12238 raft_consensus.cc:3058] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.758960 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff54429a3d3e40688aaea56b70dcdfae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.759124 11922 raft_consensus.cc:2466] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.759958 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_894409fe03824115b5539eec26f4d271 [id=d1a9808588a74a90be4afc3e4205373e]). Expected version 2 got 0
I20250625 14:01:53.760030 12238 raft_consensus.cc:513] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.760123 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 80f4e61e39894e88b3497328da8f7d01 (table default.Table_49966ab9cf1c45feb28e95ae79153e6e [id=0071abfe5ba94050bfc65317fae65385]). Expected version 1 got 0
I20250625 14:01:53.760388 12238 leader_election.cc:290] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.760490 12172 tablet_bootstrap.cc:492] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.760596 12172 ts_tablet_manager.cc:1397] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20250625 14:01:53.761358 12172 raft_consensus.cc:357] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.761459 12172 raft_consensus.cc:383] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.761490 12172 raft_consensus.cc:738] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.761595 12172 consensus_queue.cc:260] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.761893 12172 ts_tablet_manager.cc:1428] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250625 14:01:53.762107 12172 tablet_bootstrap.cc:492] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:53.762184 11717 leader_election.cc:343] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.762504 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "80f4e61e39894e88b3497328da8f7d01" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.763139 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "80f4e61e39894e88b3497328da8f7d01" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.763298 11922 raft_consensus.cc:3058] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:53.764106 11717 leader_election.cc:343] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.764201 11717 leader_election.cc:304] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.764345 12238 raft_consensus.cc:2802] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.764372 12172 tablet_bootstrap.cc:654] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.764397 12238 raft_consensus.cc:491] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.764436 12238 raft_consensus.cc:3058] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.764636 11922 raft_consensus.cc:2466] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.765425 12238 raft_consensus.cc:513] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.766472 12166 tablet_bootstrap.cc:492] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.766813 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 91fe26db32a44fb08efa3809f0fddfae (DEFAULT_TABLE table=default.Table_abd5285550f6481d993b832b604973fa [id=9aceda4c69be483c9c6efff41eb01322]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.766916 11895 tablet_service.cc:1468] Processing CreateTablet for tablet d2afe02902a54045be3b435ed7585b08 (DEFAULT_TABLE table=default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.767112 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fe26db32a44fb08efa3809f0fddfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.767187 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2afe02902a54045be3b435ed7585b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.767714 12239 tablet.cc:1722] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:53.767773 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_894409fe03824115b5539eec26f4d271" } modify_external_catalogs: true
I20250625 14:01:53.767915 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_894409fe03824115b5539eec26f4d271" } modify_external_catalogs: true
I20250625 14:01:53.768265 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 (DEFAULT_TABLE table=default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.769088 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff54429a3d3e40688aaea56b70dcdfae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.769222 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4d01792d40471ab6d5bafa1a308351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.769615 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 (DEFAULT_TABLE table=default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.769865 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4d01792d40471ab6d5bafa1a308351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.769981 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 91fe26db32a44fb08efa3809f0fddfae (DEFAULT_TABLE table=default.Table_abd5285550f6481d993b832b604973fa [id=9aceda4c69be483c9c6efff41eb01322]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.771577 12036 tablet_service.cc:1468] Processing CreateTablet for tablet a22eff28938b419f97ad971c486944ff (DEFAULT_TABLE table=default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.771857 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22eff28938b419f97ad971c486944ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.771921 12033 tablet_service.cc:1468] Processing CreateTablet for tablet d2afe02902a54045be3b435ed7585b08 (DEFAULT_TABLE table=default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.772114 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2afe02902a54045be3b435ed7585b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.772562 12238 leader_election.cc:290] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.773417 12298 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 14:01:53.774178 12298 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:01:53.774226 12166 ts_tablet_manager.cc:1397] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20250625 14:01:53.774847 12166 raft_consensus.cc:357] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.775004 12166 raft_consensus.cc:383] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.775040 12166 raft_consensus.cc:738] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.775310 12167 tablet_bootstrap.cc:492] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.775352 12166 consensus_queue.cc:260] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.775403 12167 ts_tablet_manager.cc:1397] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20250625 14:01:53.775710 12166 ts_tablet_manager.cc:1428] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.775897 12298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:01:53.774847 11896 tablet_service.cc:1468] Processing CreateTablet for tablet a22eff28938b419f97ad971c486944ff (DEFAULT_TABLE table=default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.775954 12167 raft_consensus.cc:357] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.776053 12167 raft_consensus.cc:383] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.776086 12167 raft_consensus.cc:738] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.776207 12167 consensus_queue.cc:260] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.776496 12167 ts_tablet_manager.cc:1428] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.776575 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fe26db32a44fb08efa3809f0fddfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.776716 12167 tablet_bootstrap.cc:492] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.777798 12167 tablet_bootstrap.cc:654] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.780956 12238 raft_consensus.cc:491] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.781174 12238 raft_consensus.cc:513] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:53.781883 11717 leader_election.cc:343] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.782047 11717 leader_election.cc:304] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.782361 12205 raft_consensus.cc:2802] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.782325 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff54429a3d3e40688aaea56b70dcdfae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.782449 12205 raft_consensus.cc:695] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.782459 11920 raft_consensus.cc:3058] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.782461 12238 leader_election.cc:290] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.782585 12205 consensus_queue.cc:237] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.783638 11920 raft_consensus.cc:2466] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.784247 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 (DEFAULT_TABLE table=default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.784399 11758 tablet_service.cc:1468] Processing CreateTablet for tablet a22eff28938b419f97ad971c486944ff (DEFAULT_TABLE table=default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.784595 11762 tablet_service.cc:1468] Processing CreateTablet for tablet d2afe02902a54045be3b435ed7585b08 (DEFAULT_TABLE table=default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.784785 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22eff28938b419f97ad971c486944ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.784840 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 91fe26db32a44fb08efa3809f0fddfae (DEFAULT_TABLE table=default.Table_abd5285550f6481d993b832b604973fa [id=9aceda4c69be483c9c6efff41eb01322]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.784914 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb7bbd1c627f4da6b2e1812eed472c83" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.785355 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4d01792d40471ab6d5bafa1a308351. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.787371 12166 tablet_bootstrap.cc:492] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.787940 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9b83658ba82e498fbd48134a6a6867b3
I20250625 14:01:53.788748 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.789254 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb7bbd1c627f4da6b2e1812eed472c83" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.789482 11920 raft_consensus.cc:2466] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:53.789650 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9b83658ba82e498fbd48134a6a6867b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b83658ba82e498fbd48134a6a6867b3 already in progress: creating tablet
I20250625 14:01:53.789692 12166 tablet_bootstrap.cc:654] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.790577 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 910f1645f58b4066ae5c7c61e966e64c
I20250625 14:01:53.791064 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fe26db32a44fb08efa3809f0fddfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.791083 12166 tablet_bootstrap.cc:492] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.791165 12166 ts_tablet_manager.cc:1397] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:53.791709 12166 raft_consensus.cc:357] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.791813 12166 raft_consensus.cc:383] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.791851 12166 raft_consensus.cc:738] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.791965 12166 consensus_queue.cc:260] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.792164 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 910f1645f58b4066ae5c7c61e966e64c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.792282 12166 ts_tablet_manager.cc:1428] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.792727 12173 tablet_replica.cc:331] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.792863 12173 raft_consensus.cc:2241] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.792995 12173 raft_consensus.cc:2270] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.793524 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 910f1645f58b4066ae5c7c61e966e64c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.793560 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2afe02902a54045be3b435ed7585b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.793764 12175 tablet_replica.cc:331] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.793889 12175 raft_consensus.cc:2241] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.794047 12175 raft_consensus.cc:2270] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.794458 11526 catalog_manager.cc:5582] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:53.794737 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_3a6be9f022c240baa90d4b38e252c01a [id=9bd1814bba0a43fa8a66a50e91ef165f]). Expected version 1 got 0
I20250625 14:01:53.794808 12175 ts_tablet_manager.cc:1905] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.794975 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 9f306b943fbf4ccebc4e1c89934c7d88 (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]). Expected version 2 got 0
I20250625 14:01:53.797009 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.799162 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581" } modify_external_catalogs: true
I20250625 14:01:53.799327 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581" } modify_external_catalogs: true
I20250625 14:01:53.799665 12173 ts_tablet_manager.cc:1905] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.800227 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22eff28938b419f97ad971c486944ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.800525 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d9bfb4dd53e542688a7732a9c4850e38" } modify_external_catalogs: true
I20250625 14:01:53.800642 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d9bfb4dd53e542688a7732a9c4850e38" } modify_external_catalogs: true
I20250625 14:01:53.801815 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0221dbcbca5f44df8612fc5d1714b9a3
I20250625 14:01:53.802079 12173 ts_tablet_manager.cc:1918] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.802157 12173 log.cc:1199] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/910f1645f58b4066ae5c7c61e966e64c
I20250625 14:01:53.802407 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 9f306b943fbf4ccebc4e1c89934c7d88 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.802996 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 1 got 0
I20250625 14:01:53.803355 12166 tablet_bootstrap.cc:492] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.803850 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c] alter complete (version 2)
I20250625 14:01:53.804615 12166 tablet_bootstrap.cc:654] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.806110 12175 ts_tablet_manager.cc:1918] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.806188 12175 log.cc:1199] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/910f1645f58b4066ae5c7c61e966e64c
I20250625 14:01:53.806488 12175 ts_tablet_manager.cc:1939] T 910f1645f58b4066ae5c7c61e966e64c P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.806915 12173 ts_tablet_manager.cc:1939] T 910f1645f58b4066ae5c7c61e966e64c P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.808508 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_894409fe03824115b5539eec26f4d271 [id=d1a9808588a74a90be4afc3e4205373e]) successfully deleted
I20250625 14:01:53.809567 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet d5229b608b084c4d9198fccd25bed935 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.809742 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.809777 12173 tablet_replica.cc:331] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.809914 12173 raft_consensus.cc:2241] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.809970 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet b9af043f465d41cd9dd63607eb4e8230 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.810019 12173 raft_consensus.cc:2270] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.810659 12167 tablet_bootstrap.cc:492] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.810693 12173 ts_tablet_manager.cc:1905] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.810760 12167 ts_tablet_manager.cc:1397] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.002s
I20250625 14:01:53.810791 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_894409fe03824115b5539eec26f4d271 [id=d1a9808588a74a90be4afc3e4205373e]) successfully deleted
W20250625 14:01:53.810966 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9b83658ba82e498fbd48134a6a6867b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b83658ba82e498fbd48134a6a6867b3 already in progress: creating tablet
I20250625 14:01:53.811296 12167 raft_consensus.cc:357] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.811403 12167 raft_consensus.cc:383] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.811434 12167 raft_consensus.cc:738] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.811549 12167 consensus_queue.cc:260] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.813210 12173 ts_tablet_manager.cc:1918] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.813333 12167 ts_tablet_manager.cc:1428] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250625 14:01:53.813346 12173 log.cc:1199] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d5229b608b084c4d9198fccd25bed935
I20250625 14:01:53.813714 12173 ts_tablet_manager.cc:1939] T d5229b608b084c4d9198fccd25bed935 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.814116 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet c36e99b2e83141ff9923478ca7a13a2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.814489 12173 tablet_replica.cc:331] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.814682 12173 raft_consensus.cc:2241] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.814684 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d5229b608b084c4d9198fccd25bed935 (table default.Table_c5c82cbb5bd4477fb342ccc243e798a9 [id=8d5c6093ab50409e9367b95e9cad2f7a]) successfully deleted
I20250625 14:01:53.814878 12173 raft_consensus.cc:2270] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:53.814890 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 0221dbcbca5f44df8612fc5d1714b9a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0221dbcbca5f44df8612fc5d1714b9a3 already in progress: creating tablet
I20250625 14:01:53.814895 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 470a4489d4284f909016c6c464a4ad12 with delete_type TABLET_DATA_DELETED (replaced by tablet da88786d60c34c71b85abd0fca502b8d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.815114 12175 tablet_replica.cc:331] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.815263 12175 raft_consensus.cc:2241] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.815366 12175 raft_consensus.cc:2270] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.815496 12173 ts_tablet_manager.cc:1905] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.815807 12167 tablet_bootstrap.cc:492] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.815888 12175 ts_tablet_manager.cc:1905] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.817013 12167 tablet_bootstrap.cc:654] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.818114 12173 ts_tablet_manager.cc:1918] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.818257 12173 log.cc:1199] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b9af043f465d41cd9dd63607eb4e8230
I20250625 14:01:53.818536 12173 ts_tablet_manager.cc:1939] T b9af043f465d41cd9dd63607eb4e8230 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.819222 12175 ts_tablet_manager.cc:1918] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.819429 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b9af043f465d41cd9dd63607eb4e8230 (table default.Table_7841efec8726433bb8558a603229a0af [id=f9324275818c4e7a9b39e0d31e2dc12d]) successfully deleted
I20250625 14:01:53.819664 12175 log.cc:1199] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/470a4489d4284f909016c6c464a4ad12
I20250625 14:01:53.819707 12173 tablet_replica.cc:331] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.819876 12173 raft_consensus.cc:2241] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.819983 12175 ts_tablet_manager.cc:1939] T 470a4489d4284f909016c6c464a4ad12 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.820056 12173 raft_consensus.cc:2270] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.820994 12166 tablet_bootstrap.cc:492] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.821132 12166 ts_tablet_manager.cc:1397] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:01:53.821671 12298 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.188:43359
I20250625 14:01:53.821671 12493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.188:43359 every 8 connection(s)
I20250625 14:01:53.821730 12166 raft_consensus.cc:357] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.821857 12166 raft_consensus.cc:383] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.821892 12166 raft_consensus.cc:738] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.821949 12173 ts_tablet_manager.cc:1905] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.822048 12166 consensus_queue.cc:260] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.822407 12166 ts_tablet_manager.cc:1428] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.822587 12166 tablet_bootstrap.cc:492] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.823808 12166 tablet_bootstrap.cc:654] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.823908 12298 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
I20250625 14:01:53.824381 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 000aa8550a8b4f96922312e84c518978 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.824417 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 12298
I20250625 14:01:53.824415 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet c5e5954a01aa472999e9ac079f706f4b from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.824864 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet f2748c24d9804c41b8d03156c1587e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.825073 12166 tablet_bootstrap.cc:492] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.825162 12166 ts_tablet_manager.cc:1397] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:53.825485 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet d9546e85eaa44e5f8150b46f556782bd from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.825632 12166 raft_consensus.cc:357] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.825700 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 8a4d01792d40471ab6d5bafa1a308351 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:53.825739 12166 raft_consensus.cc:383] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.825083 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.825771 12166 raft_consensus.cc:738] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.825888 12166 consensus_queue.cc:260] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.826181 12166 ts_tablet_manager.cc:1428] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.826407 12166 tablet_bootstrap.cc:492] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.827656 12166 tablet_bootstrap.cc:654] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.828272 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.828718 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 910f1645f58b4066ae5c7c61e966e64c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.828874 12177 tablet_replica.cc:331] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.828852 12430 tablet.cc:1722] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:53.829010 12177 raft_consensus.cc:2241] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.829049 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 470a4489d4284f909016c6c464a4ad12 (table default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]) successfully deleted
I20250625 14:01:53.829221 12177 raft_consensus.cc:2270] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:53.829255 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 0221dbcbca5f44df8612fc5d1714b9a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0221dbcbca5f44df8612fc5d1714b9a3 already in progress: creating tablet
I20250625 14:01:53.829504 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.829978 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 470a4489d4284f909016c6c464a4ad12 with delete_type TABLET_DATA_DELETED (replaced by tablet da88786d60c34c71b85abd0fca502b8d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.830060 12177 ts_tablet_manager.cc:1905] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.830045 11525 catalog_manager.cc:5582] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:53.830302 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 1 got 0
I20250625 14:01:53.830502 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 4 got 0
W20250625 14:01:53.831120 11717 leader_election.cc:343] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.831264 11717 leader_election.cc:304] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.831475 11717 leader_election.cc:304] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.832788 12177 ts_tablet_manager.cc:1918] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.832957 12205 raft_consensus.cc:2802] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.833051 12205 raft_consensus.cc:695] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.833127 12238 raft_consensus.cc:2802] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.833184 12205 consensus_queue.cc:237] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:53.833355 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9b83658ba82e498fbd48134a6a6867b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b83658ba82e498fbd48134a6a6867b3 already in progress: creating tablet
W20250625 14:01:53.833534 11520 catalog_manager.cc:5007] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): alter failed for tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_894409fe03824115b5539eec26f4d271 [id=d1a9808588a74a90be4afc3e4205373e]): Illegal state: Tablet not RUNNING: STOPPING
I20250625 14:01:53.833189 12238 raft_consensus.cc:491] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.833964 12238 raft_consensus.cc:3058] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.834959 12238 raft_consensus.cc:513] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.835384 12238 leader_election.cc:290] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.835757 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb7bbd1c627f4da6b2e1812eed472c83" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.836489 12172 tablet_bootstrap.cc:492] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.836594 12172 ts_tablet_manager.cc:1397] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.000s
I20250625 14:01:53.836779 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb7bbd1c627f4da6b2e1812eed472c83" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.836923 11920 raft_consensus.cc:3058] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:53.836827 11717 leader_election.cc:343] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.837118 12172 raft_consensus.cc:357] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.837226 12172 raft_consensus.cc:383] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.837232 12327 raft_consensus.cc:491] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.837275 12172 raft_consensus.cc:738] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.837312 12327 raft_consensus.cc:513] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.837400 12172 consensus_queue.cc:260] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.837677 12327 leader_election.cc:290] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.837697 12172 ts_tablet_manager.cc:1428] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.837790 11920 raft_consensus.cc:2466] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.837894 12172 tablet_bootstrap.cc:492] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.838107 11717 leader_election.cc:304] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.838121 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53bea49e49d64c7a82c96535db09c87d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.838258 12238 raft_consensus.cc:2802] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.838371 12238 raft_consensus.cc:695] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.838470 12238 consensus_queue.cc:237] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:53.838619 11855 leader_election.cc:343] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.839145 12177 log.cc:1199] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/910f1645f58b4066ae5c7c61e966e64c
I20250625 14:01:53.839509 12177 ts_tablet_manager.cc:1939] T 910f1645f58b4066ae5c7c61e966e64c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.839577 12172 tablet_bootstrap.cc:654] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.839679 12327 raft_consensus.cc:491] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.839771 12327 raft_consensus.cc:513] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.840122 12327 leader_election.cc:290] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.840240 12177 tablet_replica.cc:331] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.840195 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53bea49e49d64c7a82c96535db09c87d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.840510 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_894409fe03824115b5539eec26f4d271 [id=d1a9808588a74a90be4afc3e4205373e]) successfully deleted
W20250625 14:01:53.840735 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 0221dbcbca5f44df8612fc5d1714b9a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0221dbcbca5f44df8612fc5d1714b9a3 already in progress: creating tablet
I20250625 14:01:53.840725 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f40cfb7e1454489f9d01fd220e35b3e6" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.840837 11784 raft_consensus.cc:2466] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
W20250625 14:01:53.841104 11858 leader_election.cc:343] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.841179 11858 leader_election.cc:304] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.841331 12327 raft_consensus.cc:2747] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.841408 11858 leader_election.cc:304] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.841535 12327 raft_consensus.cc:2802] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.841589 12327 raft_consensus.cc:491] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.841626 12327 raft_consensus.cc:3058] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.841624 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f40cfb7e1454489f9d01fd220e35b3e6" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:53.842327 11855 leader_election.cc:343] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.842720 12327 raft_consensus.cc:513] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.843124 12327 leader_election.cc:290] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:53.843429 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f40cfb7e1454489f9d01fd220e35b3e6" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:53.843762 11855 leader_election.cc:343] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.844044 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f40cfb7e1454489f9d01fd220e35b3e6" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.844053 12177 raft_consensus.cc:2241] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.844184 11784 raft_consensus.cc:3058] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.844225 12177 raft_consensus.cc:2270] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.844818 12177 ts_tablet_manager.cc:1905] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.845142 11784 raft_consensus.cc:2466] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:53.845525 11858 leader_election.cc:304] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.845696 12327 raft_consensus.cc:2802] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.845795 12327 raft_consensus.cc:695] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:53.845922 12327 consensus_queue.cc:237] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.849645 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9
I20250625 14:01:53.850320 12177 ts_tablet_manager.cc:1918] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.850349 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.850579 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.850699 12177 log.cc:1199] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/470a4489d4284f909016c6c464a4ad12
I20250625 14:01:53.851562 12175 tablet_replica.cc:331] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.851588 12177 ts_tablet_manager.cc:1939] T 470a4489d4284f909016c6c464a4ad12 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.851737 12175 raft_consensus.cc:2241] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:53.851936 12175 raft_consensus.cc:2270] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.852116 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.852541 12177 tablet_replica.cc:331] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.852607 12175 ts_tablet_manager.cc:1905] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.852701 12177 raft_consensus.cc:2241] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.852809 12177 raft_consensus.cc:2270] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.853295 12177 ts_tablet_manager.cc:1905] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.854749 12175 ts_tablet_manager.cc:1918] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:53.854827 12175 log.cc:1199] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/992a9f1bc92a4d5bbfb56bda19e6c4c9
I20250625 14:01:53.855103 12175 ts_tablet_manager.cc:1939] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.855510 12177 ts_tablet_manager.cc:1918] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:53.855573 12177 log.cc:1199] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/992a9f1bc92a4d5bbfb56bda19e6c4c9
I20250625 14:01:53.855818 12177 ts_tablet_manager.cc:1939] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.855806 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (table default.Table_d9bfb4dd53e542688a7732a9c4850e38 [id=396b9df84d604d29b6f720475255a184]) successfully deleted
I20250625 14:01:53.856770 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 470a4489d4284f909016c6c464a4ad12 (table default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]) successfully deleted
I20250625 14:01:53.856946 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (table default.Table_d9bfb4dd53e542688a7732a9c4850e38 [id=396b9df84d604d29b6f720475255a184]) successfully deleted
I20250625 14:01:53.857369 12238 raft_consensus.cc:491] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.857470 12238 raft_consensus.cc:513] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.857833 12238 leader_election.cc:290] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:53.857910 12238 raft_consensus.cc:491] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.857932 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d9546e85eaa44e5f8150b46f556782bd
I20250625 14:01:53.857970 12238 raft_consensus.cc:513] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.858242 11530 catalog_manager.cc:6652] ReplaceTablet: tablet d9546e85eaa44e5f8150b46f556782bd deleted and replaced by tablet 6b4141fcafbc4a6f96504bf47539b8ae
I20250625 14:01:53.858282 12238 leader_election.cc:290] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:53.858265 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da88786d60c34c71b85abd0fca502b8d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.858446 11920 raft_consensus.cc:2466] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.858810 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet d9546e85eaa44e5f8150b46f556782bd with delete_type TABLET_DATA_DELETED (replaced by tablet 6b4141fcafbc4a6f96504bf47539b8ae) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.858979 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da88786d60c34c71b85abd0fca502b8d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.859344 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet d9546e85eaa44e5f8150b46f556782bd with delete_type TABLET_DATA_DELETED (replaced by tablet 6b4141fcafbc4a6f96504bf47539b8ae) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.859589 12175 tablet_replica.cc:331] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.859628 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da2c9696938143f69ea1305ee076d84d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.859719 11920 raft_consensus.cc:2466] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.859724 12175 raft_consensus.cc:2241] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.859922 12175 raft_consensus.cc:2270] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.860374 12175 ts_tablet_manager.cc:1905] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.861567 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c5e5954a01aa472999e9ac079f706f4b
I20250625 14:01:53.861871 11532 catalog_manager.cc:6652] ReplaceTablet: tablet c5e5954a01aa472999e9ac079f706f4b deleted and replaced by tablet ef65dc31dc5843fb9e25275af5935e73
I20250625 14:01:53.861893 12167 tablet_bootstrap.cc:492] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.861980 12167 ts_tablet_manager.cc:1397] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.002s
I20250625 14:01:53.862008 12173 ts_tablet_manager.cc:1918] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.862075 12173 log.cc:1199] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c36e99b2e83141ff9923478ca7a13a2c
I20250625 14:01:53.862301 12173 ts_tablet_manager.cc:1939] T c36e99b2e83141ff9923478ca7a13a2c P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.862464 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet c5e5954a01aa472999e9ac079f706f4b with delete_type TABLET_DATA_DELETED (replaced by tablet ef65dc31dc5843fb9e25275af5935e73) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.862527 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 000aa8550a8b4f96922312e84c518978
I20250625 14:01:53.862809 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 000aa8550a8b4f96922312e84c518978 deleted and replaced by tablet 22cfc7f3b1564e4f91114cd5e049da0d
I20250625 14:01:53.862854 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet c5e5954a01aa472999e9ac079f706f4b with delete_type TABLET_DATA_DELETED (replaced by tablet ef65dc31dc5843fb9e25275af5935e73) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.863013 12175 ts_tablet_manager.cc:1918] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.863073 12175 log.cc:1199] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d9546e85eaa44e5f8150b46f556782bd
I20250625 14:01:53.863260 12175 ts_tablet_manager.cc:1939] T d9546e85eaa44e5f8150b46f556782bd P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.863317 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 000aa8550a8b4f96922312e84c518978 with delete_type TABLET_DATA_DELETED (replaced by tablet 22cfc7f3b1564e4f91114cd5e049da0d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.863293 12167 raft_consensus.cc:357] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.863412 12167 raft_consensus.cc:383] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.863457 12167 raft_consensus.cc:738] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.863621 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 000aa8550a8b4f96922312e84c518978 with delete_type TABLET_DATA_DELETED (replaced by tablet 22cfc7f3b1564e4f91114cd5e049da0d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.863624 12167 consensus_queue.cc:260] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.863911 12167 ts_tablet_manager.cc:1428] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:53.864094 12167 tablet_bootstrap.cc:492] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.864078 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d9546e85eaa44e5f8150b46f556782bd (table default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]) successfully deleted
W20250625 14:01:53.864497 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c5e5954a01aa472999e9ac079f706f4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5e5954a01aa472999e9ac079f706f4b already in progress: creating tablet
I20250625 14:01:53.864662 12175 tablet_replica.cc:331] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.864774 12175 raft_consensus.cc:2241] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.864862 12175 raft_consensus.cc:2270] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.865339 12175 ts_tablet_manager.cc:1905] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.865520 12167 tablet_bootstrap.cc:654] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.866940 12166 tablet_bootstrap.cc:492] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.867044 12166 ts_tablet_manager.cc:1397] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20250625 14:01:53.867749 12166 raft_consensus.cc:357] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.867842 12175 ts_tablet_manager.cc:1918] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.867906 12166 raft_consensus.cc:383] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.868000 12166 raft_consensus.cc:738] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.868018 12175 log.cc:1199] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/000aa8550a8b4f96922312e84c518978
I20250625 14:01:53.868165 12166 consensus_queue.cc:260] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.868276 12175 ts_tablet_manager.cc:1939] T 000aa8550a8b4f96922312e84c518978 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.868521 12166 ts_tablet_manager.cc:1428] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:53.868717 12166 tablet_bootstrap.cc:492] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.869750 12166 tablet_bootstrap.cc:654] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.870002 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da2c9696938143f69ea1305ee076d84d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.870147 12056 raft_consensus.cc:2466] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.870198 12178 raft_consensus.cc:491] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.870276 12178 raft_consensus.cc:513] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.870620 11717 leader_election.cc:304] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.870823 12178 leader_election.cc:290] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.870858 12180 raft_consensus.cc:2802] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.870934 12180 raft_consensus.cc:491] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.870983 12180 raft_consensus.cc:3058] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.871660 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5dbf82507c0148b79ca41e74e4bb3634"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.872033 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7b4c7577bd6b43bca23e1ed2d10fb086"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.872095 12180 raft_consensus.cc:513] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:53.872200 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5dbf82507c0148b79ca41e74e4bb3634 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:53.872359 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.872467 12180 leader_election.cc:290] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:53.872686 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5987ef8c74ec45e2b5d841638a30ba99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.873030 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5987ef8c74ec45e2b5d841638a30ba99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.873159 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fec01c20e02d4084bf434285d540adce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.873452 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fec01c20e02d4084bf434285d540adce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.873469 12172 tablet_bootstrap.cc:492] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.873555 12172 ts_tablet_manager.cc:1397] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:01:53.874047 12172 raft_consensus.cc:357] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.874155 12172 raft_consensus.cc:383] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.874210 12172 raft_consensus.cc:738] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.874375 12172 consensus_queue.cc:260] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.874400 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 000aa8550a8b4f96922312e84c518978 (table default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:53.874675 12172 ts_tablet_manager.cc:1428] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.875025 12172 tablet_bootstrap.cc:492] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.875123 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da2c9696938143f69ea1305ee076d84d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.875285 11920 raft_consensus.cc:2466] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:53.875329 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c36e99b2e83141ff9923478ca7a13a2c (table default.Table_232d767d55f44fd694aa78ba3b83f1ac [id=4f84fd8318e04f02961fee283b12d934]) successfully deleted
I20250625 14:01:53.875587 11990 leader_election.cc:304] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.876152 12178 raft_consensus.cc:2802] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.876220 12178 raft_consensus.cc:491] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.876274 12178 raft_consensus.cc:3058] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.876700 12173 tablet_replica.cc:331] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.876842 12173 raft_consensus.cc:2241] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.876942 12173 raft_consensus.cc:2270] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.877406 12178 raft_consensus.cc:513] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.877465 12173 ts_tablet_manager.cc:1905] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.877868 12178 leader_election.cc:290] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.878257 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da2c9696938143f69ea1305ee076d84d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.878415 11920 raft_consensus.cc:3058] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.879375 11920 raft_consensus.cc:2466] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:53.879773 11990 leader_election.cc:304] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.879956 12178 raft_consensus.cc:2802] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.880050 12172 tablet_bootstrap.cc:654] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.880323 12178 raft_consensus.cc:695] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:53.880496 12178 consensus_queue.cc:237] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.881152 12167 tablet_bootstrap.cc:492] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.881227 12167 ts_tablet_manager.cc:1397] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:53.881696 12167 raft_consensus.cc:357] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.881800 12167 raft_consensus.cc:383] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.881830 12167 raft_consensus.cc:738] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.881950 12167 consensus_queue.cc:260] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.882246 12167 ts_tablet_manager.cc:1428] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.882462 12167 tablet_bootstrap.cc:492] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.883234 12172 tablet_bootstrap.cc:492] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.883404 12172 ts_tablet_manager.cc:1397] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s
I20250625 14:01:53.883958 12172 raft_consensus.cc:357] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.884148 12172 raft_consensus.cc:383] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.884217 12172 raft_consensus.cc:738] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.884388 12167 tablet_bootstrap.cc:654] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.884541 12172 consensus_queue.cc:260] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.885491 12172 ts_tablet_manager.cc:1428] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:53.885727 12172 tablet_bootstrap.cc:492] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.886299 12167 tablet_bootstrap.cc:492] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.886436 12167 ts_tablet_manager.cc:1397] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:53.887204 12167 raft_consensus.cc:357] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.887317 12167 raft_consensus.cc:383] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.887346 12167 raft_consensus.cc:738] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.887490 12167 consensus_queue.cc:260] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.888289 12172 tablet_bootstrap.cc:654] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.889135 12167 ts_tablet_manager.cc:1428] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:53.889403 12167 tablet_bootstrap.cc:492] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.879906 12173 ts_tablet_manager.cc:1918] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.889716 12173 log.cc:1199] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f2748c24d9804c41b8d03156c1587e93
I20250625 14:01:53.889971 12173 ts_tablet_manager.cc:1939] T f2748c24d9804c41b8d03156c1587e93 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.891393 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8a4d01792d40471ab6d5bafa1a308351
I20250625 14:01:53.891551 12167 tablet_bootstrap.cc:654] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.891721 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 8a4d01792d40471ab6d5bafa1a308351 deleted and replaced by tablet bc92f5f36ae94fe09b6017efc6ebbcaf
I20250625 14:01:53.891948 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1bc57951e55e40f2aa6b5736e5f9b500"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.892406 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bc57951e55e40f2aa6b5736e5f9b500 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.870864 11717 leader_election.cc:304] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.892839 12180 raft_consensus.cc:2802] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.892915 12180 raft_consensus.cc:491] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.892957 12180 raft_consensus.cc:3058] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:53.893457 11717 leader_election.cc:343] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.894014 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9f306b943fbf4ccebc4e1c89934c7d88
I20250625 14:01:53.894100 12180 raft_consensus.cc:513] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.894379 11528 catalog_manager.cc:6652] ReplaceTablet: tablet 9f306b943fbf4ccebc4e1c89934c7d88 deleted and replaced by tablet f0c5509615cf45339c455e8add91a96f
I20250625 14:01:53.894531 12180 leader_election.cc:290] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:53.894686 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet d9546e85eaa44e5f8150b46f556782bd with delete_type TABLET_DATA_DELETED (replaced by tablet 6b4141fcafbc4a6f96504bf47539b8ae) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.894627 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_768e989533ee4c5a8ad6f761a51c058d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.894829 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet c5e5954a01aa472999e9ac079f706f4b with delete_type TABLET_DATA_DELETED (replaced by tablet ef65dc31dc5843fb9e25275af5935e73) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.894946 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 000aa8550a8b4f96922312e84c518978 with delete_type TABLET_DATA_DELETED (replaced by tablet 22cfc7f3b1564e4f91114cd5e049da0d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.895059 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 with delete_type TABLET_DATA_DELETED (replaced by tablet bc92f5f36ae94fe09b6017efc6ebbcaf) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:53.895131 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_768e989533ee4c5a8ad6f761a51c058d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.895501 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da88786d60c34c71b85abd0fca502b8d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.895622 11920 raft_consensus.cc:3058] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.895851 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da2c9696938143f69ea1305ee076d84d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.896000 11784 raft_consensus.cc:2391] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:53.896253 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da2c9696938143f69ea1305ee076d84d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:53.896385 11783 raft_consensus.cc:2391] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:53.896605 11920 raft_consensus.cc:2466] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.896659 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da2c9696938143f69ea1305ee076d84d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.896802 11922 raft_consensus.cc:2391] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56419e38d8e34f6985d4d970c1ce76e5 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:01:53.896852 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 9f306b943fbf4ccebc4e1c89934c7d88 with delete_type TABLET_DATA_DELETED (replaced by tablet f0c5509615cf45339c455e8add91a96f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.897010 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 9f306b943fbf4ccebc4e1c89934c7d88 with delete_type TABLET_DATA_DELETED (replaced by tablet f0c5509615cf45339c455e8add91a96f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.897010 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da88786d60c34c71b85abd0fca502b8d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.897285 12175 tablet_replica.cc:331] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.897297 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da2c9696938143f69ea1305ee076d84d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.897416 12175 raft_consensus.cc:2241] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.897500 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 with delete_type TABLET_DATA_DELETED (replaced by tablet bc92f5f36ae94fe09b6017efc6ebbcaf) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.897532 12175 raft_consensus.cc:2270] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.897614 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f2748c24d9804c41b8d03156c1587e93 (table default.Table_8d003fa42e2a4a85b64e842f0199c525 [id=4111545cc6b44021b0bd7881cfb57a7b]) successfully deleted
I20250625 14:01:53.897656 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 with delete_type TABLET_DATA_DELETED (replaced by tablet bc92f5f36ae94fe09b6017efc6ebbcaf) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.898036 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 9f306b943fbf4ccebc4e1c89934c7d88 with delete_type TABLET_DATA_DELETED (replaced by tablet f0c5509615cf45339c455e8add91a96f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.898178 12175 ts_tablet_manager.cc:1905] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.898959 11717 leader_election.cc:304] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.899042 12173 tablet_replica.cc:331] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.899039 12177 tablet_replica.cc:331] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.899168 12173 raft_consensus.cc:2241] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.899170 12177 raft_consensus.cc:2241] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:01:53.899230 11717 leader_election.cc:343] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.899286 12177 raft_consensus.cc:2270] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.899286 12173 raft_consensus.cc:2270] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.899412 11717 leader_election.cc:304] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:53.899425 12238 raft_consensus.cc:2802] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.899573 12238 raft_consensus.cc:695] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
W20250625 14:01:53.899708 11520 catalog_manager.cc:5001] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): alter failed for tablet 910f1645f58b4066ae5c7c61e966e64c (table default.Table_894409fe03824115b5539eec26f4d271 [id=d1a9808588a74a90be4afc3e4205373e]),no further retry: Not found: Tablet not found: 910f1645f58b4066ae5c7c61e966e64c
I20250625 14:01:53.899729 12238 consensus_queue.cc:237] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.899816 12177 ts_tablet_manager.cc:1905] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.899927 12173 ts_tablet_manager.cc:1905] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.900548 12238 raft_consensus.cc:2747] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.898974 12180 raft_consensus.cc:491] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.902505 12180 raft_consensus.cc:513] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.902928 12177 ts_tablet_manager.cc:1918] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.903002 12177 log.cc:1199] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d9546e85eaa44e5f8150b46f556782bd
I20250625 14:01:53.903230 12177 ts_tablet_manager.cc:1939] T d9546e85eaa44e5f8150b46f556782bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.903317 12180 leader_election.cc:290] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.905732 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "000aa8550a8b4f96922312e84c518978" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.906803 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fa9aec9800fe444086b8c3bbc7cf3523" } new_table_name: "default.Table_31fa2df49e0641a3bec420da08de1070" modify_external_catalogs: true
I20250625 14:01:53.908886 12177 tablet_replica.cc:331] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.909603 11968 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:53.909884 12177 raft_consensus.cc:2241] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.910030 12177 raft_consensus.cc:2270] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.910260 12173 ts_tablet_manager.cc:1918] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:53.910372 12173 log.cc:1199] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/992a9f1bc92a4d5bbfb56bda19e6c4c9
I20250625 14:01:53.910701 12173 ts_tablet_manager.cc:1939] T 992a9f1bc92a4d5bbfb56bda19e6c4c9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:53.911415 11717 leader_election.cc:343] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:53.911573 11717 leader_election.cc:343] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 000aa8550a8b4f96922312e84c518978
I20250625 14:01:53.911631 11717 leader_election.cc:304] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:53.911629 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 992a9f1bc92a4d5bbfb56bda19e6c4c9 (table default.Table_d9bfb4dd53e542688a7732a9c4850e38 [id=396b9df84d604d29b6f720475255a184]) successfully deleted
W20250625 14:01:53.912014 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d9546e85eaa44e5f8150b46f556782bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9546e85eaa44e5f8150b46f556782bd already in progress: creating tablet
I20250625 14:01:53.912195 12173 tablet_replica.cc:331] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:01:53.912257 11717 raft_consensus.cc:2684] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20250625 14:01:53.912335 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c5e5954a01aa472999e9ac079f706f4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5e5954a01aa472999e9ac079f706f4b already in progress: creating tablet
W20250625 14:01:53.912495 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 000aa8550a8b4f96922312e84c518978 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 000aa8550a8b4f96922312e84c518978 already in progress: creating tablet
I20250625 14:01:53.912604 12167 tablet_bootstrap.cc:492] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.912699 12167 ts_tablet_manager.cc:1397] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:53.912525 12173 raft_consensus.cc:2241] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.912947 12173 raft_consensus.cc:2270] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.913448 12167 raft_consensus.cc:357] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.913503 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d9546e85eaa44e5f8150b46f556782bd (table default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]) successfully deleted
I20250625 14:01:53.913571 12167 raft_consensus.cc:383] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.913614 12167 raft_consensus.cc:738] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
W20250625 14:01:53.913661 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c5e5954a01aa472999e9ac079f706f4b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5e5954a01aa472999e9ac079f706f4b already in progress: creating tablet
I20250625 14:01:53.913772 12173 ts_tablet_manager.cc:1905] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.913776 12167 consensus_queue.cc:260] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.914825 12167 ts_tablet_manager.cc:1428] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:53.915146 12167 tablet_bootstrap.cc:492] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.916628 12177 ts_tablet_manager.cc:1905] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.917160 12167 tablet_bootstrap.cc:654] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.917177 12173 ts_tablet_manager.cc:1918] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.917244 12173 log.cc:1199] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9f306b943fbf4ccebc4e1c89934c7d88
I20250625 14:01:53.918159 12173 ts_tablet_manager.cc:1939] T 9f306b943fbf4ccebc4e1c89934c7d88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:53.919029 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9f306b943fbf4ccebc4e1c89934c7d88 (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]) successfully deleted
W20250625 14:01:53.919369 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8a4d01792d40471ab6d5bafa1a308351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4d01792d40471ab6d5bafa1a308351 already in progress: creating tablet
I20250625 14:01:53.920042 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e4a50929a7434ef0bd4f961f077f4ff8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.920496 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4a50929a7434ef0bd4f961f077f4ff8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.921475 12175 ts_tablet_manager.cc:1918] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.921593 12175 log.cc:1199] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9f306b943fbf4ccebc4e1c89934c7d88
I20250625 14:01:53.921602 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:53.921814 12177 ts_tablet_manager.cc:1918] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.921891 12177 log.cc:1199] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/000aa8550a8b4f96922312e84c518978
W20250625 14:01:53.922044 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.922132 12177 ts_tablet_manager.cc:1939] T 000aa8550a8b4f96922312e84c518978 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.922612 12175 ts_tablet_manager.cc:1939] T 9f306b943fbf4ccebc4e1c89934c7d88 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.923214 12177 tablet_replica.cc:331] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.923348 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9f306b943fbf4ccebc4e1c89934c7d88 (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]) successfully deleted
I20250625 14:01:53.923710 12177 raft_consensus.cc:2241] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:01:53.923846 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8a4d01792d40471ab6d5bafa1a308351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4d01792d40471ab6d5bafa1a308351 already in progress: creating tablet
I20250625 14:01:53.924063 12177 raft_consensus.cc:2270] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.924964 12167 tablet_bootstrap.cc:492] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.924976 12177 ts_tablet_manager.cc:1905] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.925084 12167 ts_tablet_manager.cc:1397] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:53.925563 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 000aa8550a8b4f96922312e84c518978 (table default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:53.925638 12167 raft_consensus.cc:357] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.925750 12167 raft_consensus.cc:383] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250625 14:01:53.925735 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8a4d01792d40471ab6d5bafa1a308351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a4d01792d40471ab6d5bafa1a308351 already in progress: creating tablet
I20250625 14:01:53.925787 12167 raft_consensus.cc:738] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.926869 12167 consensus_queue.cc:260] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.927003 12180 raft_consensus.cc:491] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.927098 12180 raft_consensus.cc:513] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.927484 12180 leader_election.cc:290] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.928392 12167 ts_tablet_manager.cc:1428] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:53.928613 12167 tablet_bootstrap.cc:492] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.928805 12177 ts_tablet_manager.cc:1918] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:53.928959 12177 log.cc:1199] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9f306b943fbf4ccebc4e1c89934c7d88
I20250625 14:01:53.929323 12177 ts_tablet_manager.cc:1939] T 9f306b943fbf4ccebc4e1c89934c7d88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:53.931553 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb8c57c541114222b81dff868b1529f6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:53.931767 12103 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
W20250625 14:01:53.932082 11717 leader_election.cc:343] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.932289 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9f306b943fbf4ccebc4e1c89934c7d88 (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]) successfully deleted
I20250625 14:01:53.932406 12167 tablet_bootstrap.cc:654] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.932746 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb8c57c541114222b81dff868b1529f6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.932893 11922 raft_consensus.cc:2466] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:53.933359 11717 leader_election.cc:304] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:53.933467 12166 tablet_bootstrap.cc:492] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.933555 12166 ts_tablet_manager.cc:1397] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
I20250625 14:01:53.933559 12167 tablet_bootstrap.cc:492] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.933606 12180 raft_consensus.cc:2802] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:53.933640 12167 ts_tablet_manager.cc:1397] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:01:53.933655 12180 raft_consensus.cc:491] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:53.933696 12180 raft_consensus.cc:3058] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.934108 12166 raft_consensus.cc:357] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.934139 12167 raft_consensus.cc:357] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.934209 12166 raft_consensus.cc:383] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.934234 12166 raft_consensus.cc:738] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.934234 12167 raft_consensus.cc:383] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.934265 12167 raft_consensus.cc:738] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.934376 12166 consensus_queue.cc:260] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.934409 12167 consensus_queue.cc:260] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.934661 12166 ts_tablet_manager.cc:1428] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.934729 12167 ts_tablet_manager.cc:1428] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.934804 12180 raft_consensus.cc:513] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.934892 12166 tablet_bootstrap.cc:492] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.934923 12167 tablet_bootstrap.cc:492] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.935186 12180 leader_election.cc:290] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.935859 12166 tablet_bootstrap.cc:654] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.935977 12167 tablet_bootstrap.cc:654] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.937211 12167 tablet_bootstrap.cc:492] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.937310 12167 ts_tablet_manager.cc:1397] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:53.937445 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb8c57c541114222b81dff868b1529f6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:53.937546 11922 raft_consensus.cc:3058] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:53.938079 12167 raft_consensus.cc:357] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.938181 12167 raft_consensus.cc:383] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.938210 12167 raft_consensus.cc:738] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.938342 12167 consensus_queue.cc:260] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.938603 12167 ts_tablet_manager.cc:1428] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.938633 11922 raft_consensus.cc:2466] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:53.938771 12167 tablet_bootstrap.cc:492] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.939762 11717 leader_election.cc:304] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:53.939911 12167 tablet_bootstrap.cc:654] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.940075 12180 raft_consensus.cc:2802] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:53.940172 12180 raft_consensus.cc:695] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:53.940331 12180 consensus_queue.cc:237] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.937225 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb8c57c541114222b81dff868b1529f6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:53.941743 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4f90b19d20404564bb50d83322939821"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.942036 11717 leader_election.cc:343] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:53.942209 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f90b19d20404564bb50d83322939821 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.943635 12103 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:53.947475 11830 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:53.948102 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a2e04dac18624961a57893dacef498b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:53.948499 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2e04dac18624961a57893dacef498b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:53.953370 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 80f4e61e39894e88b3497328da8f7d01 (table default.Table_49966ab9cf1c45feb28e95ae79153e6e [id=0071abfe5ba94050bfc65317fae65385]). Expected version 1 got 0
I20250625 14:01:53.953531 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 36da902c99bf4416aa0769438182e443 (table default.Table_18fd74110fdc485d839fae5cc2b22cfd [id=a32feaf4c2f74d1bbd361e7680395682]). Expected version 1 got 0
I20250625 14:01:53.954403 12498 sys_catalog.cc:263] Verifying existing consensus state
I20250625 14:01:53.955422 12172 tablet_bootstrap.cc:492] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.955538 12172 ts_tablet_manager.cc:1397] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.070s user 0.000s sys 0.002s
I20250625 14:01:53.956058 12172 raft_consensus.cc:357] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.956192 12172 raft_consensus.cc:383] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.956233 12172 raft_consensus.cc:738] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.956398 12172 consensus_queue.cc:260] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.956696 12172 ts_tablet_manager.cc:1428] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.956908 12172 tablet_bootstrap.cc:492] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.957238 12498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Bootstrap starting.
I20250625 14:01:53.957412 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7c6da9796d8348998cef7efc15459128" } new_table_name: "default.Table_59f8085ce25e47eea2c0e2308acc10f3" modify_external_catalogs: true
I20250625 14:01:53.957962 12172 tablet_bootstrap.cc:654] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:53.958405 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53bea49e49d64c7a82c96535db09c87d consensus state has no leader
I20250625 14:01:53.958608 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_abd5285550f6481d993b832b604973fa" } new_table_name: "default.Table_07d074214aae4c1ab81b65f2859410a6" modify_external_catalogs: true
I20250625 14:01:53.959770 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae (DEFAULT_TABLE table=default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.960089 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4141fcafbc4a6f96504bf47539b8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.960525 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae (DEFAULT_TABLE table=default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.960737 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4141fcafbc4a6f96504bf47539b8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.961166 12166 tablet_bootstrap.cc:492] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.961257 12166 ts_tablet_manager.cc:1397] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20250625 14:01:53.961742 12166 raft_consensus.cc:357] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.961843 12166 raft_consensus.cc:383] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.961881 12166 raft_consensus.cc:738] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.962045 12166 consensus_queue.cc:260] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.964998 12166 ts_tablet_manager.cc:1428] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:53.965255 12166 tablet_bootstrap.cc:492] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:53.966593 12166 tablet_bootstrap.cc:654] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.967967 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae (DEFAULT_TABLE table=default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:53.968271 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4141fcafbc4a6f96504bf47539b8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:53.968364 12498 log.cc:826] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Log is configured to *not* fsync() on all Append() calls
I20250625 14:01:53.971117 12172 tablet_bootstrap.cc:492] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.971208 12172 ts_tablet_manager.cc:1397] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:01:53.971274 12178 raft_consensus.cc:491] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.971374 12178 raft_consensus.cc:513] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:53.971632 12172 raft_consensus.cc:357] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.971719 12172 raft_consensus.cc:383] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.971746 12172 raft_consensus.cc:738] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.971819 12178 leader_election.cc:290] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.971858 12172 consensus_queue.cc:260] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.972108 12172 ts_tablet_manager.cc:1428] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:53.972288 12172 tablet_bootstrap.cc:492] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:53.972755 11990 leader_election.cc:343] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 59c3dd659e8048edac846083a0ff03aa
I20250625 14:01:53.973647 12172 tablet_bootstrap.cc:654] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:53.973626 11993 leader_election.cc:343] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 59c3dd659e8048edac846083a0ff03aa
I20250625 14:01:53.973691 11993 leader_election.cc:304] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:53.973826 11830 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:53.973917 12178 raft_consensus.cc:2747] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:53.974911 12172 tablet_bootstrap.cc:492] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.975005 12172 ts_tablet_manager.cc:1397] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20250625 14:01:53.975414 12172 raft_consensus.cc:357] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.975519 12172 raft_consensus.cc:383] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.975549 12172 raft_consensus.cc:738] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.975653 12172 consensus_queue.cc:260] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.975919 12172 ts_tablet_manager.cc:1428] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.976336 12172 tablet_bootstrap.cc:492] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.976938 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8d66b17e7a3948dfa0c312c5c07ea57d" } new_table_name: "default.Table_c462a6e6fe9f4090a80e61f9af07fc6e" modify_external_catalogs: true
I20250625 14:01:53.977384 12172 tablet_bootstrap.cc:654] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.977380 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fec01c20e02d4084bf434285d540adce" } new_table_name: "default.Table_02bf78c154554f73967743f837e7114e" modify_external_catalogs: true
I20250625 14:01:53.978454 12172 tablet_bootstrap.cc:492] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.978529 12172 ts_tablet_manager.cc:1397] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20250625 14:01:53.978928 12172 raft_consensus.cc:357] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.979028 12172 raft_consensus.cc:383] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.979055 12172 raft_consensus.cc:738] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.979163 12172 consensus_queue.cc:260] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.979426 12172 ts_tablet_manager.cc:1428] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:53.979609 12172 tablet_bootstrap.cc:492] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.980649 12172 tablet_bootstrap.cc:654] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.981042 12178 raft_consensus.cc:491] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.981151 12178 raft_consensus.cc:513] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.981562 12178 leader_election.cc:290] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.981638 12166 tablet_bootstrap.cc:492] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:53.981732 12166 ts_tablet_manager.cc:1397] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:53.982455 12166 raft_consensus.cc:357] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.982574 12166 raft_consensus.cc:383] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.982609 12166 raft_consensus.cc:738] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.982627 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d8e509824fc94993b1676f5b68515002" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:53.982743 12166 consensus_queue.cc:260] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.982918 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d8e509824fc94993b1676f5b68515002" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:53.983071 11783 raft_consensus.cc:2391] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:53.983392 11990 leader_election.cc:304] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:53.983718 12178 raft_consensus.cc:3058] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:53.985952 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91fe26db32a44fb08efa3809f0fddfae consensus state has no leader
W20250625 14:01:53.986297 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7eee5c995064aacb406daddb888edb6 consensus state has no leader
I20250625 14:01:53.988195 11531 catalog_manager.cc:5582] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:53.988422 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 80f4e61e39894e88b3497328da8f7d01 (table default.Table_49966ab9cf1c45feb28e95ae79153e6e [id=0071abfe5ba94050bfc65317fae65385]). Expected version 1 got 0
I20250625 14:01:53.988643 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 66cab8705ca2439abfa683f8b8b6dc45
I20250625 14:01:53.988912 11525 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_18fd74110fdc485d839fae5cc2b22cfd [id=a32feaf4c2f74d1bbd361e7680395682] alter complete (version 1)
I20250625 14:01:53.989753 12172 tablet_bootstrap.cc:492] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:53.989866 12172 ts_tablet_manager.cc:1397] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20250625 14:01:53.990229 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 66cab8705ca2439abfa683f8b8b6dc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.990290 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 66cab8705ca2439abfa683f8b8b6dc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:53.990247 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 082a46d213c545b18acbcac1b699d140 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:53.990527 12205 raft_consensus.cc:491] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:53.990608 12205 raft_consensus.cc:513] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.990664 12167 tablet_bootstrap.cc:492] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:53.990746 12167 ts_tablet_manager.cc:1397] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20250625 14:01:53.990967 12205 leader_election.cc:290] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:53.991218 12167 raft_consensus.cc:357] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.991321 12167 raft_consensus.cc:383] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.991359 12167 raft_consensus.cc:738] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.991497 12167 consensus_queue.cc:260] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:53.991743 12167 ts_tablet_manager.cc:1428] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:53.991930 12167 tablet_bootstrap.cc:492] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:53.992491 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 66cab8705ca2439abfa683f8b8b6dc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:53.992667 12177 tablet_replica.cc:331] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:53.992695 12173 tablet_replica.cc:331] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:53.992794 12177 raft_consensus.cc:2241] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.992806 12173 raft_consensus.cc:2241] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.992903 12177 raft_consensus.cc:2270] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.992923 12173 raft_consensus.cc:2270] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.993022 12167 tablet_bootstrap.cc:654] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.992956 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_73d3dbf418e2463ba09893538dd70097" } modify_external_catalogs: true
I20250625 14:01:53.993094 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_73d3dbf418e2463ba09893538dd70097" } modify_external_catalogs: true
I20250625 14:01:53.993129 12175 tablet_replica.cc:331] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:53.993289 12175 raft_consensus.cc:2241] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:53.993403 12175 raft_consensus.cc:2270] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:53.993448 12177 ts_tablet_manager.cc:1905] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.994273 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0221dbcbca5f44df8612fc5d1714b9a3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:53.994858 11717 leader_election.cc:343] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:53.994863 12175 ts_tablet_manager.cc:1905] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:53.996031 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dbd3da73c8ac4e928ab517816c17a64a" } modify_external_catalogs: true
I20250625 14:01:53.995216 12172 raft_consensus.cc:357] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.996177 12172 raft_consensus.cc:383] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:53.996161 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dbd3da73c8ac4e928ab517816c17a64a" } modify_external_catalogs: true
I20250625 14:01:53.996212 12172 raft_consensus.cc:738] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:53.996363 12172 consensus_queue.cc:260] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:53.996649 12172 ts_tablet_manager.cc:1428] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20250625 14:01:53.996876 12172 tablet_bootstrap.cc:492] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:53.997313 12175 ts_tablet_manager.cc:1918] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:53.997392 12175 log.cc:1199] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/66cab8705ca2439abfa683f8b8b6dc45
I20250625 14:01:53.997619 12175 ts_tablet_manager.cc:1939] T 66cab8705ca2439abfa683f8b8b6dc45 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:53.998104 12172 tablet_bootstrap.cc:654] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:53.998157 12173 ts_tablet_manager.cc:1905] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:53.998194 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc2766f8e0b544b0b48a0e7e5952d672 consensus state has no leader
W20250625 14:01:53.998862 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff54429a3d3e40688aaea56b70dcdfae consensus state has no leader
I20250625 14:01:53.999774 11529 catalog_manager.cc:5582] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:54.000005 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 4 got 0
I20250625 14:01:54.000054 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet d9546e85eaa44e5f8150b46f556782bd with delete_type TABLET_DATA_DELETED (replaced by tablet 6b4141fcafbc4a6f96504bf47539b8ae) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.000123 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet ff54429a3d3e40688aaea56b70dcdfae (table default.Table_c462a6e6fe9f4090a80e61f9af07fc6e [id=8302b2a44b004bdab1aa2f67bb82ad01]). Expected version 1 got 0
I20250625 14:01:54.000208 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_3a6be9f022c240baa90d4b38e252c01a [id=9bd1814bba0a43fa8a66a50e91ef165f]). Expected version 1 got 0
I20250625 14:01:54.000219 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 9f306b943fbf4ccebc4e1c89934c7d88 with delete_type TABLET_DATA_DELETED (replaced by tablet f0c5509615cf45339c455e8add91a96f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.000392 12173 ts_tablet_manager.cc:1918] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.000455 12173 log.cc:1199] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/082a46d213c545b18acbcac1b699d140
I20250625 14:01:54.000638 12173 ts_tablet_manager.cc:1939] T 082a46d213c545b18acbcac1b699d140 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.000977 11896 tablet_service.cc:1468] Processing CreateTablet for tablet ab957f1fd4214efbb6233f312617c728 (DEFAULT_TABLE table=default.Table_5987ef8c74ec45e2b5d841638a30ba99 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.001250 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab957f1fd4214efbb6233f312617c728. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.001549 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 910f1645f58b4066ae5c7c61e966e64c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.002526 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0221dbcbca5f44df8612fc5d1714b9a3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:01:54.003149 11717 leader_election.cc:343] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.003237 11717 leader_election.cc:304] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:54.003571 12205 raft_consensus.cc:2747] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.004233 12178 raft_consensus.cc:2747] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.005069 12205 raft_consensus.cc:491] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.005143 12205 raft_consensus.cc:513] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.005491 12205 leader_election.cc:290] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.005810 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5e5954a01aa472999e9ac079f706f4b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:54.005944 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 66cab8705ca2439abfa683f8b8b6dc45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66cab8705ca2439abfa683f8b8b6dc45 already in progress: creating tablet
W20250625 14:01:54.006140 11717 leader_election.cc:343] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.006435 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5e5954a01aa472999e9ac079f706f4b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.006673 11898 tablet_service.cc:1468] Processing CreateTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf (DEFAULT_TABLE table=default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:54.006764 11717 leader_election.cc:343] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.006822 11717 leader_election.cc:304] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:54.006943 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc92f5f36ae94fe09b6017efc6ebbcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.006891 11760 tablet_service.cc:1468] Processing CreateTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf (DEFAULT_TABLE table=default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.007133 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc92f5f36ae94fe09b6017efc6ebbcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.009318 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 22cfc7f3b1564e4f91114cd5e049da0d (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.009435 11895 tablet_service.cc:1468] Processing CreateTablet for tablet ef65dc31dc5843fb9e25275af5935e73 (DEFAULT_TABLE table=default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.009544 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22cfc7f3b1564e4f91114cd5e049da0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.009670 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef65dc31dc5843fb9e25275af5935e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.010263 12166 ts_tablet_manager.cc:1428] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20250625 14:01:54.010541 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 39ff4b0e7ac74ec294550775aaa44468 (DEFAULT_TABLE table=default.Table_5dbf82507c0148b79ca41e74e4bb3634 [id=12bf9473cabd4d199715d23c94a02005]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.010778 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ff4b0e7ac74ec294550775aaa44468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.011803 11900 tablet_service.cc:1468] Processing CreateTablet for tablet f0c5509615cf45339c455e8add91a96f (DEFAULT_TABLE table=default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.011930 12166 tablet_bootstrap.cc:492] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.012017 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c5509615cf45339c455e8add91a96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.013365 12033 tablet_service.cc:1468] Processing CreateTablet for tablet ef65dc31dc5843fb9e25275af5935e73 (DEFAULT_TABLE table=default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.013633 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef65dc31dc5843fb9e25275af5935e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.013651 12037 tablet_service.cc:1468] Processing CreateTablet for tablet f0c5509615cf45339c455e8add91a96f (DEFAULT_TABLE table=default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.013839 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c5509615cf45339c455e8add91a96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.014020 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 39ff4b0e7ac74ec294550775aaa44468 (DEFAULT_TABLE table=default.Table_5dbf82507c0148b79ca41e74e4bb3634 [id=12bf9473cabd4d199715d23c94a02005]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.014066 12035 tablet_service.cc:1468] Processing CreateTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf (DEFAULT_TABLE table=default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.014220 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ff4b0e7ac74ec294550775aaa44468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.014464 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 22cfc7f3b1564e4f91114cd5e049da0d (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.014662 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22cfc7f3b1564e4f91114cd5e049da0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.015220 12166 tablet_bootstrap.cc:654] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.016088 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 (DEFAULT_TABLE table=default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.016302 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.016335 12166 tablet_bootstrap.cc:492] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.016419 12166 ts_tablet_manager.cc:1397] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:54.016923 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 22cfc7f3b1564e4f91114cd5e049da0d (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.017131 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22cfc7f3b1564e4f91114cd5e049da0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.017184 12166 raft_consensus.cc:357] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.017282 12166 raft_consensus.cc:383] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.017313 12166 raft_consensus.cc:738] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.017468 12166 consensus_queue.cc:260] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.017863 12166 ts_tablet_manager.cc:1428] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.018194 12166 tablet_bootstrap.cc:492] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.018489 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 (DEFAULT_TABLE table=default.Table_1bc57951e55e40f2aa6b5736e5f9b500 [id=c8ce791eeb3845f2ba3e8ad40955506b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.018702 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25160014ecf74c2ab6f1faca42d30c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.019147 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc92f5f36ae94fe09b6017efc6ebbcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.019248 12166 tablet_bootstrap.cc:654] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.021631 12030 tablet_service.cc:1468] Processing CreateTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.021696 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 (DEFAULT_TABLE table=default.Table_1bc57951e55e40f2aa6b5736e5f9b500 [id=c8ce791eeb3845f2ba3e8ad40955506b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.021934 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2766f8e0b544b0b48a0e7e5952d672. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.021957 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25160014ecf74c2ab6f1faca42d30c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.024951 11895 tablet_service.cc:1468] Processing CreateTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.025241 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2766f8e0b544b0b48a0e7e5952d672. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.026719 12205 raft_consensus.cc:2747] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.028586 11761 tablet_service.cc:1468] Processing CreateTablet for tablet ab957f1fd4214efbb6233f312617c728 (DEFAULT_TABLE table=default.Table_5987ef8c74ec45e2b5d841638a30ba99 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.028913 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab957f1fd4214efbb6233f312617c728. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.030274 12036 tablet_service.cc:1468] Processing CreateTablet for tablet ab957f1fd4214efbb6233f312617c728 (DEFAULT_TABLE table=default.Table_5987ef8c74ec45e2b5d841638a30ba99 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.030773 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab957f1fd4214efbb6233f312617c728. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.031028 12498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 14:01:54.031457 12498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Bootstrap complete.
I20250625 14:01:54.031889 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 (DEFAULT_TABLE table=default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.032171 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.033109 12205 raft_consensus.cc:491] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.033200 12205 raft_consensus.cc:513] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.033589 12205 leader_election.cc:290] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.033942 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d69d6037befe407fb135b49a041c690a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.034040 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d69d6037befe407fb135b49a041c690a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.034152 11922 raft_consensus.cc:2466] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:54.034335 11717 leader_election.cc:343] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.034538 12177 ts_tablet_manager.cc:1918] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.034603 12177 log.cc:1199] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/66cab8705ca2439abfa683f8b8b6dc45
I20250625 14:01:54.034837 12177 ts_tablet_manager.cc:1939] T 66cab8705ca2439abfa683f8b8b6dc45 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.030436 12178 raft_consensus.cc:491] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.035149 12178 raft_consensus.cc:513] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.035503 12178 leader_election.cc:290] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.035652 11717 leader_election.cc:304] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.035729 12166 tablet_bootstrap.cc:492] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.035817 12166 ts_tablet_manager.cc:1397] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
W20250625 14:01:54.036355 11990 leader_election.cc:343] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 33c895ed888b4cb8836f6a415d170c3e
I20250625 14:01:54.036353 12166 raft_consensus.cc:357] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.036470 12166 raft_consensus.cc:383] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.036496 12205 raft_consensus.cc:2802] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.036504 12166 raft_consensus.cc:738] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.036563 12205 raft_consensus.cc:491] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.036599 12205 raft_consensus.cc:3058] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.036654 12166 consensus_queue.cc:260] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.036808 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 66cab8705ca2439abfa683f8b8b6dc45 (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:54.037410 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 39ff4b0e7ac74ec294550775aaa44468 (DEFAULT_TABLE table=default.Table_5dbf82507c0148b79ca41e74e4bb3634 [id=12bf9473cabd4d199715d23c94a02005]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.037484 11763 tablet_service.cc:1468] Processing CreateTablet for tablet f0c5509615cf45339c455e8add91a96f (DEFAULT_TABLE table=default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.037684 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ff4b0e7ac74ec294550775aaa44468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.037701 11764 tablet_service.cc:1468] Processing CreateTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.037825 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 (DEFAULT_TABLE table=default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.038158 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 (DEFAULT_TABLE table=default.Table_1bc57951e55e40f2aa6b5736e5f9b500 [id=c8ce791eeb3845f2ba3e8ad40955506b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.038533 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1bc57951e55e40f2aa6b5736e5f9b500" } modify_external_catalogs: true
I20250625 14:01:54.038683 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1bc57951e55e40f2aa6b5736e5f9b500" } modify_external_catalogs: true
W20250625 14:01:54.039891 11993 leader_election.cc:343] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 33c895ed888b4cb8836f6a415d170c3e
I20250625 14:01:54.039987 11993 leader_election.cc:304] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.039924 11526 catalog_manager.cc:5582] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:54.040266 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 53bea49e49d64c7a82c96535db09c87d (table default.Table_31fa2df49e0641a3bec420da08de1070 [id=4bdc41d7138c4a099d95a82864c85d8e]). Expected version 1 got 0
I20250625 14:01:54.040326 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2766f8e0b544b0b48a0e7e5952d672. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.041304 12166 ts_tablet_manager.cc:1428] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:54.041533 12166 tablet_bootstrap.cc:492] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.042573 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.042975 12166 tablet_bootstrap.cc:654] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.044621 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25160014ecf74c2ab6f1faca42d30c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.044575 12498 raft_consensus.cc:357] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:54.045091 12498 raft_consensus.cc:738] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac8e2e2cf5c4faea7755bbad7d23d99, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.045706 12498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:54.046228 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 910f1645f58b4066ae5c7c61e966e64c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:54.046998 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 910f1645f58b4066ae5c7c61e966e64c because the tablet was not found. No further retry: Not found: Tablet not found: 910f1645f58b4066ae5c7c61e966e64c
I20250625 14:01:54.047480 12327 consensus_queue.cc:1035] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.047418 12498 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: configured and running, proceeding with master startup.
I20250625 14:01:54.049181 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bc92f5f36ae94fe09b6017efc6ebbcaf
I20250625 14:01:54.050115 12171 raft_consensus.cc:2747] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.049199 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4031eab780324944bc63fc77848fb209
I20250625 14:01:54.053314 12166 tablet_bootstrap.cc:492] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.053422 12166 ts_tablet_manager.cc:1397] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:54.053984 12166 raft_consensus.cc:357] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.054101 12166 raft_consensus.cc:383] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.054136 12166 raft_consensus.cc:738] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.054167 12265 consensus_queue.cc:1035] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.054270 12166 consensus_queue.cc:260] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.054586 12166 ts_tablet_manager.cc:1428] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.054786 12166 tablet_bootstrap.cc:492] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.056288 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 470a4489d4284f909016c6c464a4ad12 with delete_type TABLET_DATA_DELETED (replaced by tablet da88786d60c34c71b85abd0fca502b8d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.056377 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 33c895ed888b4cb8836f6a415d170c3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.056507 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 4031eab780324944bc63fc77848fb209 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.056522 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 59c3dd659e8048edac846083a0ff03aa with delete_type TABLET_DATA_DELETED (replaced by tablet 66cab8705ca2439abfa683f8b8b6dc45) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.056574 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet d9546e85eaa44e5f8150b46f556782bd with delete_type TABLET_DATA_DELETED (replaced by tablet 6b4141fcafbc4a6f96504bf47539b8ae) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.056869 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 66cab8705ca2439abfa683f8b8b6dc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.057053 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 000aa8550a8b4f96922312e84c518978 with delete_type TABLET_DATA_DELETED (replaced by tablet 22cfc7f3b1564e4f91114cd5e049da0d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.057207 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 9f306b943fbf4ccebc4e1c89934c7d88 with delete_type TABLET_DATA_DELETED (replaced by tablet f0c5509615cf45339c455e8add91a96f) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:54.057782 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 66cab8705ca2439abfa683f8b8b6dc45 because the tablet was not found. No further retry: Not found: Tablet not found: 66cab8705ca2439abfa683f8b8b6dc45
W20250625 14:01:54.057950 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9f306b943fbf4ccebc4e1c89934c7d88 because the tablet was not found. No further retry: Not found: Tablet not found: 9f306b943fbf4ccebc4e1c89934c7d88
I20250625 14:01:54.059190 12166 tablet_bootstrap.cc:654] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.060056 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_55c8f809888047139f479c0a5d5bafa0" } modify_external_catalogs: true
I20250625 14:01:54.060204 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_55c8f809888047139f479c0a5d5bafa0" } modify_external_catalogs: true
I20250625 14:01:54.060228 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.063526 12166 tablet_bootstrap.cc:492] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.063640 12166 ts_tablet_manager.cc:1397] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:54.064147 12166 raft_consensus.cc:357] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.064271 12166 raft_consensus.cc:383] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.064316 12166 raft_consensus.cc:738] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.064431 12166 consensus_queue.cc:260] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.064785 12166 ts_tablet_manager.cc:1428] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.064982 12166 tablet_bootstrap.cc:492] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.066634 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c5509615cf45339c455e8add91a96f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.067384 12166 tablet_bootstrap.cc:654] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.068320 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 25160014ecf74c2ab6f1faca42d30c47
I20250625 14:01:54.069280 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 4031eab780324944bc63fc77848fb209 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.070619 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.072311 12171 raft_consensus.cc:491] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.072424 12171 raft_consensus.cc:513] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.072574 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet d69d6037befe407fb135b49a041c690a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.072737 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.072824 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet bb24e0ce060c486bae8135e46827d956 with delete_type TABLET_DATA_DELETED (replaced by tablet a8d6c5552b204ec1b2f5e4bf9eba5640) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.072839 12171 leader_election.cc:290] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.073063 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.073174 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 0996320cbc83480cbb4d53248efacffd with delete_type TABLET_DATA_DELETED (replaced by tablet 44d41513c1d444cba5288a05f2c4652c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.073302 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet f6b666bfd4f141db89a35fa818edb378 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.073451 11760 tablet_service.cc:1468] Processing CreateTablet for tablet ef65dc31dc5843fb9e25275af5935e73 (DEFAULT_TABLE table=default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.073715 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef65dc31dc5843fb9e25275af5935e73. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.075722 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4031eab780324944bc63fc77848fb209 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4031eab780324944bc63fc77848fb209 already in progress: creating tablet
W20250625 14:01:54.075948 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet bc92f5f36ae94fe09b6017efc6ebbcaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc92f5f36ae94fe09b6017efc6ebbcaf already in progress: creating tablet
I20250625 14:01:54.077121 12533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:54.077306 12533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:54.078080 12166 tablet_bootstrap.cc:492] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.078200 12166 ts_tablet_manager.cc:1397] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20250625 14:01:54.078779 12166 raft_consensus.cc:357] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.079030 12166 raft_consensus.cc:383] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.079035 12547 catalog_manager.cc:1261] Loaded cluster ID: a3a3501b615546dbb967e53684a94696
I20250625 14:01:54.079077 12547 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: loading cluster ID for follower catalog manager: success
I20250625 14:01:54.079092 12166 raft_consensus.cc:738] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.079275 12166 consensus_queue.cc:260] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:54.079533 11993 leader_election.cc:343] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 000aa8550a8b4f96922312e84c518978
I20250625 14:01:54.079630 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:54.080489 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 25160014ecf74c2ab6f1faca42d30c47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25160014ecf74c2ab6f1faca42d30c47 already in progress: creating tablet
I20250625 14:01:54.081776 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e5a715b432704be2a9ca8bdca624bf70
I20250625 14:01:54.081871 12180 raft_consensus.cc:491] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.081967 12180 raft_consensus.cc:513] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.080626 12166 ts_tablet_manager.cc:1428] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:54.082355 12180 leader_election.cc:290] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.082502 12166 tablet_bootstrap.cc:492] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.082710 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88261e6c75b24755852c22f3d9385347" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:54.083083 11717 leader_election.cc:343] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.083282 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88261e6c75b24755852c22f3d9385347" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.083422 11922 raft_consensus.cc:2466] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.083719 12166 tablet_bootstrap.cc:654] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.083752 11717 leader_election.cc:304] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.084035 12180 raft_consensus.cc:2802] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.084095 12180 raft_consensus.cc:491] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.084156 12180 raft_consensus.cc:3058] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.084547 12547 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: acquiring CA information for follower catalog manager: success
I20250625 14:01:54.085207 12180 raft_consensus.cc:513] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.085587 12180 leader_election.cc:290] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.085989 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88261e6c75b24755852c22f3d9385347" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.086069 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "88261e6c75b24755852c22f3d9385347" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.086134 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet e5a715b432704be2a9ca8bdca624bf70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.086184 11922 raft_consensus.cc:3058] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.086355 12177 tablet_replica.cc:331] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.086503 12177 raft_consensus.cc:2241] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.086489 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 4031eab780324944bc63fc77848fb209 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.086621 12177 raft_consensus.cc:2270] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.087049 12177 ts_tablet_manager.cc:1905] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.087225 11922 raft_consensus.cc:2466] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.087625 12265 raft_consensus.cc:491] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.087703 12265 raft_consensus.cc:513] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.088083 12265 leader_election.cc:290] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.088495 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb24e0ce060c486bae8135e46827d956" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.088605 11783 raft_consensus.cc:2466] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.088915 11858 leader_election.cc:304] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.089072 12265 raft_consensus.cc:2802] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.089140 12265 raft_consensus.cc:491] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.089187 12265 raft_consensus.cc:3058] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:54.089427 11717 leader_election.cc:343] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.090180 12265 raft_consensus.cc:513] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.090545 12265 leader_election.cc:290] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.091012 12177 ts_tablet_manager.cc:1918] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.091018 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb24e0ce060c486bae8135e46827d956" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.091137 12177 log.cc:1199] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e5a715b432704be2a9ca8bdca624bf70
I20250625 14:01:54.091188 11783 raft_consensus.cc:3058] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.091421 12177 ts_tablet_manager.cc:1939] T e5a715b432704be2a9ca8bdca624bf70 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.091516 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb24e0ce060c486bae8135e46827d956" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.091552 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb24e0ce060c486bae8135e46827d956" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:54.092037 11855 leader_election.cc:343] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.092137 11783 raft_consensus.cc:2466] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
W20250625 14:01:54.092216 11855 leader_election.cc:343] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.092211 12547 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250625 14:01:54.092454 11858 leader_election.cc:304] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.092499 11717 leader_election.cc:304] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.092796 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e5a715b432704be2a9ca8bdca624bf70 (table default.Table_55c8f809888047139f479c0a5d5bafa0 [id=b3553dc46c8440619049d4adc450e003]) successfully deleted
I20250625 14:01:54.093075 12180 raft_consensus.cc:2802] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.093164 12180 raft_consensus.cc:695] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.093289 12180 consensus_queue.cc:237] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.094851 12265 raft_consensus.cc:2802] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.094964 12265 raft_consensus.cc:695] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.095093 12265 consensus_queue.cc:237] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.096169 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 20fb7745d76c431f822258879e7d7134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.097244 12327 consensus_queue.cc:1035] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.098907 12166 tablet_bootstrap.cc:492] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.099156 12166 ts_tablet_manager.cc:1397] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:54.099668 12166 raft_consensus.cc:357] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.099767 12166 raft_consensus.cc:383] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.099802 12166 raft_consensus.cc:738] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.099927 12166 consensus_queue.cc:260] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.100330 12166 ts_tablet_manager.cc:1428] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.100528 12166 tablet_bootstrap.cc:492] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.100809 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet e5a715b432704be2a9ca8bdca624bf70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.098809 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet e5a715b432704be2a9ca8bdca624bf70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.101711 12166 tablet_bootstrap.cc:654] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.102734 12205 raft_consensus.cc:513] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.103132 12205 leader_election.cc:290] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.106539 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_04bedd118b064b669bbd67a9e6017fba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.107002 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04bedd118b064b669bbd67a9e6017fba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.107841 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 10506b2cb6c5468daa6ef270b6ed2d4d (DEFAULT_TABLE table=default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346 [id=62eeb40941e44946a64d1067d3d44dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.107985 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet c5e5954a01aa472999e9ac079f706f4b with delete_type TABLET_DATA_DELETED (replaced by tablet ef65dc31dc5843fb9e25275af5935e73) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.108167 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10506b2cb6c5468daa6ef270b6ed2d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.108268 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 4617bb8a015d42188beba9df61df2c9f (DEFAULT_TABLE table=default.Table_a2e04dac18624961a57893dacef498b2 [id=d167abcc5579450c8d1850d50b1cf640]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.108494 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4617bb8a015d42188beba9df61df2c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.108696 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.108811 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.110641 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 92975891d7b24729b4b5514d8f8aecd8 (DEFAULT_TABLE table=default.Table_e4a50929a7434ef0bd4f961f077f4ff8 [id=cd58fd19f8994edf8a5854d80684e399]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.110931 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92975891d7b24729b4b5514d8f8aecd8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.111326 11990 leader_election.cc:343] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 000aa8550a8b4f96922312e84c518978
I20250625 14:01:54.111408 11990 leader_election.cc:304] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.111539 12171 consensus_queue.cc:1035] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.111826 12171 raft_consensus.cc:2747] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.111842 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a (DEFAULT_TABLE table=default.Table_4f90b19d20404564bb50d83322939821 [id=74f13a50680d4455a4fddc3eb7a3b3bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.112025 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 92975891d7b24729b4b5514d8f8aecd8 (DEFAULT_TABLE table=default.Table_e4a50929a7434ef0bd4f961f077f4ff8 [id=cd58fd19f8994edf8a5854d80684e399]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.112263 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92975891d7b24729b4b5514d8f8aecd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.113222 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]). Expected version 1 got 0
I20250625 14:01:54.113237 11895 tablet_service.cc:1468] Processing CreateTablet for tablet dbdc3547d8de48e8887ffeb5b0f71f82 (DEFAULT_TABLE table=default.Table_768e989533ee4c5a8ad6f761a51c058d [id=1e3e09853928482bae0b4b3d489dea3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.113479 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdc3547d8de48e8887ffeb5b0f71f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.114877 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 10506b2cb6c5468daa6ef270b6ed2d4d (DEFAULT_TABLE table=default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346 [id=62eeb40941e44946a64d1067d3d44dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.115190 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10506b2cb6c5468daa6ef270b6ed2d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.115676 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a (DEFAULT_TABLE table=default.Table_4f90b19d20404564bb50d83322939821 [id=74f13a50680d4455a4fddc3eb7a3b3bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.115912 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.118146 12032 tablet_service.cc:1468] Processing CreateTablet for tablet dbdc3547d8de48e8887ffeb5b0f71f82 (DEFAULT_TABLE table=default.Table_768e989533ee4c5a8ad6f761a51c058d [id=1e3e09853928482bae0b4b3d489dea3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.118443 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdc3547d8de48e8887ffeb5b0f71f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.119066 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d69d6037befe407fb135b49a041c690a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.119704 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a (DEFAULT_TABLE table=default.Table_4f90b19d20404564bb50d83322939821 [id=74f13a50680d4455a4fddc3eb7a3b3bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.119985 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.120024 11717 leader_election.cc:343] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.120487 12456 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" instance_seqno: 1750860111839732) as {username='slave'} at 127.11.39.129:51589; Asking this server to re-register.
I20250625 14:01:54.122431 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 88261e6c75b24755852c22f3d9385347 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.122651 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet e5a715b432704be2a9ca8bdca624bf70 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.122749 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.123021 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet fc2766f8e0b544b0b48a0e7e5952d672 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.123659 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet fc2766f8e0b544b0b48a0e7e5952d672 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.123884 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_0c2c0733750c4e89ac465c192b8c27bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.124332 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c2c0733750c4e89ac465c192b8c27bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.125079 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 4dfe24e8280c4675a5a6af9d32fa526e from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.125126 11764 tablet_service.cc:1468] Processing CreateTablet for tablet dbdc3547d8de48e8887ffeb5b0f71f82 (DEFAULT_TABLE table=default.Table_768e989533ee4c5a8ad6f761a51c058d [id=1e3e09853928482bae0b4b3d489dea3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.125411 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdc3547d8de48e8887ffeb5b0f71f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.125645 12171 raft_consensus.cc:491] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.125746 12171 raft_consensus.cc:513] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.126147 12171 leader_election.cc:290] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.126827 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 92975891d7b24729b4b5514d8f8aecd8 (DEFAULT_TABLE table=default.Table_e4a50929a7434ef0bd4f961f077f4ff8 [id=cd58fd19f8994edf8a5854d80684e399]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.127070 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92975891d7b24729b4b5514d8f8aecd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.129154 12166 tablet_bootstrap.cc:492] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.129261 12166 ts_tablet_manager.cc:1397] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
W20250625 14:01:54.129703 11993 leader_election.cc:343] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 0996320cbc83480cbb4d53248efacffd
I20250625 14:01:54.129786 12166 raft_consensus.cc:357] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.129900 12166 raft_consensus.cc:383] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.129930 12166 raft_consensus.cc:738] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.130043 12166 consensus_queue.cc:260] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.130465 12166 ts_tablet_manager.cc:1428] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.130661 12166 tablet_bootstrap.cc:492] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.130766 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 4617bb8a015d42188beba9df61df2c9f (DEFAULT_TABLE table=default.Table_a2e04dac18624961a57893dacef498b2 [id=d167abcc5579450c8d1850d50b1cf640]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.131033 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4617bb8a015d42188beba9df61df2c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.131747 12166 tablet_bootstrap.cc:654] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.132627 11830 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:54.133845 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d69d6037befe407fb135b49a041c690a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.133976 11922 raft_consensus.cc:3058] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.134995 11922 raft_consensus.cc:2466] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.135553 12173 tablet_replica.cc:331] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.135478 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_60a4efc645e04af28b8c457ac9dc440e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.135706 12173 raft_consensus.cc:2241] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.135798 12166 tablet_bootstrap.cc:492] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.135825 12173 raft_consensus.cc:2270] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.135921 12166 ts_tablet_manager.cc:1397] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
W20250625 14:01:54.135978 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60a4efc645e04af28b8c457ac9dc440e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.136411 12173 ts_tablet_manager.cc:1905] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.136503 12166 raft_consensus.cc:357] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.136617 12166 raft_consensus.cc:383] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.136658 12166 raft_consensus.cc:738] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.136821 12166 consensus_queue.cc:260] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.136976 12327 raft_consensus.cc:491] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.137053 12327 raft_consensus.cc:513] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.137301 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 4617bb8a015d42188beba9df61df2c9f (DEFAULT_TABLE table=default.Table_a2e04dac18624961a57893dacef498b2 [id=d167abcc5579450c8d1850d50b1cf640]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.137420 12327 leader_election.cc:290] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:54.137559 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4617bb8a015d42188beba9df61df2c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.137974 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8d6c5552b204ec1b2f5e4bf9eba5640" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:54.138417 11858 leader_election.cc:343] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.138876 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8d6c5552b204ec1b2f5e4bf9eba5640" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.139006 12166 ts_tablet_manager.cc:1428] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:54.139284 12173 ts_tablet_manager.cc:1918] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250625 14:01:54.139290 11855 leader_election.cc:343] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.139369 11855 leader_election.cc:304] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.139405 12173 log.cc:1199] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/470a4489d4284f909016c6c464a4ad12
I20250625 14:01:54.139626 12327 raft_consensus.cc:2747] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.139609 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 4a281b2956124ce4b9fd12560bf3d5c1 (table default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]). Expected version 1 got 0
I20250625 14:01:54.139652 12173 ts_tablet_manager.cc:1939] T 470a4489d4284f909016c6c464a4ad12 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.139896 12166 tablet_bootstrap.cc:492] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.140446 12173 tablet_replica.cc:331] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.140621 11717 leader_election.cc:304] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.141127 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_eb9b89668d974648ad501f6f3863cd81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.141505 12456 ts_manager.cc:194] Registered new tserver with Master: 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:01:54.141582 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb9b89668d974648ad501f6f3863cd81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.141825 12180 raft_consensus.cc:2802] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.141924 12180 raft_consensus.cc:695] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.142067 12180 consensus_queue.cc:237] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.142565 12166 tablet_bootstrap.cc:654] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.142863 12173 raft_consensus.cc:2241] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.143076 12173 raft_consensus.cc:2270] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.143994 12173 ts_tablet_manager.cc:1905] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.145296 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 4a281b2956124ce4b9fd12560bf3d5c1 (table default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]). Expected version 1 got 0
I20250625 14:01:54.145326 12175 tablet_replica.cc:331] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.145462 12175 raft_consensus.cc:2241] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.145570 12175 raft_consensus.cc:2270] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.146553 12173 ts_tablet_manager.cc:1918] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.147964 12456 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "bfff52620fea460d850827814b790c35" instance_seqno: 1750860112036552) as {username='slave'} at 127.11.39.130:55961; Asking this server to re-register.
I20250625 14:01:54.149557 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6e0ca353af7d4a4aa7179de57cc9c962"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.150012 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e0ca353af7d4a4aa7179de57cc9c962 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.149857 12178 raft_consensus.cc:491] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.150563 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 66cab8705ca2439abfa683f8b8b6dc45 (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:54.150576 12178 raft_consensus.cc:513] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:54.150700 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d9546e85eaa44e5f8150b46f556782bd because the tablet was not found. No further retry: Not found: Tablet not found: d9546e85eaa44e5f8150b46f556782bd
W20250625 14:01:54.150792 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9f306b943fbf4ccebc4e1c89934c7d88 because the tablet was not found. No further retry: Not found: Tablet not found: 9f306b943fbf4ccebc4e1c89934c7d88
W20250625 14:01:54.150872 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 910f1645f58b4066ae5c7c61e966e64c because the tablet was not found. No further retry: Not found: Tablet not found: 910f1645f58b4066ae5c7c61e966e64c
W20250625 14:01:54.150971 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet bc92f5f36ae94fe09b6017efc6ebbcaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc92f5f36ae94fe09b6017efc6ebbcaf already in progress: creating tablet
I20250625 14:01:54.151087 12178 leader_election.cc:290] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.151327 12173 log.cc:1199] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/33c895ed888b4cb8836f6a415d170c3e
I20250625 14:01:54.151475 11968 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:54.151607 12173 ts_tablet_manager.cc:1939] T 33c895ed888b4cb8836f6a415d170c3e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.153354 12456 ts_manager.cc:194] Registered new tserver with Master: bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.154181 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff54429a3d3e40688aaea56b70dcdfae" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.154227 12178 raft_consensus.cc:491] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.154345 12178 raft_consensus.cc:513] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.154726 12178 leader_election.cc:290] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.155561 12173 tablet_replica.cc:331] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.156738 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff54429a3d3e40688aaea56b70dcdfae" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.156929 11921 raft_consensus.cc:2391] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:54.157171 12173 raft_consensus.cc:2241] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.157317 12173 raft_consensus.cc:2270] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.157546 12456 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" instance_seqno: 1750860112228776) as {username='slave'} at 127.11.39.131:43785; Asking this server to re-register.
I20250625 14:01:54.157913 12173 ts_tablet_manager.cc:1905] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.158730 11858 consensus_peers.cc:487] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5a715b432704be2a9ca8bdca624bf70. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:54.160933 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 88261e6c75b24755852c22f3d9385347
I20250625 14:01:54.161227 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 88261e6c75b24755852c22f3d9385347 deleted and replaced by tablet 9da1d3ee457944399e60e0c5bdd8c428
I20250625 14:01:54.161480 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet fc2766f8e0b544b0b48a0e7e5952d672
I20250625 14:01:54.161707 11529 catalog_manager.cc:6652] ReplaceTablet: tablet fc2766f8e0b544b0b48a0e7e5952d672 deleted and replaced by tablet 68a0cfeac48042bdaea66c3b0e370480
W20250625 14:01:54.166404 11993 leader_election.cc:343] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 20fb7745d76c431f822258879e7d7134
W20250625 14:01:54.166517 11990 leader_election.cc:343] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 0996320cbc83480cbb4d53248efacffd
I20250625 14:01:54.166620 11990 leader_election.cc:304] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.166777 12178 raft_consensus.cc:2747] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.166903 11990 leader_election.cc:304] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.167065 12178 raft_consensus.cc:3058] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:54.167167 11990 leader_election.cc:343] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 20fb7745d76c431f822258879e7d7134
I20250625 14:01:54.167223 11990 leader_election.cc:304] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.167620 12103 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:54.168125 12178 raft_consensus.cc:2747] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.168272 12178 raft_consensus.cc:2747] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.169723 12173 ts_tablet_manager.cc:1918] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.172534 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 082a46d213c545b18acbcac1b699d140 (table default.Table_6c2e6fedb8a74a829bc14d61bf626ed8 [id=68e1633962a6404c94ddcdde634c23e0]) successfully deleted
I20250625 14:01:54.171936 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.172744 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 470a4489d4284f909016c6c464a4ad12 (table default.Table_657545d883ec472983269ce0bbcd63ff [id=e67edee2642447d583e7ca5b97ec0213]) successfully deleted
I20250625 14:01:54.172803 12173 log.cc:1199] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/59c3dd659e8048edac846083a0ff03aa
I20250625 14:01:54.172880 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 33c895ed888b4cb8836f6a415d170c3e (table default.Table_ed4f16f35df243efae3f4c6bfff51566 [id=eee318a7a56c49c49f18e4e03248ceef]) successfully deleted
W20250625 14:01:54.173022 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4031eab780324944bc63fc77848fb209 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4031eab780324944bc63fc77848fb209 already in progress: creating tablet
I20250625 14:01:54.173071 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3094232349684556b7c1c091fe59af2b" } new_table_name: "default.Table_b5db9b5292a6461bac446f5ebc358c27" modify_external_catalogs: true
I20250625 14:01:54.173182 12173 ts_tablet_manager.cc:1939] T 59c3dd659e8048edac846083a0ff03aa P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.173854 12173 tablet_replica.cc:331] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.173997 12173 raft_consensus.cc:2241] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.174132 12173 raft_consensus.cc:2270] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.174103 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_56b605b35a0d4335b2916c5748f8ab38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.174136 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 10506b2cb6c5468daa6ef270b6ed2d4d (DEFAULT_TABLE table=default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346 [id=62eeb40941e44946a64d1067d3d44dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.174470 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10506b2cb6c5468daa6ef270b6ed2d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.174487 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 88261e6c75b24755852c22f3d9385347 with delete_type TABLET_DATA_DELETED (replaced by tablet 9da1d3ee457944399e60e0c5bdd8c428) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:54.174520 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56b605b35a0d4335b2916c5748f8ab38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.174649 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 with delete_type TABLET_DATA_DELETED (replaced by tablet 68a0cfeac48042bdaea66c3b0e370480) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.175020 12173 ts_tablet_manager.cc:1905] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.177925 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 88261e6c75b24755852c22f3d9385347 with delete_type TABLET_DATA_DELETED (replaced by tablet 9da1d3ee457944399e60e0c5bdd8c428) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.178097 12177 tablet_replica.cc:331] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.178248 12177 raft_consensus.cc:2241] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.178431 12177 pending_rounds.cc:70] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:54.178468 12177 pending_rounds.cc:77] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523027327422464 op_type: NO_OP noop_request { }
I20250625 14:01:54.178483 11919 raft_consensus.cc:1273] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:54.178520 12177 raft_consensus.cc:2887] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.178572 12177 raft_consensus.cc:2270] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.178862 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 with delete_type TABLET_DATA_DELETED (replaced by tablet 68a0cfeac48042bdaea66c3b0e370480) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.179507 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 88261e6c75b24755852c22f3d9385347 with delete_type TABLET_DATA_DELETED (replaced by tablet 9da1d3ee457944399e60e0c5bdd8c428) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.179630 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 1 got 0
I20250625 14:01:54.179910 12456 ts_manager.cc:194] Registered new tserver with Master: 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:54.180663 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 59c3dd659e8048edac846083a0ff03aa (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:54.180861 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 with delete_type TABLET_DATA_DELETED (replaced by tablet 68a0cfeac48042bdaea66c3b0e370480) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.181290 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1aa440e8532d4a51a048ec92c4a363bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.181680 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1aa440e8532d4a51a048ec92c4a363bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.182687 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9a5399f5e7f14c7985451d22a883e2eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.183022 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a5399f5e7f14c7985451d22a883e2eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.183879 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d0f93962f9df42408804933938d2595c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.184187 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0f93962f9df42408804933938d2595c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.188666 12265 consensus_queue.cc:1035] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:54.190976 11717 consensus_peers.cc:487] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:54.191438 12173 ts_tablet_manager.cc:1918] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.191516 12173 log.cc:1199] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d9546e85eaa44e5f8150b46f556782bd
I20250625 14:01:54.191727 12173 ts_tablet_manager.cc:1939] T d9546e85eaa44e5f8150b46f556782bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.192152 12205 consensus_queue.cc:1035] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.192337 12173 tablet_replica.cc:331] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.192374 12175 ts_tablet_manager.cc:1905] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.192467 12173 raft_consensus.cc:2241] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.192575 12173 raft_consensus.cc:2270] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.193290 12265 raft_consensus.cc:491] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.193382 12265 raft_consensus.cc:513] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.193755 12265 leader_election.cc:290] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.194653 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4dfe24e8280c4675a5a6af9d32fa526e" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.194784 11784 raft_consensus.cc:2466] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.195156 11858 leader_election.cc:304] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.195351 12265 raft_consensus.cc:2802] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.195403 12265 raft_consensus.cc:491] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.195441 12265 raft_consensus.cc:3058] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.196398 12265 raft_consensus.cc:513] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.196741 12265 leader_election.cc:290] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.197435 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4dfe24e8280c4675a5a6af9d32fa526e" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.197553 11784 raft_consensus.cc:3058] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.198846 12327 raft_consensus.cc:491] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.198922 12327 raft_consensus.cc:513] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.199267 12327 leader_election.cc:290] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.200165 11784 raft_consensus.cc:2466] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:54.200486 11858 leader_election.cc:304] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.200471 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d9546e85eaa44e5f8150b46f556782bd (table default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]) successfully deleted
I20250625 14:01:54.200655 12558 raft_consensus.cc:2802] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.200753 12558 raft_consensus.cc:695] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.200847 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "169c59b473bd425296fa5bd9bbf2b616" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.200908 12558 consensus_queue.cc:237] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:54.201233 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 169c59b473bd425296fa5bd9bbf2b616 consensus state has no leader
I20250625 14:01:54.201948 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3a6be9f022c240baa90d4b38e252c01a" } new_table_name: "default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea" modify_external_catalogs: true
W20250625 14:01:54.202258 11858 leader_election.cc:343] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.202894 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cba0c23c2d6d4dfdb990086dc9ed2834" } new_table_name: "default.Table_e7750b507fd741bda3ad151860391100" modify_external_catalogs: true
I20250625 14:01:54.204059 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4167bf88496040c69601a4c80246ce36" } modify_external_catalogs: true
I20250625 14:01:54.204159 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4167bf88496040c69601a4c80246ce36" } modify_external_catalogs: true
I20250625 14:01:54.194068 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4dfe24e8280c4675a5a6af9d32fa526e" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.198176 12178 consensus_queue.cc:1035] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.198741 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4dfe24e8280c4675a5a6af9d32fa526e" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.202085 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "169c59b473bd425296fa5bd9bbf2b616" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.206084 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a2e04dac18624961a57893dacef498b2" } new_table_name: "default.Table_4c4a6ce84e424391a7e70a54a79913eb" modify_external_catalogs: true
W20250625 14:01:54.206125 11855 leader_election.cc:343] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.206367 12265 raft_consensus.cc:491] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.206462 12265 raft_consensus.cc:513] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.206799 12265 leader_election.cc:290] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:01:54.207194 11855 leader_election.cc:343] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.207270 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "165cc62292fc418890f253d87da10f51" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:54.207396 11855 leader_election.cc:343] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.207405 11782 raft_consensus.cc:2466] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.207454 11855 leader_election.cc:304] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.207854 11858 leader_election.cc:304] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.208041 12327 raft_consensus.cc:2747] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.208154 12327 raft_consensus.cc:2802] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.208200 12327 raft_consensus.cc:491] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.208247 12327 raft_consensus.cc:3058] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.209401 12327 raft_consensus.cc:513] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.209548 12167 tablet_bootstrap.cc:492] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.209656 12167 ts_tablet_manager.cc:1397] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.218s user 0.001s sys 0.000s
I20250625 14:01:54.209818 12327 leader_election.cc:290] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.210144 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "165cc62292fc418890f253d87da10f51" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.210247 12167 raft_consensus.cc:357] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.210379 12167 raft_consensus.cc:383] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.210417 12167 raft_consensus.cc:738] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.210530 12167 consensus_queue.cc:260] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.210786 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "165cc62292fc418890f253d87da10f51" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.210855 12167 ts_tablet_manager.cc:1428] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20250625 14:01:54.210891 11855 leader_election.cc:343] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.210915 11782 raft_consensus.cc:3058] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.211076 12167 tablet_bootstrap.cc:492] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.211275 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "165cc62292fc418890f253d87da10f51" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:54.211592 11855 leader_election.cc:343] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.212004 11782 raft_consensus.cc:2466] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:54.212210 12167 tablet_bootstrap.cc:654] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.212325 11858 leader_election.cc:304] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.212553 12265 raft_consensus.cc:2802] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.212646 12265 raft_consensus.cc:695] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.212814 12265 consensus_queue.cc:237] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.214697 12173 ts_tablet_manager.cc:1905] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.218356 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 (DEFAULT_TABLE table=default.Table_04bedd118b064b669bbd67a9e6017fba [id=1513365deec7433d8564e56a0dca7154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.218540 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 (DEFAULT_TABLE table=default.Table_04bedd118b064b669bbd67a9e6017fba [id=1513365deec7433d8564e56a0dca7154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.218667 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144ba67ce1fa419cac46e40ebcc078e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.218825 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144ba67ce1fa419cac46e40ebcc078e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.219033 11533 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 1 got 0
I20250625 14:01:54.219305 12173 ts_tablet_manager.cc:1918] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.219369 12173 log.cc:1199] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/000aa8550a8b4f96922312e84c518978
I20250625 14:01:54.219581 12173 ts_tablet_manager.cc:1939] T 000aa8550a8b4f96922312e84c518978 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.219542 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_59f8085ce25e47eea2c0e2308acc10f3" } new_table_name: "default.Table_3518ef32d62a474d95cb4a64a11f2309" modify_external_catalogs: true
I20250625 14:01:54.222342 12233 tablet.cc:1722] T 80f4e61e39894e88b3497328da8f7d01 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.222275 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_66c17881414348d49722f825bff86a90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.224386 12171 raft_consensus.cc:491] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.224486 12171 raft_consensus.cc:513] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.224881 12171 leader_election.cc:290] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.225328 12430 tablet.cc:1722] T 80f4e61e39894e88b3497328da8f7d01 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.227910 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb8c57c541114222b81dff868b1529f6" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.228346 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fb8c57c541114222b81dff868b1529f6" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.228498 11922 raft_consensus.cc:2391] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:54.229636 11990 leader_election.cc:304] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.229969 12171 raft_consensus.cc:3058] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.230854 12265 raft_consensus.cc:491] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.230942 12265 raft_consensus.cc:513] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.230993 12171 raft_consensus.cc:2747] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.231328 12265 leader_election.cc:290] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.232205 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d1c412286d94eedac62cf4f1f939f68" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:54.232542 11855 leader_election.cc:343] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.231727 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d1c412286d94eedac62cf4f1f939f68" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:54.234741 11858 leader_election.cc:343] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.234809 11858 leader_election.cc:304] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.234997 12265 raft_consensus.cc:2747] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.231575 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 (DEFAULT_TABLE table=default.Table_04bedd118b064b669bbd67a9e6017fba [id=1513365deec7433d8564e56a0dca7154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.235405 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 144ba67ce1fa419cac46e40ebcc078e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.235847 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 000aa8550a8b4f96922312e84c518978 (table default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
W20250625 14:01:54.236326 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 25160014ecf74c2ab6f1faca42d30c47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25160014ecf74c2ab6f1faca42d30c47 already in progress: creating tablet
I20250625 14:01:54.236532 12173 tablet_replica.cc:331] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.236663 12173 raft_consensus.cc:2241] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.236760 12173 raft_consensus.cc:2270] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.237373 12173 ts_tablet_manager.cc:1905] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.240406 12173 ts_tablet_manager.cc:1918] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.240483 12173 log.cc:1199] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0996320cbc83480cbb4d53248efacffd
I20250625 14:01:54.240681 12173 ts_tablet_manager.cc:1939] T 0996320cbc83480cbb4d53248efacffd P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:54.240860 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4617bb8a015d42188beba9df61df2c9f consensus state has no leader
I20250625 14:01:54.242246 12175 ts_tablet_manager.cc:1918] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.242988 12175 log.cc:1199] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d69d6037befe407fb135b49a041c690a
I20250625 14:01:54.243420 12175 ts_tablet_manager.cc:1939] T d69d6037befe407fb135b49a041c690a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.245193 12175 tablet_replica.cc:331] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.245522 12175 raft_consensus.cc:2241] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.245937 12175 pending_rounds.cc:70] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:54.246031 12175 pending_rounds.cc:77] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523027334848512 op_type: NO_OP noop_request { }
I20250625 14:01:54.246196 12175 raft_consensus.cc:2887] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.251300 12173 tablet_replica.cc:331] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.251492 12173 raft_consensus.cc:2241] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.244536 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d69d6037befe407fb135b49a041c690a (table default.Table_a13429dfda614c5c98a33e244bef1ba3 [id=a8a101206e2e4a35a3123e6f8a2074ce]) successfully deleted
I20250625 14:01:54.251601 12173 raft_consensus.cc:2270] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.251753 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0996320cbc83480cbb4d53248efacffd (table default.Table_72fe4368faa447cb81e9db0cad9a87e3 [id=8cc7744ad13545cba212ea3affd17d9d]) successfully deleted
W20250625 14:01:54.251914 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 25160014ecf74c2ab6f1faca42d30c47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25160014ecf74c2ab6f1faca42d30c47 already in progress: creating tablet
I20250625 14:01:54.252174 12173 ts_tablet_manager.cc:1905] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.252287 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66c17881414348d49722f825bff86a90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.253334 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6e0ca353af7d4a4aa7179de57cc9c962" } modify_external_catalogs: true
I20250625 14:01:54.253486 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6e0ca353af7d4a4aa7179de57cc9c962" } modify_external_catalogs: true
I20250625 14:01:54.255167 12173 ts_tablet_manager.cc:1918] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.255265 12173 log.cc:1199] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/20fb7745d76c431f822258879e7d7134
I20250625 14:01:54.255499 12173 ts_tablet_manager.cc:1939] T 20fb7745d76c431f822258879e7d7134 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.256209 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 20fb7745d76c431f822258879e7d7134 (table default.Table_493a555ade1e403cbd43a86a1c2dcbb2 [id=00cfe390d93041248a233d00e741acd6]) successfully deleted
I20250625 14:01:54.259006 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_eb9b89668d974648ad501f6f3863cd81" } modify_external_catalogs: true
I20250625 14:01:54.259137 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_eb9b89668d974648ad501f6f3863cd81" } modify_external_catalogs: true
W20250625 14:01:54.261245 12553 consensus_queue.cc:1162] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "56419e38d8e34f6985d4d970c1ce76e5" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:01:54.263093 12177 ts_tablet_manager.cc:1905] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.265456 12177 ts_tablet_manager.cc:1918] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.265558 12177 log.cc:1199] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/88261e6c75b24755852c22f3d9385347
I20250625 14:01:54.265815 12177 ts_tablet_manager.cc:1939] T 88261e6c75b24755852c22f3d9385347 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.266752 12173 tablet_replica.cc:331] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.266942 12173 raft_consensus.cc:2241] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.267122 12173 raft_consensus.cc:2270] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.267511 12173 ts_tablet_manager.cc:1905] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.266579 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7eee5c995064aacb406daddb888edb6 consensus state has no leader
I20250625 14:01:54.269918 12173 ts_tablet_manager.cc:1918] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.270011 12173 log.cc:1199] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e5a715b432704be2a9ca8bdca624bf70
I20250625 14:01:54.270248 12173 ts_tablet_manager.cc:1939] T e5a715b432704be2a9ca8bdca624bf70 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.272595 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e5a715b432704be2a9ca8bdca624bf70 (table default.Table_55c8f809888047139f479c0a5d5bafa0 [id=b3553dc46c8440619049d4adc450e003]) successfully deleted
W20250625 14:01:54.272785 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet bc92f5f36ae94fe09b6017efc6ebbcaf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc92f5f36ae94fe09b6017efc6ebbcaf already in progress: creating tablet
W20250625 14:01:54.272883 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 88261e6c75b24755852c22f3d9385347 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88261e6c75b24755852c22f3d9385347 already in progress: creating tablet
W20250625 14:01:54.272986 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet fc2766f8e0b544b0b48a0e7e5952d672 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc2766f8e0b544b0b48a0e7e5952d672 already in progress: creating tablet
I20250625 14:01:54.275033 12167 tablet_bootstrap.cc:492] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.275146 12167 ts_tablet_manager.cc:1397] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.000s
I20250625 14:01:54.275668 12167 raft_consensus.cc:357] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.275794 12167 raft_consensus.cc:383] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.275835 12167 raft_consensus.cc:738] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.275960 12167 consensus_queue.cc:260] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.276206 12167 ts_tablet_manager.cc:1428] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.276396 12167 tablet_bootstrap.cc:492] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.277424 12167 tablet_bootstrap.cc:654] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.277660 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4f90b19d20404564bb50d83322939821" } modify_external_catalogs: true
I20250625 14:01:54.277824 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4f90b19d20404564bb50d83322939821" } modify_external_catalogs: true
I20250625 14:01:54.275544 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 88261e6c75b24755852c22f3d9385347 (table default.Table_29b36939592445fa8336a104142a6d44 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
W20250625 14:01:54.280074 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet fc2766f8e0b544b0b48a0e7e5952d672 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc2766f8e0b544b0b48a0e7e5952d672 already in progress: creating tablet
I20250625 14:01:54.281183 12172 tablet_bootstrap.cc:492] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.281297 12172 ts_tablet_manager.cc:1397] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.284s user 0.000s sys 0.002s
I20250625 14:01:54.281806 12172 raft_consensus.cc:357] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.281921 12172 raft_consensus.cc:383] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.281955 12172 raft_consensus.cc:738] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.282109 12172 consensus_queue.cc:260] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.282714 12175 raft_consensus.cc:2270] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:54.254968 12554 consensus_queue.cc:1162] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfff52620fea460d850827814b790c35" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:01:54.283601 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_154ef6ebeb3243549454095410cf6797" } modify_external_catalogs: true
I20250625 14:01:54.283741 12172 ts_tablet_manager.cc:1428] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:54.283840 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_154ef6ebeb3243549454095410cf6797" } modify_external_catalogs: true
I20250625 14:01:54.283960 12172 tablet_bootstrap.cc:492] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.284795 12175 ts_tablet_manager.cc:1905] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.284914 12172 tablet_bootstrap.cc:654] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.285477 12265 raft_consensus.cc:491] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.285571 12265 raft_consensus.cc:513] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.285931 12265 leader_election.cc:290] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.286414 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0221dbcbca5f44df8612fc5d1714b9a3" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:54.286900 11855 leader_election.cc:343] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.286949 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0221dbcbca5f44df8612fc5d1714b9a3" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.287091 11783 raft_consensus.cc:2466] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.287379 11858 leader_election.cc:304] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.287602 12265 raft_consensus.cc:2802] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.287660 12265 raft_consensus.cc:491] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.287716 12265 raft_consensus.cc:3058] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.288055 12167 tablet_bootstrap.cc:492] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.288161 12167 ts_tablet_manager.cc:1397] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250625 14:01:54.288682 12167 raft_consensus.cc:357] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.288720 12265 raft_consensus.cc:513] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.288798 12167 raft_consensus.cc:383] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.288841 12167 raft_consensus.cc:738] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.288993 12167 consensus_queue.cc:260] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.289103 12265 leader_election.cc:290] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.289510 12175 ts_tablet_manager.cc:1918] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.289565 12166 tablet_bootstrap.cc:492] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.289677 12166 ts_tablet_manager.cc:1397] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.150s user 0.002s sys 0.000s
I20250625 14:01:54.290151 12166 raft_consensus.cc:357] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.290258 12166 raft_consensus.cc:383] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.290289 12166 raft_consensus.cc:738] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.290442 12166 consensus_queue.cc:260] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.290674 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0221dbcbca5f44df8612fc5d1714b9a3" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.290728 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0221dbcbca5f44df8612fc5d1714b9a3" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.290769 12166 ts_tablet_manager.cc:1428] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.290799 11783 raft_consensus.cc:3058] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.290967 12166 tablet_bootstrap.cc:492] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.291764 11783 raft_consensus.cc:2466] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:54.291960 12166 tablet_bootstrap.cc:654] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:54.292634 11855 leader_election.cc:343] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.292774 12167 ts_tablet_manager.cc:1428] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:01:54.292935 11858 leader_election.cc:304] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.293239 12327 raft_consensus.cc:2802] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.293334 12327 raft_consensus.cc:695] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.293470 12327 consensus_queue.cc:237] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.292999 12167 tablet_bootstrap.cc:492] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.295033 12167 tablet_bootstrap.cc:654] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.298682 12172 tablet_bootstrap.cc:492] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.298799 12172 ts_tablet_manager.cc:1397] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20250625 14:01:54.299321 12172 raft_consensus.cc:357] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.299444 12172 raft_consensus.cc:383] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.299486 12172 raft_consensus.cc:738] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.299613 12172 consensus_queue.cc:260] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.299947 12172 ts_tablet_manager.cc:1428] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:54.300150 12172 tablet_bootstrap.cc:492] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.301208 12172 tablet_bootstrap.cc:654] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.303642 12030 tablet_service.cc:1468] Processing CreateTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa (DEFAULT_TABLE table=default.Table_6e0ca353af7d4a4aa7179de57cc9c962 [id=a4aac54fe4334c33b6fdbb81c472f827]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.303949 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.304594 12171 consensus_queue.cc:1035] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.307291 12205 consensus_queue.cc:1035] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.310806 11526 catalog_manager.cc:5582] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:54.311132 11526 catalog_manager.cc:5582] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:54.311280 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet ff54429a3d3e40688aaea56b70dcdfae (table default.Table_c462a6e6fe9f4090a80e61f9af07fc6e [id=8302b2a44b004bdab1aa2f67bb82ad01]). Expected version 1 got 0
I20250625 14:01:54.311410 11526 catalog_manager.cc:5582] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:54.311544 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_3a6be9f022c240baa90d4b38e252c01a [id=9bd1814bba0a43fa8a66a50e91ef165f]). Expected version 1 got 0
I20250625 14:01:54.311630 12172 tablet_bootstrap.cc:492] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.311640 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 53bea49e49d64c7a82c96535db09c87d (table default.Table_31fa2df49e0641a3bec420da08de1070 [id=4bdc41d7138c4a099d95a82864c85d8e]). Expected version 1 got 0
I20250625 14:01:54.311743 12172 ts_tablet_manager.cc:1397] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20250625 14:01:54.311847 11526 catalog_manager.cc:5582] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:54.312506 12172 raft_consensus.cc:357] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.312625 12172 raft_consensus.cc:383] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.312659 12172 raft_consensus.cc:738] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
W20250625 14:01:54.312747 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb8c57c541114222b81dff868b1529f6 consensus state has no leader
I20250625 14:01:54.312778 12172 consensus_queue.cc:260] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:54.313023 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb7bbd1c627f4da6b2e1812eed472c83 consensus state has no leader
I20250625 14:01:54.313879 12172 ts_tablet_manager.cc:1428] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250625 14:01:54.314106 12172 tablet_bootstrap.cc:492] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.315793 12265 raft_consensus.cc:491] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.315915 12265 raft_consensus.cc:513] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.316365 12265 leader_election.cc:290] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.316555 12172 tablet_bootstrap.cc:654] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.316740 12205 raft_consensus.cc:491] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.316829 12205 raft_consensus.cc:513] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.316928 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f6b666bfd4f141db89a35fa818edb378" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.317034 11783 raft_consensus.cc:2466] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.317193 12205 leader_election.cc:290] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.317405 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f6b666bfd4f141db89a35fa818edb378" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.317479 11858 leader_election.cc:304] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.317952 12265 raft_consensus.cc:2802] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 14:01:54.317979 11855 leader_election.cc:343] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.318034 12265 raft_consensus.cc:491] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.318076 12265 raft_consensus.cc:3058] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.319200 12265 raft_consensus.cc:513] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.319586 12265 leader_election.cc:290] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.320123 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f6b666bfd4f141db89a35fa818edb378" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.320252 11783 raft_consensus.cc:3058] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.321218 11783 raft_consensus.cc:2466] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:54.321580 11858 leader_election.cc:304] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.322118 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f6b666bfd4f141db89a35fa818edb378" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.322417 11895 tablet_service.cc:1468] Processing CreateTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa (DEFAULT_TABLE table=default.Table_6e0ca353af7d4a4aa7179de57cc9c962 [id=a4aac54fe4334c33b6fdbb81c472f827]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.322726 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.322738 11855 leader_election.cc:343] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.326398 12265 raft_consensus.cc:2802] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.326515 12265 raft_consensus.cc:695] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.326651 12265 consensus_queue.cc:237] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.326877 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6b4141fcafbc4a6f96504bf47539b8ae
I20250625 14:01:54.326968 12172 tablet_bootstrap.cc:492] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.327060 12172 ts_tablet_manager.cc:1397] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20250625 14:01:54.327617 12172 raft_consensus.cc:357] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.327764 12172 raft_consensus.cc:383] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.327805 12172 raft_consensus.cc:738] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.327950 12172 consensus_queue.cc:260] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.328276 12172 ts_tablet_manager.cc:1428] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.328493 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.329996 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:54.330556 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 6b4141fcafbc4a6f96504bf47539b8ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b4141fcafbc4a6f96504bf47539b8ae already in progress: creating tablet
I20250625 14:01:54.331192 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f6b666bfd4f141db89a35fa818edb378" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.331252 11757 tablet_service.cc:1468] Processing CreateTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa (DEFAULT_TABLE table=default.Table_6e0ca353af7d4a4aa7179de57cc9c962 [id=a4aac54fe4334c33b6fdbb81c472f827]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.331282 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f6b666bfd4f141db89a35fa818edb378" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.331935 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:54.332185 11717 leader_election.cc:343] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.332331 11717 leader_election.cc:304] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:54.332468 12205 raft_consensus.cc:2747] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.333294 12205 consensus_queue.cc:1035] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.334504 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.336699 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6b4141fcafbc4a6f96504bf47539b8ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b4141fcafbc4a6f96504bf47539b8ae already in progress: creating tablet
I20250625 14:01:54.336970 12172 tablet_bootstrap.cc:492] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.337037 12030 tablet_service.cc:1468] Processing CreateTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 (DEFAULT_TABLE table=default.Table_eb9b89668d974648ad501f6f3863cd81 [id=fe0b85589c3e4db4b88979ef94ffec30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.337404 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac4b7bbfad9493598b31a86e2c045c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.338207 12172 tablet_bootstrap.cc:654] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.339310 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 0e6599cf920c4c8b8ed17ecad1a31338 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.340539 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 8a4d01792d40471ab6d5bafa1a308351 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.341638 12205 consensus_queue.cc:1035] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.342489 11895 tablet_service.cc:1468] Processing CreateTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 (DEFAULT_TABLE table=default.Table_eb9b89668d974648ad501f6f3863cd81 [id=fe0b85589c3e4db4b88979ef94ffec30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.342797 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac4b7bbfad9493598b31a86e2c045c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.344153 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (DEFAULT_TABLE table=default.Table_60a4efc645e04af28b8c457ac9dc440e [id=1d4a1c31c04f4945a30ae7cf98f65c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.344419 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2fd4408e4f4f06b5a1bc686402ee40. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.345074 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (DEFAULT_TABLE table=default.Table_60a4efc645e04af28b8c457ac9dc440e [id=1d4a1c31c04f4945a30ae7cf98f65c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.345446 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 92984f3be8454a969b7c39af97a11479 (DEFAULT_TABLE table=default.Table_0c2c0733750c4e89ac465c192b8c27bd [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.345695 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92984f3be8454a969b7c39af97a11479. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.345772 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2fd4408e4f4f06b5a1bc686402ee40. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.348059 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.348199 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.348330 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a0cfeac48042bdaea66c3b0e370480. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.348433 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a0cfeac48042bdaea66c3b0e370480. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.349870 12175 log.cc:1199] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/bb24e0ce060c486bae8135e46827d956
I20250625 14:01:54.350188 12175 ts_tablet_manager.cc:1939] T bb24e0ce060c486bae8135e46827d956 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.350880 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 (DEFAULT_TABLE table=default.Table_29b36939592445fa8336a104142a6d44 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.351269 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1a5cdbf81fcc4467907332b8969e5d0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.351389 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9da1d3ee457944399e60e0c5bdd8c428. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.351436 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 (DEFAULT_TABLE table=default.Table_29b36939592445fa8336a104142a6d44 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:54.351682 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a5cdbf81fcc4467907332b8969e5d0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.352258 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 92984f3be8454a969b7c39af97a11479 (DEFAULT_TABLE table=default.Table_0c2c0733750c4e89ac465c192b8c27bd [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.353534 11757 tablet_service.cc:1468] Processing CreateTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 (DEFAULT_TABLE table=default.Table_eb9b89668d974648ad501f6f3863cd81 [id=fe0b85589c3e4db4b88979ef94ffec30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.353677 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 92984f3be8454a969b7c39af97a11479 (DEFAULT_TABLE table=default.Table_0c2c0733750c4e89ac465c192b8c27bd [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.353807 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac4b7bbfad9493598b31a86e2c045c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.353919 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92984f3be8454a969b7c39af97a11479. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.354393 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9da1d3ee457944399e60e0c5bdd8c428. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.355422 11517 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet b7eee5c995064aacb406daddb888edb6 (table default.Table_3518ef32d62a474d95cb4a64a11f2309 [id=05ba3fb82ea74715a67dbefb3018db83], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet b7eee5c995064aacb406daddb888edb6 consensus state has no leader
I20250625 14:01:54.355538 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet bb24e0ce060c486bae8135e46827d956 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]) successfully deleted
I20250625 14:01:54.353534 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (DEFAULT_TABLE table=default.Table_60a4efc645e04af28b8c457ac9dc440e [id=1d4a1c31c04f4945a30ae7cf98f65c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.356108 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2fd4408e4f4f06b5a1bc686402ee40. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.356071 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.356330 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68a0cfeac48042bdaea66c3b0e370480. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.356498 12175 tablet_replica.cc:331] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.356655 12175 raft_consensus.cc:2241] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.356808 12172 tablet_bootstrap.cc:492] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.356832 12175 pending_rounds.cc:70] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:54.356920 12172 ts_tablet_manager.cc:1397] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250625 14:01:54.356981 12175 pending_rounds.cc:77] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523028283510784 op_type: NO_OP noop_request { }
I20250625 14:01:54.357079 12175 raft_consensus.cc:2887] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.357152 12175 raft_consensus.cc:2270] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.357487 12172 raft_consensus.cc:357] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.357609 12172 raft_consensus.cc:383] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.357654 12172 raft_consensus.cc:738] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.357792 12172 consensus_queue.cc:260] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.357949 12175 ts_tablet_manager.cc:1905] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.358754 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 (DEFAULT_TABLE table=default.Table_29b36939592445fa8336a104142a6d44 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.358847 12166 tablet_bootstrap.cc:492] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.358826 12178 consensus_queue.cc:1035] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.358928 12166 ts_tablet_manager.cc:1397] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.000s
I20250625 14:01:54.359006 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9da1d3ee457944399e60e0c5bdd8c428. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.359418 12166 raft_consensus.cc:357] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.359515 12166 raft_consensus.cc:383] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.359551 12166 raft_consensus.cc:738] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.359680 12166 consensus_queue.cc:260] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.359995 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92984f3be8454a969b7c39af97a11479. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.359999 12166 ts_tablet_manager.cc:1428] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.361183 12166 tablet_bootstrap.cc:492] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.361256 12178 raft_consensus.cc:491] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.361353 12178 raft_consensus.cc:513] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.361727 12178 leader_election.cc:290] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.362208 12166 tablet_bootstrap.cc:654] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.362275 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb7bbd1c627f4da6b2e1812eed472c83" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.362586 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb7bbd1c627f4da6b2e1812eed472c83" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.363229 12558 raft_consensus.cc:491] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.363309 12558 raft_consensus.cc:513] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.363672 12558 leader_election.cc:290] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.363729 12208 consensus_queue.cc:1035] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.364008 12208 consensus_queue.cc:1035] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.364295 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4a281b2956124ce4b9fd12560bf3d5c1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.364583 11990 leader_election.cc:304] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:01:54.364960 11855 leader_election.cc:343] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.364998 12171 raft_consensus.cc:2747] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.365648 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4a281b2956124ce4b9fd12560bf3d5c1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:54.367341 11858 leader_election.cc:343] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.367415 11858 leader_election.cc:304] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.367630 12558 raft_consensus.cc:2747] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.369777 12057 raft_consensus.cc:3058] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.370023 12233 tablet.cc:1722] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.372346 12558 consensus_queue.cc:1035] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.373306 12172 ts_tablet_manager.cc:1428] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20250625 14:01:54.373458 12430 tablet.cc:1722] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.373538 12172 tablet_bootstrap.cc:492] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.375835 12172 tablet_bootstrap.cc:654] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.376488 12175 ts_tablet_manager.cc:1918] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.376574 12175 log.cc:1199] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f6b666bfd4f141db89a35fa818edb378
I20250625 14:01:54.377884 12175 ts_tablet_manager.cc:1939] T f6b666bfd4f141db89a35fa818edb378 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.378641 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f6b666bfd4f141db89a35fa818edb378 (table default.Table_8029b9c972e547b0aa052cd38040c777 [id=8e84fd2f33444bdf85d58b0721a0080e]) successfully deleted
I20250625 14:01:54.378962 12175 tablet_replica.cc:331] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.379163 12175 raft_consensus.cc:2241] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.379319 12175 raft_consensus.cc:2270] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.380386 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e2d752997eb84bdc9bc702cc0afc16e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.380815 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2d752997eb84bdc9bc702cc0afc16e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.383081 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9d8bbe1212a7438f9a06cc1a18c6e40a
I20250625 14:01:54.383541 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4024f05f2d0245da8ef8d15052d80282"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.383914 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4024f05f2d0245da8ef8d15052d80282 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.386513 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.386993 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:54.387501 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8bbe1212a7438f9a06cc1a18c6e40a already in progress: creating tablet
I20250625 14:01:54.389874 12175 ts_tablet_manager.cc:1905] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.390261 12584 tablet.cc:1722] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.391376 12055 raft_consensus.cc:3058] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.392822 12166 tablet_bootstrap.cc:492] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.392928 12166 ts_tablet_manager.cc:1397] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:01:54.393311 12238 consensus_queue.cc:1035] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.393414 12166 raft_consensus.cc:357] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.393520 12166 raft_consensus.cc:383] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.393550 12166 raft_consensus.cc:738] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.393669 12166 consensus_queue.cc:260] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.393935 12166 ts_tablet_manager.cc:1428] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.394132 12166 tablet_bootstrap.cc:492] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.395752 12172 tablet_bootstrap.cc:492] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.395855 12172 ts_tablet_manager.cc:1397] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:01:54.396385 12172 raft_consensus.cc:357] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.396504 12172 raft_consensus.cc:383] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.396544 12172 raft_consensus.cc:738] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.396668 12172 consensus_queue.cc:260] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.396946 12172 ts_tablet_manager.cc:1428] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.397146 12172 tablet_bootstrap.cc:492] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.398216 12172 tablet_bootstrap.cc:654] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.399586 12265 consensus_queue.cc:1035] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.401819 12175 ts_tablet_manager.cc:1918] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.402074 12175 log.cc:1199] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/4031eab780324944bc63fc77848fb209
I20250625 14:01:54.403548 12175 ts_tablet_manager.cc:1939] T 4031eab780324944bc63fc77848fb209 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.404793 12166 tablet_bootstrap.cc:654] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.405973 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 4031eab780324944bc63fc77848fb209 (table default.Table_73d3dbf418e2463ba09893538dd70097 [id=3ef8fa0543a14c90b4c42e770323f83f]) successfully deleted
I20250625 14:01:54.406524 12172 tablet_bootstrap.cc:492] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.406625 12172 ts_tablet_manager.cc:1397] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:54.407006 12265 raft_consensus.cc:491] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.407101 12265 raft_consensus.cc:513] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.407196 12172 raft_consensus.cc:357] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.407306 12172 raft_consensus.cc:383] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.407339 12172 raft_consensus.cc:738] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.407459 12172 consensus_queue.cc:260] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.407510 12265 leader_election.cc:290] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.407739 12172 ts_tablet_manager.cc:1428] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.407989 12172 tablet_bootstrap.cc:492] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.408564 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64b3b045e4f3424f86f473c2ad351b9c" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.408708 11783 raft_consensus.cc:2466] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.409122 12172 tablet_bootstrap.cc:654] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.409370 11858 leader_election.cc:304] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.409451 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64b3b045e4f3424f86f473c2ad351b9c" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:54.410002 11855 leader_election.cc:343] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.410924 12167 tablet_bootstrap.cc:492] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.411057 12167 ts_tablet_manager.cc:1397] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.118s user 0.000s sys 0.002s
I20250625 14:01:54.411307 12265 raft_consensus.cc:2802] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.411381 12265 raft_consensus.cc:491] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.411422 12265 raft_consensus.cc:3058] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.411537 12167 raft_consensus.cc:357] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.411620 12167 raft_consensus.cc:383] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.411641 12167 raft_consensus.cc:738] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.411754 12167 consensus_queue.cc:260] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.412009 12167 ts_tablet_manager.cc:1428] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:54.412154 12167 tablet_bootstrap.cc:492] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.412464 12265 raft_consensus.cc:513] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.412875 12265 leader_election.cc:290] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.413012 12167 tablet_bootstrap.cc:654] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.413285 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64b3b045e4f3424f86f473c2ad351b9c" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:54.413678 11855 leader_election.cc:343] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.413823 12205 raft_consensus.cc:491] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.413928 12205 raft_consensus.cc:513] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.414347 12205 leader_election.cc:290] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.414891 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.415066 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "64b3b045e4f3424f86f473c2ad351b9c" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.415117 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53bea49e49d64c7a82c96535db09c87d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.415174 11782 raft_consensus.cc:3058] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.415239 11920 raft_consensus.cc:2466] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.416203 11782 raft_consensus.cc:2466] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:54.416445 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53bea49e49d64c7a82c96535db09c87d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:54.416877 11717 leader_election.cc:343] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.418089 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet aac4b7bbfad9493598b31a86e2c045c0
I20250625 14:01:54.418550 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet b7eee5c995064aacb406daddb888edb6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.418902 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.419377 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d4a1580aeb4a4c1787c32b4d23e0fcaa
I20250625 14:01:54.419723 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 812d9a36acf644c99edfbf55086f9b25 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.420331 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.421001 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0e6599cf920c4c8b8ed17ecad1a31338
W20250625 14:01:54.421043 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a1580aeb4a4c1787c32b4d23e0fcaa already in progress: creating tablet
I20250625 14:01:54.421272 11528 catalog_manager.cc:6652] ReplaceTablet: tablet 0e6599cf920c4c8b8ed17ecad1a31338 deleted and replaced by tablet 6bcdf4d901e34ab5ba2c36fe53456f0e
I20250625 14:01:54.421416 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet ab957f1fd4214efbb6233f312617c728 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.421432 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.422394 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8a54b321a8a040eb9fbd1f842aa17161"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.422765 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a54b321a8a040eb9fbd1f842aa17161 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.424427 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 80f4e61e39894e88b3497328da8f7d01 (table default.Table_49966ab9cf1c45feb28e95ae79153e6e [id=0071abfe5ba94050bfc65317fae65385]). Expected version 1 got 0
I20250625 14:01:54.424535 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet ff54429a3d3e40688aaea56b70dcdfae (table default.Table_c462a6e6fe9f4090a80e61f9af07fc6e [id=8302b2a44b004bdab1aa2f67bb82ad01]). Expected version 1 got 0
I20250625 14:01:54.424913 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 80f4e61e39894e88b3497328da8f7d01 (table default.Table_49966ab9cf1c45feb28e95ae79153e6e [id=0071abfe5ba94050bfc65317fae65385]). Expected version 1 got 0
I20250625 14:01:54.425034 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 1 got 0
I20250625 14:01:54.425417 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_602e5344bce84d3f81394779588ad1c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.425510 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:54.425791 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_602e5344bce84d3f81394779588ad1c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.426390 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.426676 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 165cc62292fc418890f253d87da10f51
I20250625 14:01:54.427078 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_657545d883ec472983269ce0bbcd63ff" } new_table_name: "default.Table_e4729036527243a1b64bf5c9b7a4a5e1" modify_external_catalogs: true
I20250625 14:01:54.427922 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.428352 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 0e6599cf920c4c8b8ed17ecad1a31338 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bcdf4d901e34ab5ba2c36fe53456f0e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.428427 11717 leader_election.cc:304] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.428514 12177 tablet_replica.cc:331] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.428637 12177 raft_consensus.cc:2241] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.428767 12177 raft_consensus.cc:2270] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.429157 12205 raft_consensus.cc:2802] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.429214 12205 raft_consensus.cc:491] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.429268 12205 raft_consensus.cc:3058] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.429462 12177 ts_tablet_manager.cc:1905] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.430362 12205 raft_consensus.cc:513] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.430761 12205 leader_election.cc:290] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:54.431787 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8bbe1212a7438f9a06cc1a18c6e40a already in progress: creating tablet
I20250625 14:01:54.431898 12177 ts_tablet_manager.cc:1918] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.431986 12177 log.cc:1199] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0e6599cf920c4c8b8ed17ecad1a31338
W20250625 14:01:54.432044 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet aac4b7bbfad9493598b31a86e2c045c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aac4b7bbfad9493598b31a86e2c045c0 already in progress: creating tablet
W20250625 14:01:54.432201 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a1580aeb4a4c1787c32b4d23e0fcaa already in progress: creating tablet
I20250625 14:01:54.432287 12177 ts_tablet_manager.cc:1939] T 0e6599cf920c4c8b8ed17ecad1a31338 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.433465 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 0e6599cf920c4c8b8ed17ecad1a31338 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bcdf4d901e34ab5ba2c36fe53456f0e) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:54.433547 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet aac4b7bbfad9493598b31a86e2c045c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aac4b7bbfad9493598b31a86e2c045c0 already in progress: creating tablet
I20250625 14:01:54.434219 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_aad2dbed98a440f19cf6aa8608d96780"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.434721 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aad2dbed98a440f19cf6aa8608d96780 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.435169 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 165cc62292fc418890f253d87da10f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.435984 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 165cc62292fc418890f253d87da10f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.436149 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.436265 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet d69d6037befe407fb135b49a041c690a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.436278 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53bea49e49d64c7a82c96535db09c87d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.436396 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet bb24e0ce060c486bae8135e46827d956 with delete_type TABLET_DATA_DELETED (replaced by tablet a8d6c5552b204ec1b2f5e4bf9eba5640) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.436492 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.436504 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53bea49e49d64c7a82c96535db09c87d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.436630 11920 raft_consensus.cc:3058] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.436652 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet c5e5954a01aa472999e9ac079f706f4b with delete_type TABLET_DATA_DELETED (replaced by tablet ef65dc31dc5843fb9e25275af5935e73) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.436687 12177 tablet_replica.cc:331] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.436786 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet f6b666bfd4f141db89a35fa818edb378 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.436843 12177 raft_consensus.cc:2241] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.436954 12177 raft_consensus.cc:2270] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.436699 12208 consensus_queue.cc:1035] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250625 14:01:54.437496 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 165cc62292fc418890f253d87da10f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.437749 11920 raft_consensus.cc:2466] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.438043 12177 ts_tablet_manager.cc:1905] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.439441 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 165cc62292fc418890f253d87da10f51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 165cc62292fc418890f253d87da10f51 already in progress: creating tablet
I20250625 14:01:54.440618 12177 ts_tablet_manager.cc:1918] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.440704 12177 log.cc:1199] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/165cc62292fc418890f253d87da10f51
I20250625 14:01:54.440904 12177 ts_tablet_manager.cc:1939] T 165cc62292fc418890f253d87da10f51 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.441143 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 0e6599cf920c4c8b8ed17ecad1a31338 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bcdf4d901e34ab5ba2c36fe53456f0e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.441254 11717 leader_election.cc:304] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.441355 12173 tablet_replica.cc:331] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:01:54.441443 11717 leader_election.cc:343] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.441488 12173 raft_consensus.cc:2241] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.441617 12173 raft_consensus.cc:2270] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.441807 12205 raft_consensus.cc:2802] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.441895 12205 raft_consensus.cc:695] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.442040 12205 consensus_queue.cc:237] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.442281 12173 ts_tablet_manager.cc:1905] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.444626 12173 ts_tablet_manager.cc:1918] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.444710 12173 log.cc:1199] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0e6599cf920c4c8b8ed17ecad1a31338
I20250625 14:01:54.444939 12173 ts_tablet_manager.cc:1939] T 0e6599cf920c4c8b8ed17ecad1a31338 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.445541 11858 leader_election.cc:304] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.445899 12327 raft_consensus.cc:491] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.446009 12327 raft_consensus.cc:513] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.446194 12177 tablet_replica.cc:331] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.446379 12600 raft_consensus.cc:2802] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.446431 12327 leader_election.cc:290] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.446471 12600 raft_consensus.cc:695] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.446566 12177 raft_consensus.cc:2241] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.446619 12600 consensus_queue.cc:237] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.446774 12177 raft_consensus.cc:2270] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.447468 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5e5954a01aa472999e9ac079f706f4b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.447563 12177 ts_tablet_manager.cc:1905] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.447814 11855 leader_election.cc:343] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.447947 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0e6599cf920c4c8b8ed17ecad1a31338 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
W20250625 14:01:54.449458 11717 consensus_peers.cc:487] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:54.450032 12177 ts_tablet_manager.cc:1918] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.450199 12177 log.cc:1199] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/4dfe24e8280c4675a5a6af9d32fa526e
I20250625 14:01:54.450518 12177 ts_tablet_manager.cc:1939] T 4dfe24e8280c4675a5a6af9d32fa526e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.451093 12600 raft_consensus.cc:491] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.451202 12600 raft_consensus.cc:513] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.451581 12177 tablet_replica.cc:331] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.451619 12600 leader_election.cc:290] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.451771 12177 raft_consensus.cc:2241] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.451964 12177 pending_rounds.cc:70] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:54.452047 12177 pending_rounds.cc:77] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523027528159232 op_type: NO_OP noop_request { }
I20250625 14:01:54.452142 12177 raft_consensus.cc:2887] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.452152 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44d41513c1d444cba5288a05f2c4652c" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.452230 12177 raft_consensus.cc:2270] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:54.452652 11855 leader_election.cc:343] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.452952 12177 ts_tablet_manager.cc:1905] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.453248 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44d41513c1d444cba5288a05f2c4652c" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.453370 12167 tablet_bootstrap.cc:492] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.453387 11784 raft_consensus.cc:2466] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.453464 12167 ts_tablet_manager.cc:1397] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.001s
I20250625 14:01:54.453455 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5e5954a01aa472999e9ac079f706f4b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.453547 11783 raft_consensus.cc:2466] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.454164 12167 raft_consensus.cc:357] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.454388 12167 raft_consensus.cc:383] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.454476 12167 raft_consensus.cc:738] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.454699 12167 consensus_queue.cc:260] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.455678 11858 leader_election.cc:304] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.455947 12600 raft_consensus.cc:2802] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.456025 12600 raft_consensus.cc:491] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.456076 12600 raft_consensus.cc:3058] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.456271 12167 ts_tablet_manager.cc:1428] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:54.456588 12167 tablet_bootstrap.cc:492] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.456693 12177 ts_tablet_manager.cc:1918] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.456812 12177 log.cc:1199] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d69d6037befe407fb135b49a041c690a
I20250625 14:01:54.457065 12600 raft_consensus.cc:513] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.457155 12177 ts_tablet_manager.cc:1939] T d69d6037befe407fb135b49a041c690a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.457437 12600 leader_election.cc:290] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.457782 11858 leader_election.cc:304] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.457891 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44d41513c1d444cba5288a05f2c4652c" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.458053 12600 raft_consensus.cc:2802] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.458098 12600 raft_consensus.cc:491] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.458132 12600 raft_consensus.cc:3058] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:54.458418 11855 leader_election.cc:343] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.459017 12600 raft_consensus.cc:513] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.459452 12600 leader_election.cc:290] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.459887 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44d41513c1d444cba5288a05f2c4652c" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.460021 11783 raft_consensus.cc:3058] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.459757 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5e5954a01aa472999e9ac079f706f4b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.460678 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c5e5954a01aa472999e9ac079f706f4b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.460783 11784 raft_consensus.cc:3058] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.461659 11784 raft_consensus.cc:2466] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:54.462406 11783 raft_consensus.cc:2466] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
W20250625 14:01:54.462564 11855 leader_election.cc:343] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.463312 11858 leader_election.cc:304] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.463527 11858 leader_election.cc:304] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.463698 12265 raft_consensus.cc:2802] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.463802 12558 raft_consensus.cc:2802] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.463855 12558 raft_consensus.cc:695] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.459414 12167 tablet_bootstrap.cc:654] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.463969 12558 consensus_queue.cc:237] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.464301 12177 tablet_replica.cc:331] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.464481 12177 raft_consensus.cc:2241] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.464632 12177 raft_consensus.cc:2270] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.464781 12265 raft_consensus.cc:695] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.464926 12265 consensus_queue.cc:237] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.465176 12177 ts_tablet_manager.cc:1905] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.465972 12175 tablet_replica.cc:331] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.466125 12175 raft_consensus.cc:2241] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.466295 12175 raft_consensus.cc:2270] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.466706 12175 ts_tablet_manager.cc:1905] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.467670 12233 tablet.cc:1722] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:54.468358 12584 tablet.cc:1722] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:54.471228 12177 ts_tablet_manager.cc:1918] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.471392 12177 log.cc:1199] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/bb24e0ce060c486bae8135e46827d956
I20250625 14:01:54.471678 12177 ts_tablet_manager.cc:1939] T bb24e0ce060c486bae8135e46827d956 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.472326 12175 ts_tablet_manager.cc:1918] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.472416 12175 log.cc:1199] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e5a715b432704be2a9ca8bdca624bf70
I20250625 14:01:54.472595 12177 tablet_replica.cc:331] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.472698 12175 ts_tablet_manager.cc:1939] T e5a715b432704be2a9ca8bdca624bf70 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.472828 12177 raft_consensus.cc:2241] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.473039 12177 raft_consensus.cc:2270] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.473443 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e5a715b432704be2a9ca8bdca624bf70 (table default.Table_55c8f809888047139f479c0a5d5bafa0 [id=b3553dc46c8440619049d4adc450e003]) successfully deleted
I20250625 14:01:54.473484 12177 ts_tablet_manager.cc:1905] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.473721 12175 tablet_replica.cc:331] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.473857 12175 raft_consensus.cc:2241] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.474016 12175 pending_rounds.cc:70] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:54.474053 12175 pending_rounds.cc:77] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523028849627136 op_type: NO_OP noop_request { }
I20250625 14:01:54.474120 12175 raft_consensus.cc:2887] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.474179 12175 raft_consensus.cc:2270] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.475283 12166 tablet_bootstrap.cc:492] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.475385 12166 ts_tablet_manager.cc:1397] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.000s
I20250625 14:01:54.475939 12166 raft_consensus.cc:357] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.476070 12166 raft_consensus.cc:383] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.476101 12166 raft_consensus.cc:738] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.476219 12166 consensus_queue.cc:260] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.476544 12166 ts_tablet_manager.cc:1428] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.476775 12166 tablet_bootstrap.cc:492] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.477763 12166 tablet_bootstrap.cc:654] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.477746 12177 ts_tablet_manager.cc:1918] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.477905 12177 log.cc:1199] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0221dbcbca5f44df8612fc5d1714b9a3
I20250625 14:01:54.478224 12177 ts_tablet_manager.cc:1939] T 0221dbcbca5f44df8612fc5d1714b9a3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.479017 12166 tablet_bootstrap.cc:492] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.479113 12166 ts_tablet_manager.cc:1397] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:54.479254 12177 tablet_replica.cc:331] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.479419 12177 raft_consensus.cc:2241] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.479565 12177 raft_consensus.cc:2270] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.479622 12166 raft_consensus.cc:357] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.479722 12166 raft_consensus.cc:383] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.479758 12166 raft_consensus.cc:738] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.479898 12166 consensus_queue.cc:260] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.480237 12166 ts_tablet_manager.cc:1428] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:54.480372 12177 ts_tablet_manager.cc:1905] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.480437 12166 tablet_bootstrap.cc:492] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.481431 12166 tablet_bootstrap.cc:654] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.483206 12177 ts_tablet_manager.cc:1918] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.483379 12177 log.cc:1199] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c5e5954a01aa472999e9ac079f706f4b
I20250625 14:01:54.483666 12177 ts_tablet_manager.cc:1939] T c5e5954a01aa472999e9ac079f706f4b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.483901 12166 tablet_bootstrap.cc:492] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.483999 12166 ts_tablet_manager.cc:1397] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:01:54.484537 12177 tablet_replica.cc:331] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.484486 12166 raft_consensus.cc:357] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.484601 12166 raft_consensus.cc:383] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.484635 12166 raft_consensus.cc:738] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.484761 12166 consensus_queue.cc:260] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.484818 12177 raft_consensus.cc:2241] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.485028 12177 raft_consensus.cc:2270] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.485080 12166 ts_tablet_manager.cc:1428] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.485395 12166 tablet_bootstrap.cc:492] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.485627 12177 ts_tablet_manager.cc:1905] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.486500 12166 tablet_bootstrap.cc:654] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.488250 12166 tablet_bootstrap.cc:492] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.488353 12166 ts_tablet_manager.cc:1397] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:01:54.488358 12177 ts_tablet_manager.cc:1918] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.488610 12205 raft_consensus.cc:491] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.488752 12205 raft_consensus.cc:513] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.488857 12166 raft_consensus.cc:357] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.488945 12166 raft_consensus.cc:383] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.488976 12166 raft_consensus.cc:738] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.489092 12166 consensus_queue.cc:260] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.489197 12205 leader_election.cc:290] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:54.489403 12166 ts_tablet_manager.cc:1428] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:54.489586 12166 tablet_bootstrap.cc:492] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.489732 12177 log.cc:1199] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f6b666bfd4f141db89a35fa818edb378
I20250625 14:01:54.490042 12177 ts_tablet_manager.cc:1939] T f6b666bfd4f141db89a35fa818edb378 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.491040 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8d6c5552b204ec1b2f5e4bf9eba5640" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.491098 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8d6c5552b204ec1b2f5e4bf9eba5640" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.491194 11921 raft_consensus.cc:2466] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:54.491547 11717 leader_election.cc:343] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.491696 11717 leader_election.cc:304] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.491916 12205 raft_consensus.cc:2802] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.491979 12205 raft_consensus.cc:491] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.492018 12205 raft_consensus.cc:3058] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.492609 12166 tablet_bootstrap.cc:654] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.493027 12205 raft_consensus.cc:513] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.493376 12205 leader_election.cc:290] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:54.494221 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0e6599cf920c4c8b8ed17ecad1a31338 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:54.494463 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 165cc62292fc418890f253d87da10f51 (table default.Table_4167bf88496040c69601a4c80246ce36 [id=831b6f15f6e043fbb8a2d03425758576]) successfully deleted
I20250625 14:01:54.494551 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 4dfe24e8280c4675a5a6af9d32fa526e (table default.Table_78f8eff133eb479ab5b94eef76b4992e [id=73fae6a7414940f7ac920b6623c21704]) successfully deleted
I20250625 14:01:54.494624 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d69d6037befe407fb135b49a041c690a (table default.Table_a13429dfda614c5c98a33e244bef1ba3 [id=a8a101206e2e4a35a3123e6f8a2074ce]) successfully deleted
I20250625 14:01:54.494692 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet bb24e0ce060c486bae8135e46827d956 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]) successfully deleted
I20250625 14:01:54.494755 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0221dbcbca5f44df8612fc5d1714b9a3 (table default.Table_c2f06be7a54e4be7b2ce6205ac8002dc [id=4473873b77254ad28c73714b5f6e84d8]) successfully deleted
I20250625 14:01:54.494819 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c5e5954a01aa472999e9ac079f706f4b (table default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]) successfully deleted
I20250625 14:01:54.494887 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f6b666bfd4f141db89a35fa818edb378 (table default.Table_8029b9c972e547b0aa052cd38040c777 [id=8e84fd2f33444bdf85d58b0721a0080e]) successfully deleted
I20250625 14:01:54.495287 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b7eee5c995064aacb406daddb888edb6
I20250625 14:01:54.495592 11529 catalog_manager.cc:6652] ReplaceTablet: tablet b7eee5c995064aacb406daddb888edb6 deleted and replaced by tablet 8363c9c6dab64a30b08ab92a152a3ee5
I20250625 14:01:54.495668 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8d6c5552b204ec1b2f5e4bf9eba5640" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.495817 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2135205cf6d1472983740c9119df79a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.496258 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2135205cf6d1472983740c9119df79a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:54.496383 11717 leader_election.cc:343] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.497089 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 812d9a36acf644c99edfbf55086f9b25
I20250625 14:01:54.497395 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 812d9a36acf644c99edfbf55086f9b25 deleted and replaced by tablet 8b82e99ecc994068b7823ef75d5b233f
I20250625 14:01:54.497598 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_049d9acf2b4942958531ca1b61d7cde6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.497701 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet b7eee5c995064aacb406daddb888edb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 8363c9c6dab64a30b08ab92a152a3ee5) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:54.497992 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_049d9acf2b4942958531ca1b61d7cde6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.498291 12233 tablet.cc:1722] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:54.498749 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 812d9a36acf644c99edfbf55086f9b25 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b82e99ecc994068b7823ef75d5b233f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.498812 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ab957f1fd4214efbb6233f312617c728
I20250625 14:01:54.499068 11528 catalog_manager.cc:6652] ReplaceTablet: tablet ab957f1fd4214efbb6233f312617c728 deleted and replaced by tablet ee3cc1074818466a97d04f0136eaea92
I20250625 14:01:54.499131 12172 tablet_bootstrap.cc:492] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.499208 12172 ts_tablet_manager.cc:1397] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.091s user 0.002s sys 0.000s
I20250625 14:01:54.499269 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_009dda51059342099345e5463b33f6f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.499595 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_009dda51059342099345e5463b33f6f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.499677 12172 raft_consensus.cc:357] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.499814 12172 raft_consensus.cc:383] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.499845 12172 raft_consensus.cc:738] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.499989 12172 consensus_queue.cc:260] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.500269 12172 ts_tablet_manager.cc:1428] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.500458 12172 tablet_bootstrap.cc:492] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.500638 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3518ef32d62a474d95cb4a64a11f2309" } new_table_name: "default.Table_dba49d3cdee64ffba6f3959bed8da9ba" modify_external_catalogs: true
I20250625 14:01:54.501427 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet b7eee5c995064aacb406daddb888edb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 8363c9c6dab64a30b08ab92a152a3ee5) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.501593 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 812d9a36acf644c99edfbf55086f9b25 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b82e99ecc994068b7823ef75d5b233f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.501662 12172 tablet_bootstrap.cc:654] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.501904 12173 tablet_replica.cc:331] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.502051 12173 raft_consensus.cc:2241] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.502174 12173 raft_consensus.cc:2270] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.502595 12173 ts_tablet_manager.cc:1905] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.502636 12167 tablet_bootstrap.cc:492] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.502724 12167 ts_tablet_manager.cc:1397] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.001s
I20250625 14:01:54.503224 12167 raft_consensus.cc:357] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.503334 12167 raft_consensus.cc:383] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.503372 12167 raft_consensus.cc:738] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.503528 12167 consensus_queue.cc:260] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.503818 12167 ts_tablet_manager.cc:1428] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:54.504007 12167 tablet_bootstrap.cc:492] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:54.504508 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b7eee5c995064aacb406daddb888edb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7eee5c995064aacb406daddb888edb6 already in progress: creating tablet
I20250625 14:01:54.504978 12173 ts_tablet_manager.cc:1918] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.505030 12167 tablet_bootstrap.cc:654] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.505050 12173 log.cc:1199] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/812d9a36acf644c99edfbf55086f9b25
I20250625 14:01:54.505059 12584 tablet.cc:1722] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:54.505338 12173 ts_tablet_manager.cc:1939] T 812d9a36acf644c99edfbf55086f9b25 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.505820 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet b7eee5c995064aacb406daddb888edb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 8363c9c6dab64a30b08ab92a152a3ee5) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.506237 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 812d9a36acf644c99edfbf55086f9b25 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b82e99ecc994068b7823ef75d5b233f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.506615 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet ab957f1fd4214efbb6233f312617c728 with delete_type TABLET_DATA_DELETED (replaced by tablet ee3cc1074818466a97d04f0136eaea92) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.506711 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet ab957f1fd4214efbb6233f312617c728 with delete_type TABLET_DATA_DELETED (replaced by tablet ee3cc1074818466a97d04f0136eaea92) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.507038 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 812d9a36acf644c99edfbf55086f9b25 (table default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
W20250625 14:01:54.507297 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet ab957f1fd4214efbb6233f312617c728 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab957f1fd4214efbb6233f312617c728 already in progress: creating tablet
I20250625 14:01:54.508255 12177 tablet_replica.cc:331] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.508409 12177 raft_consensus.cc:2241] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.508523 12177 raft_consensus.cc:2270] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.509171 12177 ts_tablet_manager.cc:1905] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.510362 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_60a4efc645e04af28b8c457ac9dc440e" } new_table_name: "default.Table_67a78b6cc247483798a3ca2332498af2" modify_external_catalogs: true
I20250625 14:01:54.511582 12177 ts_tablet_manager.cc:1918] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.511652 12177 log.cc:1199] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b7eee5c995064aacb406daddb888edb6
I20250625 14:01:54.511622 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4d04289158c94a1a95157a785c3d5829"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.511857 12177 ts_tablet_manager.cc:1939] T b7eee5c995064aacb406daddb888edb6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:54.512037 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d04289158c94a1a95157a785c3d5829 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.512497 12177 tablet_replica.cc:331] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.512625 12177 raft_consensus.cc:2241] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.512746 12177 raft_consensus.cc:2270] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.514282 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b7eee5c995064aacb406daddb888edb6 (table default.Table_3518ef32d62a474d95cb4a64a11f2309 [id=05ba3fb82ea74715a67dbefb3018db83]) successfully deleted
I20250625 14:01:54.515131 12167 tablet_bootstrap.cc:492] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.515215 12167 ts_tablet_manager.cc:1397] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20250625 14:01:54.515682 12167 raft_consensus.cc:357] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.515782 12167 raft_consensus.cc:383] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.515810 12167 raft_consensus.cc:738] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.515918 12167 consensus_queue.cc:260] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.516191 12167 ts_tablet_manager.cc:1428] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:54.516351 12167 tablet_bootstrap.cc:492] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.517171 12172 tablet_bootstrap.cc:492] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.517259 12172 ts_tablet_manager.cc:1397] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:54.517356 12167 tablet_bootstrap.cc:654] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.517709 12172 raft_consensus.cc:357] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.517817 12172 raft_consensus.cc:383] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.517850 12172 raft_consensus.cc:738] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.517985 12172 consensus_queue.cc:260] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.518857 12233 tablet.cc:1722] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.519057 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d (table default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]). Expected version 1 got 0
I20250625 14:01:54.519212 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 4 got 0
I20250625 14:01:54.519295 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet ff54429a3d3e40688aaea56b70dcdfae (table default.Table_c462a6e6fe9f4090a80e61f9af07fc6e [id=8302b2a44b004bdab1aa2f67bb82ad01]). Expected version 1 got 0
I20250625 14:01:54.519382 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]). Expected version 2 got 0
I20250625 14:01:54.519448 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet fb8c57c541114222b81dff868b1529f6 (table default.Table_e7750b507fd741bda3ad151860391100 [id=83f715a6270c49f7b0986d2b05d73b44]). Expected version 1 got 0
I20250625 14:01:54.520733 12172 ts_tablet_manager.cc:1428] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:54.521008 12172 tablet_bootstrap.cc:492] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.521075 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet fb8c57c541114222b81dff868b1529f6 (table default.Table_e7750b507fd741bda3ad151860391100 [id=83f715a6270c49f7b0986d2b05d73b44]). Expected version 1 got 0
I20250625 14:01:54.521191 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 4 got 0
I20250625 14:01:54.521303 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]). Expected version 2 got 0
I20250625 14:01:54.522101 12029 tablet_service.cc:1468] Processing CreateTablet for tablet e7260f6c81d64415ae2469f87fe46c55 (DEFAULT_TABLE table=default.Table_66c17881414348d49722f825bff86a90 [id=264c5ba782504673b9d5e2caeac31b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.522270 12172 tablet_bootstrap.cc:654] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.522296 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 205f83a0ffbc440492e241a75657f1b8 (DEFAULT_TABLE table=default.Table_56b605b35a0d4335b2916c5748f8ab38 [id=f7efaf49a2fe422185ac18faf97835b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.522418 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7260f6c81d64415ae2469f87fe46c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.522562 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f83a0ffbc440492e241a75657f1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.522892 12036 tablet_service.cc:1468] Processing CreateTablet for tablet cbd18834c5594897a2b16c7069a90c18 (DEFAULT_TABLE table=default.Table_d0f93962f9df42408804933938d2595c [id=2b85fd3adb7f4584887aa464e3ba929f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.523103 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd18834c5594897a2b16c7069a90c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.523103 12177 ts_tablet_manager.cc:1905] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.524819 11898 tablet_service.cc:1468] Processing CreateTablet for tablet e7260f6c81d64415ae2469f87fe46c55 (DEFAULT_TABLE table=default.Table_66c17881414348d49722f825bff86a90 [id=264c5ba782504673b9d5e2caeac31b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.525130 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7260f6c81d64415ae2469f87fe46c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.525159 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 7302430d7e4a4610bfe271c114718d35 (DEFAULT_TABLE table=default.Table_9a5399f5e7f14c7985451d22a883e2eb [id=1cf0251105444beca355668b5a0da27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.525170 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 205f83a0ffbc440492e241a75657f1b8 (DEFAULT_TABLE table=default.Table_56b605b35a0d4335b2916c5748f8ab38 [id=f7efaf49a2fe422185ac18faf97835b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.525322 12177 ts_tablet_manager.cc:1918] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.525362 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7302430d7e4a4610bfe271c114718d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.525388 12177 log.cc:1199] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/812d9a36acf644c99edfbf55086f9b25
I20250625 14:01:54.525449 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f83a0ffbc440492e241a75657f1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.525640 12177 ts_tablet_manager.cc:1939] T 812d9a36acf644c99edfbf55086f9b25 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.526331 12172 tablet_bootstrap.cc:492] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.526412 12172 ts_tablet_manager.cc:1397] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20250625 14:01:54.526522 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 32d345da0f674704b8e1f23a74bac3ce (DEFAULT_TABLE table=default.Table_1aa440e8532d4a51a048ec92c4a363bf [id=f6b6cc48a6f54d6bb64dba30511a4c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.526727 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d345da0f674704b8e1f23a74bac3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.526906 12172 raft_consensus.cc:357] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.527016 12172 raft_consensus.cc:383] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.527047 12172 raft_consensus.cc:738] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.527175 12172 consensus_queue.cc:260] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.527467 12172 ts_tablet_manager.cc:1428] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.527643 12172 tablet_bootstrap.cc:492] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.527866 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 32d345da0f674704b8e1f23a74bac3ce (DEFAULT_TABLE table=default.Table_1aa440e8532d4a51a048ec92c4a363bf [id=f6b6cc48a6f54d6bb64dba30511a4c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.528115 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d345da0f674704b8e1f23a74bac3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.528649 12172 tablet_bootstrap.cc:654] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.530009 11763 tablet_service.cc:1468] Processing CreateTablet for tablet e7260f6c81d64415ae2469f87fe46c55 (DEFAULT_TABLE table=default.Table_66c17881414348d49722f825bff86a90 [id=264c5ba782504673b9d5e2caeac31b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.530272 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7260f6c81d64415ae2469f87fe46c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.530530 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 32d345da0f674704b8e1f23a74bac3ce (DEFAULT_TABLE table=default.Table_1aa440e8532d4a51a048ec92c4a363bf [id=f6b6cc48a6f54d6bb64dba30511a4c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.530654 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 7302430d7e4a4610bfe271c114718d35 (DEFAULT_TABLE table=default.Table_9a5399f5e7f14c7985451d22a883e2eb [id=1cf0251105444beca355668b5a0da27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.530740 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d345da0f674704b8e1f23a74bac3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.530889 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7302430d7e4a4610bfe271c114718d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.531049 11760 tablet_service.cc:1468] Processing CreateTablet for tablet cbd18834c5594897a2b16c7069a90c18 (DEFAULT_TABLE table=default.Table_d0f93962f9df42408804933938d2595c [id=2b85fd3adb7f4584887aa464e3ba929f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.531251 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd18834c5594897a2b16c7069a90c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.531364 12167 tablet_bootstrap.cc:492] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.531440 12167 ts_tablet_manager.cc:1397] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20250625 14:01:54.531991 12167 raft_consensus.cc:357] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.532099 12167 raft_consensus.cc:383] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.532130 12167 raft_consensus.cc:738] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.532246 12167 consensus_queue.cc:260] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.532517 12167 ts_tablet_manager.cc:1428] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.532477 12584 tablet.cc:1722] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.532696 12167 tablet_bootstrap.cc:492] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.533252 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 205f83a0ffbc440492e241a75657f1b8 (DEFAULT_TABLE table=default.Table_56b605b35a0d4335b2916c5748f8ab38 [id=f7efaf49a2fe422185ac18faf97835b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.533447 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f83a0ffbc440492e241a75657f1b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.534065 12167 tablet_bootstrap.cc:654] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.535326 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 812d9a36acf644c99edfbf55086f9b25 (table default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
W20250625 14:01:54.535676 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ab957f1fd4214efbb6233f312617c728 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab957f1fd4214efbb6233f312617c728 already in progress: creating tablet
I20250625 14:01:54.535699 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_29b36939592445fa8336a104142a6d44" } new_table_name: "default.Table_1809d17fc2ca4fc294f2c0b3cbec2866" modify_external_catalogs: true
I20250625 14:01:54.536185 12167 tablet_bootstrap.cc:492] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.536249 12172 tablet_bootstrap.cc:492] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.536271 12167 ts_tablet_manager.cc:1397] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:54.536334 12172 ts_tablet_manager.cc:1397] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250625 14:01:54.536690 12167 raft_consensus.cc:357] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.536782 12167 raft_consensus.cc:383] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.536824 12167 raft_consensus.cc:738] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.536798 12172 raft_consensus.cc:357] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.536906 12172 raft_consensus.cc:383] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.536938 12172 raft_consensus.cc:738] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.536929 12167 consensus_queue.cc:260] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.537057 12172 consensus_queue.cc:260] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.537180 12167 ts_tablet_manager.cc:1428] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.537333 12167 tablet_bootstrap.cc:492] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.537362 12172 ts_tablet_manager.cc:1428] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.537533 12172 tablet_bootstrap.cc:492] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.538707 12172 tablet_bootstrap.cc:654] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.539484 12167 tablet_bootstrap.cc:654] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.540912 12167 tablet_bootstrap.cc:492] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.541011 12167 ts_tablet_manager.cc:1397] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20250625 14:01:54.541093 12172 tablet_bootstrap.cc:492] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.541170 12172 ts_tablet_manager.cc:1397] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:54.541486 12167 raft_consensus.cc:357] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.541597 12167 raft_consensus.cc:383] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.541633 12167 raft_consensus.cc:738] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.541666 12172 raft_consensus.cc:357] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.541760 12167 consensus_queue.cc:260] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.541798 12172 raft_consensus.cc:383] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.541842 12172 raft_consensus.cc:738] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.542081 12167 ts_tablet_manager.cc:1428] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:54.542112 12172 consensus_queue.cc:260] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.542271 12167 tablet_bootstrap.cc:492] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.542569 12172 ts_tablet_manager.cc:1428] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.542737 12172 tablet_bootstrap.cc:492] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.543370 12167 tablet_bootstrap.cc:654] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.543695 12172 tablet_bootstrap.cc:654] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.547520 12167 tablet_bootstrap.cc:492] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.547631 12167 ts_tablet_manager.cc:1397] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
W20250625 14:01:54.547641 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8363c9c6dab64a30b08ab92a152a3ee5 has no consensus state
I20250625 14:01:54.547863 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_28d60bb833d14dcf97370422a7f67317" } new_table_name: "default.Table_e70f8d95174d4bfe8aad800cb1211138" modify_external_catalogs: true
I20250625 14:01:54.548161 12167 raft_consensus.cc:357] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.548269 12167 raft_consensus.cc:383] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.548306 12167 raft_consensus.cc:738] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.548457 12167 consensus_queue.cc:260] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.548731 12167 ts_tablet_manager.cc:1428] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20250625 14:01:54.549034 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a2fd4408e4f4f06b5a1bc686402ee40 consensus state has no leader
I20250625 14:01:54.549072 12167 tablet_bootstrap.cc:492] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.549477 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c462a6e6fe9f4090a80e61f9af07fc6e" } modify_external_catalogs: true
I20250625 14:01:54.549575 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c462a6e6fe9f4090a80e61f9af07fc6e" } modify_external_catalogs: true
I20250625 14:01:54.550088 12167 tablet_bootstrap.cc:654] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.551306 12167 tablet_bootstrap.cc:492] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.551384 12167 ts_tablet_manager.cc:1397] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
W20250625 14:01:54.551879 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9da1d3ee457944399e60e0c5bdd8c428 consensus state has no leader
I20250625 14:01:54.551890 12167 raft_consensus.cc:357] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.552001 12167 raft_consensus.cc:383] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.552035 12167 raft_consensus.cc:738] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.552162 12167 consensus_queue.cc:260] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.552441 12167 ts_tablet_manager.cc:1428] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.553131 12167 tablet_bootstrap.cc:492] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.554153 12167 tablet_bootstrap.cc:654] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.555740 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 68a0cfeac48042bdaea66c3b0e370480 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.556072 12167 tablet_bootstrap.cc:492] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.556165 12167 ts_tablet_manager.cc:1397] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:54.556656 12167 raft_consensus.cc:357] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.556763 12167 raft_consensus.cc:383] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.556799 12167 raft_consensus.cc:738] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.556902 12167 consensus_queue.cc:260] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.557195 12167 ts_tablet_manager.cc:1428] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.557399 12167 tablet_bootstrap.cc:492] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:54.557909 12604 consensus_queue.cc:1162] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfff52620fea460d850827814b790c35" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:01:54.558173 11897 tablet_service.cc:1468] Processing CreateTablet for tablet cbd18834c5594897a2b16c7069a90c18 (DEFAULT_TABLE table=default.Table_d0f93962f9df42408804933938d2595c [id=2b85fd3adb7f4584887aa464e3ba929f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.558215 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet ab957f1fd4214efbb6233f312617c728 with delete_type TABLET_DATA_DELETED (replaced by tablet ee3cc1074818466a97d04f0136eaea92) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.558490 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd18834c5594897a2b16c7069a90c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.558696 12175 ts_tablet_manager.cc:1905] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.559746 12167 tablet_bootstrap.cc:654] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.560902 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8d6c5552b204ec1b2f5e4bf9eba5640" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.561004 12175 ts_tablet_manager.cc:1918] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.561089 12175 log.cc:1199] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c5e5954a01aa472999e9ac079f706f4b
I20250625 14:01:54.561065 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 7302430d7e4a4610bfe271c114718d35 (DEFAULT_TABLE table=default.Table_9a5399f5e7f14c7985451d22a883e2eb [id=1cf0251105444beca355668b5a0da27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.561311 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7302430d7e4a4610bfe271c114718d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.561352 12175 ts_tablet_manager.cc:1939] T c5e5954a01aa472999e9ac079f706f4b P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.561304 12233 tablet.cc:1722] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.562343 12430 tablet.cc:1722] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.563345 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c5e5954a01aa472999e9ac079f706f4b (table default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]) successfully deleted
I20250625 14:01:54.563539 12175 tablet_replica.cc:331] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.563664 12175 raft_consensus.cc:2241] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.563805 12175 pending_rounds.cc:70] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:54.563831 12175 pending_rounds.cc:77] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523027768397824 op_type: NO_OP noop_request { }
I20250625 14:01:54.563876 12175 raft_consensus.cc:2887] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.563925 12175 raft_consensus.cc:2270] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.561012 11921 raft_consensus.cc:3058] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.565109 11921 raft_consensus.cc:2466] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.565872 12167 tablet_bootstrap.cc:492] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.565959 12167 ts_tablet_manager.cc:1397] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:54.566185 11717 leader_election.cc:304] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.566452 12208 raft_consensus.cc:2802] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.566534 12208 raft_consensus.cc:695] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.566486 12167 raft_consensus.cc:357] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.566596 12167 raft_consensus.cc:383] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.566630 12167 raft_consensus.cc:738] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.566660 12208 consensus_queue.cc:237] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.566740 12167 consensus_queue.cc:260] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.567099 12167 ts_tablet_manager.cc:1428] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.567426 12167 tablet_bootstrap.cc:492] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.568306 12175 ts_tablet_manager.cc:1905] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.568486 12167 tablet_bootstrap.cc:654] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:54.568542 11858 consensus_peers.cc:487] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e6599cf920c4c8b8ed17ecad1a31338. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:54.569057 12430 tablet.cc:1722] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.569159 12622 tablet.cc:1722] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:54.570096 12178 raft_consensus.cc:491] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.570197 12178 raft_consensus.cc:513] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.570601 12178 leader_election.cc:290] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:54.572409 11993 leader_election.cc:343] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: f6b666bfd4f141db89a35fa818edb378
I20250625 14:01:54.572481 12167 tablet_bootstrap.cc:492] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.572559 12167 ts_tablet_manager.cc:1397] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:54.573014 12167 raft_consensus.cc:357] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.573112 12167 raft_consensus.cc:383] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.573144 12167 raft_consensus.cc:738] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.573266 12167 consensus_queue.cc:260] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.573529 12167 ts_tablet_manager.cc:1428] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:54.573727 12167 tablet_bootstrap.cc:492] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:54.574497 11990 leader_election.cc:343] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: f6b666bfd4f141db89a35fa818edb378
I20250625 14:01:54.574573 11990 leader_election.cc:304] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.574764 12178 raft_consensus.cc:2747] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.575917 12430 tablet.cc:1722] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:54.574772 12167 tablet_bootstrap.cc:654] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.576581 12175 ts_tablet_manager.cc:1918] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.576681 12175 log.cc:1199] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/4dfe24e8280c4675a5a6af9d32fa526e
I20250625 14:01:54.576969 12175 ts_tablet_manager.cc:1939] T 4dfe24e8280c4675a5a6af9d32fa526e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.577744 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 4dfe24e8280c4675a5a6af9d32fa526e (table default.Table_78f8eff133eb479ab5b94eef76b4992e [id=73fae6a7414940f7ac920b6623c21704]) successfully deleted
I20250625 14:01:54.578001 12175 tablet_replica.cc:331] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.578157 12175 raft_consensus.cc:2241] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.578382 12175 pending_rounds.cc:70] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:54.578444 12175 pending_rounds.cc:77] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523028147392512 op_type: NO_OP noop_request { }
I20250625 14:01:54.578526 12175 raft_consensus.cc:2887] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.578606 12175 raft_consensus.cc:2270] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.579152 12175 ts_tablet_manager.cc:1905] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.580536 12172 tablet_bootstrap.cc:492] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.580641 12172 ts_tablet_manager.cc:1397] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.000s
I20250625 14:01:54.581101 12172 raft_consensus.cc:357] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.581212 12172 raft_consensus.cc:383] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.581259 12172 raft_consensus.cc:738] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.581382 12175 ts_tablet_manager.cc:1918] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.581383 12172 consensus_queue.cc:260] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.581488 12175 log.cc:1199] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0221dbcbca5f44df8612fc5d1714b9a3
I20250625 14:01:54.581646 12172 ts_tablet_manager.cc:1428] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.581794 12175 ts_tablet_manager.cc:1939] T 0221dbcbca5f44df8612fc5d1714b9a3 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.581844 12172 tablet_bootstrap.cc:492] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.582583 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0221dbcbca5f44df8612fc5d1714b9a3 (table default.Table_c2f06be7a54e4be7b2ce6205ac8002dc [id=4473873b77254ad28c73714b5f6e84d8]) successfully deleted
I20250625 14:01:54.582885 12172 tablet_bootstrap.cc:654] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.582893 12175 tablet_replica.cc:331] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.583128 12175 raft_consensus.cc:2241] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.583299 12175 raft_consensus.cc:2270] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.583710 12175 ts_tablet_manager.cc:1905] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.585927 12175 ts_tablet_manager.cc:1918] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.586005 12175 log.cc:1199] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/88261e6c75b24755852c22f3d9385347
I20250625 14:01:54.586221 12175 ts_tablet_manager.cc:1939] T 88261e6c75b24755852c22f3d9385347 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.586982 12172 tablet_bootstrap.cc:492] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.587080 12172 ts_tablet_manager.cc:1397] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20250625 14:01:54.587579 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 88261e6c75b24755852c22f3d9385347 (table default.Table_1809d17fc2ca4fc294f2c0b3cbec2866 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
W20250625 14:01:54.588016 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet fc2766f8e0b544b0b48a0e7e5952d672 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc2766f8e0b544b0b48a0e7e5952d672 already in progress: creating tablet
W20250625 14:01:54.588168 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6b4141fcafbc4a6f96504bf47539b8ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b4141fcafbc4a6f96504bf47539b8ae already in progress: creating tablet
I20250625 14:01:54.588284 12178 raft_consensus.cc:491] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 14:01:54.588313 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8bbe1212a7438f9a06cc1a18c6e40a already in progress: creating tablet
I20250625 14:01:54.588376 12175 tablet_replica.cc:331] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.588382 12178 raft_consensus.cc:513] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:54.588433 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet aac4b7bbfad9493598b31a86e2c045c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aac4b7bbfad9493598b31a86e2c045c0 already in progress: creating tablet
I20250625 14:01:54.588505 12175 raft_consensus.cc:2241] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:01:54.588661 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a1580aeb4a4c1787c32b4d23e0fcaa already in progress: creating tablet
I20250625 14:01:54.588681 12175 raft_consensus.cc:2270] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.588809 12178 leader_election.cc:290] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.589017 12172 raft_consensus.cc:357] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.589131 12172 raft_consensus.cc:383] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.589177 12172 raft_consensus.cc:738] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.589232 12175 ts_tablet_manager.cc:1905] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.589751 11990 leader_election.cc:343] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: d69d6037befe407fb135b49a041c690a
W20250625 14:01:54.589828 11993 leader_election.cc:343] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: d69d6037befe407fb135b49a041c690a
I20250625 14:01:54.589884 11993 leader_election.cc:304] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.590101 12178 raft_consensus.cc:2747] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.589516 12172 consensus_queue.cc:260] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.590893 12172 ts_tablet_manager.cc:1428] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250625 14:01:54.591266 12172 tablet_bootstrap.cc:492] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.591542 12175 ts_tablet_manager.cc:1918] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.591624 12175 log.cc:1199] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0e6599cf920c4c8b8ed17ecad1a31338
I20250625 14:01:54.591889 12175 ts_tablet_manager.cc:1939] T 0e6599cf920c4c8b8ed17ecad1a31338 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.592509 12175 tablet_replica.cc:331] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.592644 12175 raft_consensus.cc:2241] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.592666 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0e6599cf920c4c8b8ed17ecad1a31338 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:54.592806 12175 pending_rounds.cc:70] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:54.592845 12175 pending_rounds.cc:77] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523027817377792 op_type: NO_OP noop_request { }
I20250625 14:01:54.592902 12175 raft_consensus.cc:2887] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.592962 12175 raft_consensus.cc:2270] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.593540 12175 ts_tablet_manager.cc:1905] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.593822 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]). Expected version 1 got 0
I20250625 14:01:54.593931 12172 tablet_bootstrap.cc:654] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.593976 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_b5db9b5292a6461bac446f5ebc358c27 [id=f8e4990b036541f1b033de99bff1accc]). Expected version 1 got 0
I20250625 14:01:54.594058 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]). Expected version 4 got 0
I20250625 14:01:54.594167 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d (table default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]). Expected version 1 got 0
I20250625 14:01:54.594431 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]). Expected version 2 got 0
I20250625 14:01:54.594543 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet fb8c57c541114222b81dff868b1529f6 (table default.Table_e7750b507fd741bda3ad151860391100 [id=83f715a6270c49f7b0986d2b05d73b44]). Expected version 1 got 0
I20250625 14:01:54.595629 12175 ts_tablet_manager.cc:1918] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.595688 12175 log.cc:1199] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/165cc62292fc418890f253d87da10f51
I20250625 14:01:54.595913 12175 ts_tablet_manager.cc:1939] T 165cc62292fc418890f253d87da10f51 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.595961 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ff54429a3d3e40688aaea56b70dcdfae
I20250625 14:01:54.596400 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_28d60bb833d14dcf97370422a7f67317 [id=eb9c04f498934429a3cbc198525b7489] alter complete (version 1)
I20250625 14:01:54.596607 12175 tablet_replica.cc:331] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.596736 12175 raft_consensus.cc:2241] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.596760 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 165cc62292fc418890f253d87da10f51 (table default.Table_4167bf88496040c69601a4c80246ce36 [id=831b6f15f6e043fbb8a2d03425758576]) successfully deleted
I20250625 14:01:54.596850 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet ff54429a3d3e40688aaea56b70dcdfae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.597026 12175 raft_consensus.cc:2270] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.597074 12177 tablet_replica.cc:331] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.597213 12177 raft_consensus.cc:2241] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.597425 12177 raft_consensus.cc:2270] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.597555 12175 ts_tablet_manager.cc:1905] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.599424 12177 ts_tablet_manager.cc:1905] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.599792 12175 ts_tablet_manager.cc:1918] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.599853 12175 log.cc:1199] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b7eee5c995064aacb406daddb888edb6
I20250625 14:01:54.600044 12175 ts_tablet_manager.cc:1939] T b7eee5c995064aacb406daddb888edb6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.601650 12175 tablet_replica.cc:331] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.601670 12177 ts_tablet_manager.cc:1918] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.601737 12177 log.cc:1199] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/ff54429a3d3e40688aaea56b70dcdfae
I20250625 14:01:54.601779 12175 raft_consensus.cc:2241] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.601962 12175 raft_consensus.cc:2270] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.602002 12177 ts_tablet_manager.cc:1939] T ff54429a3d3e40688aaea56b70dcdfae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.602355 12175 ts_tablet_manager.cc:1905] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.602807 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b7eee5c995064aacb406daddb888edb6 (table default.Table_dba49d3cdee64ffba6f3959bed8da9ba [id=05ba3fb82ea74715a67dbefb3018db83]) successfully deleted
I20250625 14:01:54.605296 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_b5db9b5292a6461bac446f5ebc358c27 [id=f8e4990b036541f1b033de99bff1accc]). Expected version 1 got 0
I20250625 14:01:54.605460 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 53bea49e49d64c7a82c96535db09c87d (table default.Table_31fa2df49e0641a3bec420da08de1070 [id=4bdc41d7138c4a099d95a82864c85d8e]). Expected version 1 got 0
I20250625 14:01:54.605566 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet da88786d60c34c71b85abd0fca502b8d (table default.Table_e4729036527243a1b64bf5c9b7a4a5e1 [id=e67edee2642447d583e7ca5b97ec0213]). Expected version 1 got 0
I20250625 14:01:54.605618 12533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b19d4bb9dd34b4c92dd939a17482334. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:54.605729 12533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:54.607657 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 88261e6c75b24755852c22f3d9385347 with delete_type TABLET_DATA_DELETED (replaced by tablet 9da1d3ee457944399e60e0c5bdd8c428) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.607844 12173 tablet_replica.cc:331] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.608012 12173 raft_consensus.cc:2241] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.608125 12173 raft_consensus.cc:2270] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.608577 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet ff54429a3d3e40688aaea56b70dcdfae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.608914 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet ff54429a3d3e40688aaea56b70dcdfae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.610834 12173 ts_tablet_manager.cc:1905] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.613098 12173 ts_tablet_manager.cc:1918] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.613168 12173 log.cc:1199] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/88261e6c75b24755852c22f3d9385347
I20250625 14:01:54.613384 12173 ts_tablet_manager.cc:1939] T 88261e6c75b24755852c22f3d9385347 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.613737 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 9077aa58d4d5488d812e71da4407d87b (DEFAULT_TABLE table=default.Table_aad2dbed98a440f19cf6aa8608d96780 [id=c485676a21514b95bab0990f6807c5c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.613981 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077aa58d4d5488d812e71da4407d87b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.614136 12036 tablet_service.cc:1468] Processing CreateTablet for tablet c940a9f7ada54b48940e90c822c84735 (DEFAULT_TABLE table=default.Table_602e5344bce84d3f81394779588ad1c0 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.614365 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 88261e6c75b24755852c22f3d9385347 (table default.Table_1809d17fc2ca4fc294f2c0b3cbec2866 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
I20250625 14:01:54.614430 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c940a9f7ada54b48940e90c822c84735. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.614159 12173 tablet_replica.cc:331] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.614611 12173 raft_consensus.cc:2241] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.614712 12173 raft_consensus.cc:2270] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.615336 12173 ts_tablet_manager.cc:1905] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.617025 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 9077aa58d4d5488d812e71da4407d87b (DEFAULT_TABLE table=default.Table_aad2dbed98a440f19cf6aa8608d96780 [id=c485676a21514b95bab0990f6807c5c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.617381 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet ff54429a3d3e40688aaea56b70dcdfae (table default.Table_c462a6e6fe9f4090a80e61f9af07fc6e [id=8302b2a44b004bdab1aa2f67bb82ad01]) successfully deleted
I20250625 14:01:54.617528 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4c4a6ce84e424391a7e70a54a79913eb" } modify_external_catalogs: true
I20250625 14:01:54.617659 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4c4a6ce84e424391a7e70a54a79913eb" } modify_external_catalogs: true
I20250625 14:01:54.618141 12173 ts_tablet_manager.cc:1918] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.618212 12173 log.cc:1199] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/ff54429a3d3e40688aaea56b70dcdfae
I20250625 14:01:54.618496 12173 ts_tablet_manager.cc:1939] T ff54429a3d3e40688aaea56b70dcdfae P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.618652 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 9077aa58d4d5488d812e71da4407d87b (DEFAULT_TABLE table=default.Table_aad2dbed98a440f19cf6aa8608d96780 [id=c485676a21514b95bab0990f6807c5c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.618928 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077aa58d4d5488d812e71da4407d87b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.621415 11897 tablet_service.cc:1468] Processing CreateTablet for tablet c940a9f7ada54b48940e90c822c84735 (DEFAULT_TABLE table=default.Table_602e5344bce84d3f81394779588ad1c0 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.621830 11895 tablet_service.cc:1468] Processing CreateTablet for tablet a7ede0ddacb74e39b07f175b5ef2a2c5 (DEFAULT_TABLE table=default.Table_4024f05f2d0245da8ef8d15052d80282 [id=f5c7890a67b34de29d7bb56262c9e0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.622954 11898 tablet_service.cc:1468] Processing CreateTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 (DEFAULT_TABLE table=default.Table_e2d752997eb84bdc9bc702cc0afc16e6 [id=d9b7da024f7841eb867569b7c06dc2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.624025 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 3c825977e422407486587f28af36bd68 (DEFAULT_TABLE table=default.Table_1a5cdbf81fcc4467907332b8969e5d0c [id=c7bfff2cc8b84a5d83719cd96bc5af9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.624125 11758 tablet_service.cc:1468] Processing CreateTablet for tablet a7ede0ddacb74e39b07f175b5ef2a2c5 (DEFAULT_TABLE table=default.Table_4024f05f2d0245da8ef8d15052d80282 [id=f5c7890a67b34de29d7bb56262c9e0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.624425 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ede0ddacb74e39b07f175b5ef2a2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.624434 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 3c825977e422407486587f28af36bd68 (DEFAULT_TABLE table=default.Table_1a5cdbf81fcc4467907332b8969e5d0c [id=c7bfff2cc8b84a5d83719cd96bc5af9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.624722 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c825977e422407486587f28af36bd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.626128 11763 tablet_service.cc:1468] Processing CreateTablet for tablet a7f797fe89204fa18340bfb43ab36cbf (DEFAULT_TABLE table=default.Table_8a54b321a8a040eb9fbd1f842aa17161 [id=ccfb2f80b431431db5df92e0b400520c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.626394 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f797fe89204fa18340bfb43ab36cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.626485 11760 tablet_service.cc:1468] Processing CreateTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 (DEFAULT_TABLE table=default.Table_e2d752997eb84bdc9bc702cc0afc16e6 [id=d9b7da024f7841eb867569b7c06dc2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.626690 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47cf7e6d24347a88da2ee8fbd6de1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.627074 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.627188 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.627429 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.628798 11896 tablet_service.cc:1468] Processing CreateTablet for tablet a7f797fe89204fa18340bfb43ab36cbf (DEFAULT_TABLE table=default.Table_8a54b321a8a040eb9fbd1f842aa17161 [id=ccfb2f80b431431db5df92e0b400520c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.629456 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1aa440e8532d4a51a048ec92c4a363bf" } modify_external_catalogs: true
I20250625 14:01:54.629587 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1aa440e8532d4a51a048ec92c4a363bf" } modify_external_catalogs: true
I20250625 14:01:54.630403 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 8b82e99ecc994068b7823ef75d5b233f (DEFAULT_TABLE table=default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.630493 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6cd4de10d95046caa0f949f76701914f" } modify_external_catalogs: true
I20250625 14:01:54.630590 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6cd4de10d95046caa0f949f76701914f" } modify_external_catalogs: true
I20250625 14:01:54.630648 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b82e99ecc994068b7823ef75d5b233f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.632624 12178 raft_consensus.cc:491] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.632727 12178 raft_consensus.cc:513] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.633127 12178 leader_election.cc:290] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.633211 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 68a0cfeac48042bdaea66c3b0e370480
I20250625 14:01:54.633476 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 68a0cfeac48042bdaea66c3b0e370480 deleted and replaced by tablet e3af8a01ca1f49afb8aa1834807abf7e
I20250625 14:01:54.633630 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_49966ab9cf1c45feb28e95ae79153e6e [id=0071abfe5ba94050bfc65317fae65385] alter complete (version 1)
I20250625 14:01:54.634152 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 8b82e99ecc994068b7823ef75d5b233f (DEFAULT_TABLE table=default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.634464 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 with delete_type TABLET_DATA_DELETED (replaced by tablet e3af8a01ca1f49afb8aa1834807abf7e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.634841 11532 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_e7750b507fd741bda3ad151860391100 [id=83f715a6270c49f7b0986d2b05d73b44] alter complete (version 1)
I20250625 14:01:54.634974 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da88786d60c34c71b85abd0fca502b8d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.635702 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.637312 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_daa46b6e09604fbe821817cc42384742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.637720 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daa46b6e09604fbe821817cc42384742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.639668 12036 tablet_service.cc:1468] Processing CreateTablet for tablet a7ede0ddacb74e39b07f175b5ef2a2c5 (DEFAULT_TABLE table=default.Table_4024f05f2d0245da8ef8d15052d80282 [id=f5c7890a67b34de29d7bb56262c9e0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.639761 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 with delete_type TABLET_DATA_DELETED (replaced by tablet e3af8a01ca1f49afb8aa1834807abf7e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.639984 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ede0ddacb74e39b07f175b5ef2a2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.640081 12178 raft_consensus.cc:491] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.640148 12178 raft_consensus.cc:513] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.640507 12178 leader_election.cc:290] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.640832 12265 raft_consensus.cc:491] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.640933 12265 raft_consensus.cc:513] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.641199 11762 tablet_service.cc:1468] Processing CreateTablet for tablet c940a9f7ada54b48940e90c822c84735 (DEFAULT_TABLE table=default.Table_602e5344bce84d3f81394779588ad1c0 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.641333 12265 leader_election.cc:290] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.641479 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c940a9f7ada54b48940e90c822c84735. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.641502 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "da88786d60c34c71b85abd0fca502b8d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.641814 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 3c825977e422407486587f28af36bd68 (DEFAULT_TABLE table=default.Table_1a5cdbf81fcc4467907332b8969e5d0c [id=c7bfff2cc8b84a5d83719cd96bc5af9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.642050 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c825977e422407486587f28af36bd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.643911 12030 tablet_service.cc:1468] Processing CreateTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 (DEFAULT_TABLE table=default.Table_e2d752997eb84bdc9bc702cc0afc16e6 [id=d9b7da024f7841eb867569b7c06dc2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.644143 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47cf7e6d24347a88da2ee8fbd6de1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.639684 12029 tablet_service.cc:1468] Processing CreateTablet for tablet a7f797fe89204fa18340bfb43ab36cbf (DEFAULT_TABLE table=default.Table_8a54b321a8a040eb9fbd1f842aa17161 [id=ccfb2f80b431431db5df92e0b400520c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.644661 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf278e5ff7f4e0c9b9b25610a76c74d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.644791 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f797fe89204fa18340bfb43ab36cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.644788 11784 raft_consensus.cc:2466] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:54.645146 11858 leader_election.cc:304] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.645325 12265 raft_consensus.cc:2802] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.645370 12265 raft_consensus.cc:491] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.645406 12265 raft_consensus.cc:3058] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.646456 12265 raft_consensus.cc:513] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.639994 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.646853 12265 leader_election.cc:290] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.646978 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.647362 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf278e5ff7f4e0c9b9b25610a76c74d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.647487 11784 raft_consensus.cc:3058] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.647794 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 32d345da0f674704b8e1f23a74bac3ce
I20250625 14:01:54.648505 11784 raft_consensus.cc:2466] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:54.648870 11858 leader_election.cc:304] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.649097 12265 raft_consensus.cc:2802] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.649181 12265 raft_consensus.cc:695] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:54.649173 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4617bb8a015d42188beba9df61df2c9f
I20250625 14:01:54.649315 12265 consensus_queue.cc:237] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.649971 11990 leader_election.cc:304] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.650132 12178 raft_consensus.cc:2747] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.650243 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet a22eff28938b419f97ad971c486944ff from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.651245 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "80f4e61e39894e88b3497328da8f7d01" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.652347 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf278e5ff7f4e0c9b9b25610a76c74d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.652628 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf278e5ff7f4e0c9b9b25610a76c74d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.652669 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ef65dc31dc5843fb9e25275af5935e73
I20250625 14:01:54.653295 12172 tablet_bootstrap.cc:492] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.653394 12172 ts_tablet_manager.cc:1397] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.001s
I20250625 14:01:54.653964 12172 raft_consensus.cc:357] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.654119 12172 raft_consensus.cc:383] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.654157 12172 raft_consensus.cc:738] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.654343 12172 consensus_queue.cc:260] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.654443 11524 catalog_manager.cc:5582] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:54.654633 12172 ts_tablet_manager.cc:1428] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:54.654737 11524 catalog_manager.cc:5582] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:54.654839 12172 tablet_bootstrap.cc:492] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.654995 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 91fe26db32a44fb08efa3809f0fddfae (table default.Table_07d074214aae4c1ab81b65f2859410a6 [id=9aceda4c69be483c9c6efff41eb01322]). Expected version 1 got 0
I20250625 14:01:54.655215 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f797fe89204fa18340bfb43ab36cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.655751 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.655879 12172 tablet_bootstrap.cc:654] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.656100 12208 raft_consensus.cc:491] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.656185 12208 raft_consensus.cc:513] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.656538 12208 leader_election.cc:290] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.657495 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f47cf7e6d24347a88da2ee8fbd6de1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.657630 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b82e99ecc994068b7823ef75d5b233f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.657757 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c825977e422407486587f28af36bd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.657909 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c940a9f7ada54b48940e90c822c84735. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.658676 12178 raft_consensus.cc:491] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.658766 12178 raft_consensus.cc:513] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.659149 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077aa58d4d5488d812e71da4407d87b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.659159 12178 leader_election.cc:290] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:54.659838 11990 leader_election.cc:343] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 0221dbcbca5f44df8612fc5d1714b9a3
I20250625 14:01:54.660115 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ede0ddacb74e39b07f175b5ef2a2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.661870 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet ff54429a3d3e40688aaea56b70dcdfae (table default.Table_c462a6e6fe9f4090a80e61f9af07fc6e [id=8302b2a44b004bdab1aa2f67bb82ad01]) successfully deleted
W20250625 14:01:54.662070 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 68a0cfeac48042bdaea66c3b0e370480 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68a0cfeac48042bdaea66c3b0e370480 already in progress: creating tablet
I20250625 14:01:54.662971 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "80f4e61e39894e88b3497328da8f7d01" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.663095 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 with delete_type TABLET_DATA_DELETED (replaced by tablet e3af8a01ca1f49afb8aa1834807abf7e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.663231 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 4031eab780324944bc63fc77848fb209 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.663332 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet ff54429a3d3e40688aaea56b70dcdfae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.663522 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 4617bb8a015d42188beba9df61df2c9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.663784 12177 tablet_replica.cc:331] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.663882 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 32d345da0f674704b8e1f23a74bac3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.663920 12177 raft_consensus.cc:2241] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.664031 12177 raft_consensus.cc:2270] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.664067 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet ef65dc31dc5843fb9e25275af5935e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.664196 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet d69d6037befe407fb135b49a041c690a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.664494 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet b7eee5c995064aacb406daddb888edb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 8363c9c6dab64a30b08ab92a152a3ee5) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.664616 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 4617bb8a015d42188beba9df61df2c9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.664652 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet ef65dc31dc5843fb9e25275af5935e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.664645 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d1c412286d94eedac62cf4f1f939f68" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.664623 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 32d345da0f674704b8e1f23a74bac3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.664855 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d1c412286d94eedac62cf4f1f939f68" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.664958 11920 raft_consensus.cc:2466] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.665395 12177 ts_tablet_manager.cc:1905] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.665634 12175 ts_tablet_manager.cc:1918] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.665700 12175 log.cc:1199] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/812d9a36acf644c99edfbf55086f9b25
I20250625 14:01:54.665951 12175 ts_tablet_manager.cc:1939] T 812d9a36acf644c99edfbf55086f9b25 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:01:54.667586 11855 leader_election.cc:343] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.668118 12177 ts_tablet_manager.cc:1918] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.668182 12175 tablet_replica.cc:331] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.668195 12177 log.cc:1199] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/4031eab780324944bc63fc77848fb209
I20250625 14:01:54.668339 12175 raft_consensus.cc:2241] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.668427 12177 ts_tablet_manager.cc:1939] T 4031eab780324944bc63fc77848fb209 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.668464 12175 raft_consensus.cc:2270] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.668861 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet ef65dc31dc5843fb9e25275af5935e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.669282 12584 tablet.cc:1722] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:54.669349 12175 ts_tablet_manager.cc:1905] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.670073 11993 leader_election.cc:304] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.670326 12171 raft_consensus.cc:2747] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:54.670823 11855 leader_election.cc:343] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.671728 12430 tablet.cc:1722] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:54.672780 12175 ts_tablet_manager.cc:1918] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.672866 12175 log.cc:1199] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/ff54429a3d3e40688aaea56b70dcdfae
I20250625 14:01:54.673152 12175 ts_tablet_manager.cc:1939] T ff54429a3d3e40688aaea56b70dcdfae P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.674162 12167 tablet_bootstrap.cc:492] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.674250 12167 ts_tablet_manager.cc:1397] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.101s user 0.000s sys 0.002s
I20250625 14:01:54.674744 12167 raft_consensus.cc:357] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.674852 12167 raft_consensus.cc:383] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.674888 12167 raft_consensus.cc:738] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.675050 12167 consensus_queue.cc:260] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.675338 12167 ts_tablet_manager.cc:1428] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:54.675509 12167 tablet_bootstrap.cc:492] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.675683 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_31fa2df49e0641a3bec420da08de1070" } modify_external_catalogs: true
I20250625 14:01:54.675791 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_31fa2df49e0641a3bec420da08de1070" } modify_external_catalogs: true
I20250625 14:01:54.676537 12167 tablet_bootstrap.cc:654] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.678831 11717 leader_election.cc:304] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.679097 12208 raft_consensus.cc:2802] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 14:01:54.679158 11717 leader_election.cc:343] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.679158 12208 raft_consensus.cc:491] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.679443 12208 raft_consensus.cc:3058] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:54.680043 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet ef65dc31dc5843fb9e25275af5935e73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef65dc31dc5843fb9e25275af5935e73 already in progress: creating tablet
I20250625 14:01:54.680307 12208 raft_consensus.cc:513] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.680615 12208 leader_election.cc:290] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.680716 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 812d9a36acf644c99edfbf55086f9b25 (table default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
W20250625 14:01:54.680840 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet ab957f1fd4214efbb6233f312617c728 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab957f1fd4214efbb6233f312617c728 already in progress: creating tablet
I20250625 14:01:54.680931 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet ff54429a3d3e40688aaea56b70dcdfae (table default.Table_c462a6e6fe9f4090a80e61f9af07fc6e [id=8302b2a44b004bdab1aa2f67bb82ad01]) successfully deleted
W20250625 14:01:54.681044 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 68a0cfeac48042bdaea66c3b0e370480 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68a0cfeac48042bdaea66c3b0e370480 already in progress: creating tablet
W20250625 14:01:54.681159 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 0221dbcbca5f44df8612fc5d1714b9a3 because the tablet was not found. No further retry: Not found: Tablet not found: 0221dbcbca5f44df8612fc5d1714b9a3
I20250625 14:01:54.681264 12326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:54.681383 12326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
W20250625 14:01:54.681263 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b7eee5c995064aacb406daddb888edb6 because the tablet was not found. No further retry: Not found: Tablet not found: b7eee5c995064aacb406daddb888edb6
I20250625 14:01:54.682523 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 4617bb8a015d42188beba9df61df2c9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:54.683050 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 4617bb8a015d42188beba9df61df2c9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4617bb8a015d42188beba9df61df2c9f already in progress: creating tablet
W20250625 14:01:54.683169 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet ef65dc31dc5843fb9e25275af5935e73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef65dc31dc5843fb9e25275af5935e73 already in progress: creating tablet
W20250625 14:01:54.683269 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 32d345da0f674704b8e1f23a74bac3ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32d345da0f674704b8e1f23a74bac3ce already in progress: creating tablet
W20250625 14:01:54.683651 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4617bb8a015d42188beba9df61df2c9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4617bb8a015d42188beba9df61df2c9f already in progress: creating tablet
I20250625 14:01:54.683835 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 32d345da0f674704b8e1f23a74bac3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:54.685496 11993 leader_election.cc:343] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 0221dbcbca5f44df8612fc5d1714b9a3
I20250625 14:01:54.685577 11993 leader_election.cc:304] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.685835 12166 tablet_bootstrap.cc:492] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.685930 12166 ts_tablet_manager.cc:1397] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.196s user 0.002s sys 0.000s
I20250625 14:01:54.685967 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d1c412286d94eedac62cf4f1f939f68" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.686089 11920 raft_consensus.cc:3058] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.686496 12172 tablet_bootstrap.cc:492] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.686483 12166 raft_consensus.cc:357] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.686529 12208 raft_consensus.cc:491] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.686575 12172 ts_tablet_manager.cc:1397] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:01:54.686589 12166 raft_consensus.cc:383] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.686620 12166 raft_consensus.cc:738] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.686611 12208 raft_consensus.cc:513] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.686741 12166 consensus_queue.cc:260] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.686967 12208 leader_election.cc:290] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.687029 12166 ts_tablet_manager.cc:1428] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.687044 12172 raft_consensus.cc:357] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.687114 11920 raft_consensus.cc:2466] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.687150 12172 raft_consensus.cc:383] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.687180 12172 raft_consensus.cc:738] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.687215 12166 tablet_bootstrap.cc:492] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.687295 12172 consensus_queue.cc:260] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.687559 12172 ts_tablet_manager.cc:1428] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.687645 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d1c412286d94eedac62cf4f1f939f68" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.687731 12172 tablet_bootstrap.cc:492] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.687950 12233 tablet.cc:1722] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:54.688248 12166 tablet_bootstrap.cc:654] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.688726 12172 tablet_bootstrap.cc:654] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.688788 12171 raft_consensus.cc:2747] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:54.690878 11717 leader_election.cc:343] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.691004 11717 leader_election.cc:304] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.691074 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b83658ba82e498fbd48134a6a6867b3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.691314 12238 raft_consensus.cc:2802] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.691403 12238 raft_consensus.cc:695] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.691412 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b83658ba82e498fbd48134a6a6867b3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.691519 11920 raft_consensus.cc:2466] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.691540 12238 consensus_queue.cc:237] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:54.691895 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 32d345da0f674704b8e1f23a74bac3ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32d345da0f674704b8e1f23a74bac3ce already in progress: creating tablet
I20250625 14:01:54.692147 11717 leader_election.cc:304] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:54.692327 11717 leader_election.cc:343] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.692688 12205 raft_consensus.cc:2802] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.692731 12205 raft_consensus.cc:491] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.692757 12205 raft_consensus.cc:3058] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.693488 12205 raft_consensus.cc:513] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.693799 12205 leader_election.cc:290] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.694130 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b83658ba82e498fbd48134a6a6867b3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.694164 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9b83658ba82e498fbd48134a6a6867b3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.694288 11920 raft_consensus.cc:3058] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.695341 11920 raft_consensus.cc:2466] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.695999 12238 raft_consensus.cc:491] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.696082 12238 raft_consensus.cc:513] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.696404 12238 leader_election.cc:290] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.698901 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f8f9e822f0d4483f8b4af1775c472dc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.699054 11520 catalog_manager.cc:5001] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): alter failed for tablet ff54429a3d3e40688aaea56b70dcdfae (table default.Table_c462a6e6fe9f4090a80e61f9af07fc6e [id=8302b2a44b004bdab1aa2f67bb82ad01]),no further retry: Not found: Tablet not found: ff54429a3d3e40688aaea56b70dcdfae
W20250625 14:01:54.699203 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 68a0cfeac48042bdaea66c3b0e370480 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 68a0cfeac48042bdaea66c3b0e370480 already in progress: creating tablet
W20250625 14:01:54.699321 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8f9e822f0d4483f8b4af1775c472dc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.700182 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_046e760e5933440995f2198870cdbc31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.699326 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 4031eab780324944bc63fc77848fb209 (table default.Table_73d3dbf418e2463ba09893538dd70097 [id=3ef8fa0543a14c90b4c42e770323f83f]) successfully deleted
W20250625 14:01:54.700521 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_046e760e5933440995f2198870cdbc31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:54.700671 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ff54429a3d3e40688aaea56b70dcdfae because the tablet was not found. No further retry: Not found: Tablet not found: ff54429a3d3e40688aaea56b70dcdfae
W20250625 14:01:54.700793 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4617bb8a015d42188beba9df61df2c9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4617bb8a015d42188beba9df61df2c9f already in progress: creating tablet
W20250625 14:01:54.700892 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 32d345da0f674704b8e1f23a74bac3ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32d345da0f674704b8e1f23a74bac3ce already in progress: creating tablet
W20250625 14:01:54.700968 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ef65dc31dc5843fb9e25275af5935e73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef65dc31dc5843fb9e25275af5935e73 already in progress: creating tablet
W20250625 14:01:54.701068 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d69d6037befe407fb135b49a041c690a because the tablet was not found. No further retry: Not found: Tablet not found: d69d6037befe407fb135b49a041c690a
I20250625 14:01:54.702353 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a22eff28938b419f97ad971c486944ff
I20250625 14:01:54.702487 11717 leader_election.cc:304] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.702641 11525 catalog_manager.cc:6652] ReplaceTablet: tablet a22eff28938b419f97ad971c486944ff deleted and replaced by tablet 5bba2990cca6441fb954b2f30f561708
I20250625 14:01:54.702615 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2afe02902a54045be3b435ed7585b08" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.702692 12205 raft_consensus.cc:2802] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.702786 12205 raft_consensus.cc:695] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.702921 12205 consensus_queue.cc:237] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.703164 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet a22eff28938b419f97ad971c486944ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5bba2990cca6441fb954b2f30f561708) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.703559 12166 tablet_bootstrap.cc:492] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.703655 12166 ts_tablet_manager.cc:1397] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
W20250625 14:01:54.703866 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a22eff28938b419f97ad971c486944ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a22eff28938b419f97ad971c486944ff already in progress: creating tablet
I20250625 14:01:54.704056 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2afe02902a54045be3b435ed7585b08" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:01:54.702692 11717 leader_election.cc:343] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.704151 12166 raft_consensus.cc:357] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.704277 12166 raft_consensus.cc:383] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.704313 12166 raft_consensus.cc:738] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.704391 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet a22eff28938b419f97ad971c486944ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5bba2990cca6441fb954b2f30f561708) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.704435 12166 consensus_queue.cc:260] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.704619 12175 tablet_replica.cc:331] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.704694 12166 ts_tablet_manager.cc:1428] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.704738 12175 raft_consensus.cc:2241] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.704831 12175 raft_consensus.cc:2270] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.704887 12166 tablet_bootstrap.cc:492] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.706154 12166 tablet_bootstrap.cc:654] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.707146 12171 raft_consensus.cc:491] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.707244 12171 raft_consensus.cc:513] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.707625 12171 leader_election.cc:290] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.704167 11920 raft_consensus.cc:2466] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:54.708249 11990 leader_election.cc:343] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 4dfe24e8280c4675a5a6af9d32fa526e
I20250625 14:01:54.709149 12175 ts_tablet_manager.cc:1905] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.710920 11717 leader_election.cc:343] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.711140 11717 leader_election.cc:304] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.712309 12166 tablet_bootstrap.cc:492] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.712422 12166 ts_tablet_manager.cc:1397] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:54.712659 12175 ts_tablet_manager.cc:1918] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.712772 12175 log.cc:1199] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/a22eff28938b419f97ad971c486944ff
W20250625 14:01:54.712962 11993 leader_election.cc:343] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 4dfe24e8280c4675a5a6af9d32fa526e
I20250625 14:01:54.712998 12166 raft_consensus.cc:357] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.713052 11993 leader_election.cc:304] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.713104 12166 raft_consensus.cc:383] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.713145 12166 raft_consensus.cc:738] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.713308 12171 raft_consensus.cc:2747] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.713290 12166 consensus_queue.cc:260] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.713624 12166 ts_tablet_manager.cc:1428] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.713928 12166 tablet_bootstrap.cc:492] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.715001 12166 tablet_bootstrap.cc:654] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.715338 12238 raft_consensus.cc:2802] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.715407 12238 raft_consensus.cc:491] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.715446 12238 raft_consensus.cc:3058] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.713281 12175 ts_tablet_manager.cc:1939] T a22eff28938b419f97ad971c486944ff P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.716482 12238 raft_consensus.cc:513] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.716897 12238 leader_election.cc:290] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.717172 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet a22eff28938b419f97ad971c486944ff (table default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]) successfully deleted
I20250625 14:01:54.717835 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2afe02902a54045be3b435ed7585b08" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.717903 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d2afe02902a54045be3b435ed7585b08" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.717950 11919 raft_consensus.cc:3058] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.723076 11919 raft_consensus.cc:2466] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.724038 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.724484 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.724516 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 4a281b2956124ce4b9fd12560bf3d5c1 (table default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]). Expected version 1 got 0
I20250625 14:01:54.724642 11528 catalog_manager.cc:5582] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:54.724813 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]). Expected version 1 got 0
I20250625 14:01:54.724929 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 91fe26db32a44fb08efa3809f0fddfae (table default.Table_07d074214aae4c1ab81b65f2859410a6 [id=9aceda4c69be483c9c6efff41eb01322]). Expected version 1 got 0
I20250625 14:01:54.725116 11528 catalog_manager.cc:5582] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:54.725244 12166 tablet_bootstrap.cc:492] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.725283 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 53bea49e49d64c7a82c96535db09c87d (table default.Table_31fa2df49e0641a3bec420da08de1070 [id=4bdc41d7138c4a099d95a82864c85d8e]). Expected version 1 got 0
I20250625 14:01:54.725340 12166 ts_tablet_manager.cc:1397] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:01:54.725329 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_86978c9f798f4082adf63c1c04b549a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.725652 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86978c9f798f4082adf63c1c04b549a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.725680 11532 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020] alter complete (version 4)
I20250625 14:01:54.725883 12166 raft_consensus.cc:357] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.725999 12166 raft_consensus.cc:383] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.726035 12166 raft_consensus.cc:738] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.726161 12166 consensus_queue.cc:260] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.726418 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1a5cdbf81fcc4467907332b8969e5d0c" } new_table_name: "default.Table_b856c2faaa1542d6baf838480fb906c7" modify_external_catalogs: true
I20250625 14:01:54.726498 12166 ts_tablet_manager.cc:1428] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.726714 12166 tablet_bootstrap.cc:492] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.727120 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 4a281b2956124ce4b9fd12560bf3d5c1 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.727782 12166 tablet_bootstrap.cc:654] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.728042 11717 leader_election.cc:304] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.728219 12238 raft_consensus.cc:2802] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.728303 12238 raft_consensus.cc:695] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
W20250625 14:01:54.728366 11717 leader_election.cc:343] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.728437 12238 consensus_queue.cc:237] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.728997 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 8b82e99ecc994068b7823ef75d5b233f (DEFAULT_TABLE table=default.Table_27b5da1267634910a47dcb65db17b755 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.729305 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b82e99ecc994068b7823ef75d5b233f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.729907 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet a22eff28938b419f97ad971c486944ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5bba2990cca6441fb954b2f30f561708) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.730227 12177 tablet_replica.cc:331] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.730384 12177 raft_consensus.cc:2241] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.730491 12177 raft_consensus.cc:2270] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.730952 12177 ts_tablet_manager.cc:1905] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.733227 12177 ts_tablet_manager.cc:1918] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.733302 12177 log.cc:1199] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a22eff28938b419f97ad971c486944ff
I20250625 14:01:54.733520 12177 ts_tablet_manager.cc:1939] T a22eff28938b419f97ad971c486944ff P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.734094 12205 raft_consensus.cc:491] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.734158 12205 raft_consensus.cc:513] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.734445 12171 raft_consensus.cc:491] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.734530 12171 raft_consensus.cc:513] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.734625 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a22eff28938b419f97ad971c486944ff (table default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]) successfully deleted
I20250625 14:01:54.734874 12171 leader_election.cc:290] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.735368 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53bea49e49d64c7a82c96535db09c87d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.735514 11919 raft_consensus.cc:2391] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:54.735616 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7b8124c1ff214ffaa4645d62d65091ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.736003 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b8124c1ff214ffaa4645d62d65091ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.736126 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "53bea49e49d64c7a82c96535db09c87d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.736279 12166 tablet_bootstrap.cc:492] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.736362 12166 ts_tablet_manager.cc:1397] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:54.736474 11993 leader_election.cc:304] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.736629 12171 raft_consensus.cc:3058] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.736825 12166 raft_consensus.cc:357] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.736898 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 9da1d3ee457944399e60e0c5bdd8c428 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.736929 12166 raft_consensus.cc:383] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.736965 12166 raft_consensus.cc:738] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.737107 12166 consensus_queue.cc:260] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.737396 12166 ts_tablet_manager.cc:1428] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:54.737598 12166 tablet_bootstrap.cc:492] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.737583 12171 raft_consensus.cc:2747] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.738780 12166 tablet_bootstrap.cc:654] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.739069 12205 leader_election.cc:290] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.739153 12205 raft_consensus.cc:491] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.739212 12205 raft_consensus.cc:513] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.739475 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8a4d01792d40471ab6d5bafa1a308351" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.739522 12205 leader_election.cc:290] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:54.739777 11717 leader_election.cc:343] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.739926 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "169c59b473bd425296fa5bd9bbf2b616" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.740043 12055 raft_consensus.cc:2466] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.740051 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8a4d01792d40471ab6d5bafa1a308351" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.740146 11919 raft_consensus.cc:2466] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.740171 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "169c59b473bd425296fa5bd9bbf2b616" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.740296 11920 raft_consensus.cc:2466] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.740406 11717 leader_election.cc:304] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.740628 11717 leader_election.cc:304] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:01:54.740780 12208 raft_consensus.cc:2802] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.740904 12208 raft_consensus.cc:491] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.740994 12208 raft_consensus.cc:3058] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.741569 12166 tablet_bootstrap.cc:492] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.741689 12166 ts_tablet_manager.cc:1397] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:54.741947 12208 raft_consensus.cc:513] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.742327 12208 leader_election.cc:290] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.742429 12208 raft_consensus.cc:2802] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.742471 12208 raft_consensus.cc:491] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.742506 12208 raft_consensus.cc:3058] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.742630 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8a4d01792d40471ab6d5bafa1a308351" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.742666 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8a4d01792d40471ab6d5bafa1a308351" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.742723 11920 raft_consensus.cc:3058] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.743295 12208 raft_consensus.cc:513] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.743521 12208 leader_election.cc:290] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.743630 11920 raft_consensus.cc:2466] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.745770 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 (DEFAULT_TABLE table=default.Table_dba49d3cdee64ffba6f3959bed8da9ba [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.745873 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 (DEFAULT_TABLE table=default.Table_dba49d3cdee64ffba6f3959bed8da9ba [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.746057 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8363c9c6dab64a30b08ab92a152a3ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.746028 11717 leader_election.cc:304] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.746135 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8363c9c6dab64a30b08ab92a152a3ee5. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.746196 11717 leader_election.cc:343] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.746515 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "169c59b473bd425296fa5bd9bbf2b616" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.746603 11920 raft_consensus.cc:3058] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.747335 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 8b82e99ecc994068b7823ef75d5b233f from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.747435 11920 raft_consensus.cc:2466] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.747709 11717 leader_election.cc:304] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.742188 12166 raft_consensus.cc:357] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.747931 12166 raft_consensus.cc:383] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.747973 12166 raft_consensus.cc:738] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.748122 12166 consensus_queue.cc:260] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.748342 11532 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f] alter complete (version 2)
I20250625 14:01:54.748472 11898 tablet_service.cc:1468] Processing CreateTablet for tablet ee3cc1074818466a97d04f0136eaea92 (DEFAULT_TABLE table=default.Table_5987ef8c74ec45e2b5d841638a30ba99 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.748572 12166 ts_tablet_manager.cc:1428] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:01:54.748701 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3cc1074818466a97d04f0136eaea92. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.748800 12166 tablet_bootstrap.cc:492] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:54.749382 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c825977e422407486587f28af36bd68 consensus state has no leader
I20250625 14:01:54.750991 12166 tablet_bootstrap.cc:654] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.751981 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "169c59b473bd425296fa5bd9bbf2b616" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.752102 12055 raft_consensus.cc:3058] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.752599 12205 raft_consensus.cc:2802] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.752697 12205 raft_consensus.cc:695] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.752837 12205 consensus_queue.cc:237] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.753095 12055 raft_consensus.cc:2466] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.753604 12205 raft_consensus.cc:2802] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.753811 12205 raft_consensus.cc:695] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.753943 12205 consensus_queue.cc:237] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.756791 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 0221dbcbca5f44df8612fc5d1714b9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.756973 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 165cc62292fc418890f253d87da10f51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.757114 12173 tablet_replica.cc:331] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.757254 12173 raft_consensus.cc:2241] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.757366 12173 raft_consensus.cc:2270] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.757501 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 66cab8705ca2439abfa683f8b8b6dc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.757606 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet f6b666bfd4f141db89a35fa818edb378 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.757671 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 4dfe24e8280c4675a5a6af9d32fa526e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.757900 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet ff54429a3d3e40688aaea56b70dcdfae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.758392 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet d69d6037befe407fb135b49a041c690a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.758775 12173 ts_tablet_manager.cc:1905] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.759860 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 (DEFAULT_TABLE table=default.Table_dba49d3cdee64ffba6f3959bed8da9ba [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.760154 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8363c9c6dab64a30b08ab92a152a3ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.761123 12173 ts_tablet_manager.cc:1918] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.761191 12173 log.cc:1199] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0221dbcbca5f44df8612fc5d1714b9a3
I20250625 14:01:54.761426 12173 ts_tablet_manager.cc:1939] T 0221dbcbca5f44df8612fc5d1714b9a3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.757622 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet bb24e0ce060c486bae8135e46827d956 with delete_type TABLET_DATA_DELETED (replaced by tablet a8d6c5552b204ec1b2f5e4bf9eba5640) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.762127 12173 tablet_replica.cc:331] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.762274 12173 raft_consensus.cc:2241] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.762410 12173 raft_consensus.cc:2270] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.762993 12173 ts_tablet_manager.cc:1905] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.764343 11761 tablet_service.cc:1468] Processing CreateTablet for tablet ee3cc1074818466a97d04f0136eaea92 (DEFAULT_TABLE table=default.Table_5987ef8c74ec45e2b5d841638a30ba99 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.765027 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3cc1074818466a97d04f0136eaea92. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.765548 12173 ts_tablet_manager.cc:1918] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.765615 12173 log.cc:1199] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/165cc62292fc418890f253d87da10f51
I20250625 14:01:54.765836 12173 ts_tablet_manager.cc:1939] T 165cc62292fc418890f253d87da10f51 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.766407 12173 tablet_replica.cc:331] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.766474 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0221dbcbca5f44df8612fc5d1714b9a3 (table default.Table_c2f06be7a54e4be7b2ce6205ac8002dc [id=4473873b77254ad28c73714b5f6e84d8]) successfully deleted
I20250625 14:01:54.766527 12173 raft_consensus.cc:2241] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.766603 12173 raft_consensus.cc:2270] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.766665 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 165cc62292fc418890f253d87da10f51 (table default.Table_4167bf88496040c69601a4c80246ce36 [id=831b6f15f6e043fbb8a2d03425758576]) successfully deleted
I20250625 14:01:54.767086 12173 ts_tablet_manager.cc:1905] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.767603 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5dbf82507c0148b79ca41e74e4bb3634" } new_table_name: "default.Table_7887db4b4d5c4f2a8770f9f0b73832ec" modify_external_catalogs: true
I20250625 14:01:54.769680 12173 ts_tablet_manager.cc:1918] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.769874 12173 log.cc:1199] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/66cab8705ca2439abfa683f8b8b6dc45
I20250625 14:01:54.769953 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9da1d3ee457944399e60e0c5bdd8c428
I20250625 14:01:54.770246 12173 ts_tablet_manager.cc:1939] T 66cab8705ca2439abfa683f8b8b6dc45 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.770331 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 9da1d3ee457944399e60e0c5bdd8c428 deleted and replaced by tablet fc948c61d54a4618856b64a12a32b2c4
I20250625 14:01:54.770558 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f4d1651a42f04c3ea03c9db2668e3c62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.770788 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 with delete_type TABLET_DATA_DELETED (replaced by tablet fc948c61d54a4618856b64a12a32b2c4) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.771171 12173 tablet_replica.cc:331] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.771363 12173 raft_consensus.cc:2241] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.771517 12173 raft_consensus.cc:2270] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.771548 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0c2c0733750c4e89ac465c192b8c27bd" } new_table_name: "default.Table_5f7bec805c5d4182a130bf45d09b3b35" modify_external_catalogs: true
I20250625 14:01:54.771754 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 with delete_type TABLET_DATA_DELETED (replaced by tablet fc948c61d54a4618856b64a12a32b2c4) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.772208 12173 ts_tablet_manager.cc:1905] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.772789 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8abc4f3249834149817f4c730d26b806"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.773177 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8abc4f3249834149817f4c730d26b806 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.773689 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4a281b2956124ce4b9fd12560bf3d5c1
I20250625 14:01:54.773963 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 53bea49e49d64c7a82c96535db09c87d
I20250625 14:01:54.774178 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_e4729036527243a1b64bf5c9b7a4a5e1 [id=e67edee2642447d583e7ca5b97ec0213] alter complete (version 1)
I20250625 14:01:54.774396 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_27b5da1267634910a47dcb65db17b755" } new_table_name: "default.Table_626e2cc613e149589b0a39ca9ff4c057" modify_external_catalogs: true
I20250625 14:01:54.774845 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e16bd386c64c4f6ea20141ecdc8b91ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.774956 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8b82e99ecc994068b7823ef75d5b233f
I20250625 14:01:54.774928 12173 ts_tablet_manager.cc:1918] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.775166 12173 log.cc:1199] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f6b666bfd4f141db89a35fa818edb378
W20250625 14:01:54.775182 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e16bd386c64c4f6ea20141ecdc8b91ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.775234 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 8b82e99ecc994068b7823ef75d5b233f deleted and replaced by tablet 4b76d36bac354543b8f7cef071aaa661
I20250625 14:01:54.775421 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c99e790aef874f6c8875c93bd8df8256"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.775501 12173 ts_tablet_manager.cc:1939] T f6b666bfd4f141db89a35fa818edb378 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:54.775763 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c99e790aef874f6c8875c93bd8df8256 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.776315 12173 tablet_replica.cc:331] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.776486 12173 raft_consensus.cc:2241] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:01:54.776587 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4d1651a42f04c3ea03c9db2668e3c62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.776685 12173 raft_consensus.cc:2270] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.773972 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 4a281b2956124ce4b9fd12560bf3d5c1 deleted and replaced by tablet 8fee92d68eaa4b22a7f0c122aeb5bc44
I20250625 14:01:54.777283 12173 ts_tablet_manager.cc:1905] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.777544 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 with delete_type TABLET_DATA_DELETED (replaced by tablet fc948c61d54a4618856b64a12a32b2c4) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.777830 12029 tablet_service.cc:1468] Processing CreateTablet for tablet ee3cc1074818466a97d04f0136eaea92 (DEFAULT_TABLE table=default.Table_5987ef8c74ec45e2b5d841638a30ba99 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.778090 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3cc1074818466a97d04f0136eaea92. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.778224 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9da1d3ee457944399e60e0c5bdd8c428 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9da1d3ee457944399e60e0c5bdd8c428 already in progress: creating tablet
I20250625 14:01:54.779560 12173 ts_tablet_manager.cc:1918] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.779624 12173 log.cc:1199] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/4dfe24e8280c4675a5a6af9d32fa526e
I20250625 14:01:54.779836 12173 ts_tablet_manager.cc:1939] T 4dfe24e8280c4675a5a6af9d32fa526e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.780587 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 4a281b2956124ce4b9fd12560bf3d5c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fee92d68eaa4b22a7f0c122aeb5bc44) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.780789 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 53bea49e49d64c7a82c96535db09c87d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.780891 12175 tablet_replica.cc:331] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.780961 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 with delete_type TABLET_DATA_DELETED (replaced by tablet bc92f5f36ae94fe09b6017efc6ebbcaf) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.781059 12175 raft_consensus.cc:2241] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.781118 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 53bea49e49d64c7a82c96535db09c87d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.781174 12175 raft_consensus.cc:2270] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.781201 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b82e99ecc994068b7823ef75d5b233f with delete_type TABLET_DATA_DELETED (replaced by tablet 4b76d36bac354543b8f7cef071aaa661) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.781287 12177 tablet_replica.cc:331] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.781416 12177 raft_consensus.cc:2241] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.781546 12175 ts_tablet_manager.cc:1905] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.781579 12177 pending_rounds.cc:70] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:54.781611 12177 pending_rounds.cc:77] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523028756324352 op_type: NO_OP noop_request { }
I20250625 14:01:54.781673 12177 raft_consensus.cc:2887] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.781723 12173 tablet_replica.cc:331] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.781734 12177 raft_consensus.cc:2270] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.781849 12173 raft_consensus.cc:2241] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.781884 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet a22eff28938b419f97ad971c486944ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5bba2990cca6441fb954b2f30f561708) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.781937 12173 raft_consensus.cc:2270] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.782441 12177 ts_tablet_manager.cc:1905] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.782446 12173 ts_tablet_manager.cc:1905] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.782536 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.782666 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 with delete_type TABLET_DATA_DELETED (replaced by tablet bc92f5f36ae94fe09b6017efc6ebbcaf) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.783568 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b82e99ecc994068b7823ef75d5b233f with delete_type TABLET_DATA_DELETED (replaced by tablet 4b76d36bac354543b8f7cef071aaa661) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.783776 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.783769 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 66cab8705ca2439abfa683f8b8b6dc45 (table default.Table_7164bdfcf05f4f20a9cbf6cae2bc2581 [id=66581080a48e4ef9adfd9febad03acf4]) successfully deleted
I20250625 14:01:54.783926 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f6b666bfd4f141db89a35fa818edb378 (table default.Table_8029b9c972e547b0aa052cd38040c777 [id=8e84fd2f33444bdf85d58b0721a0080e]) successfully deleted
W20250625 14:01:54.784183 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9da1d3ee457944399e60e0c5bdd8c428 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9da1d3ee457944399e60e0c5bdd8c428 already in progress: creating tablet
I20250625 14:01:54.784694 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 4a281b2956124ce4b9fd12560bf3d5c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fee92d68eaa4b22a7f0c122aeb5bc44) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.784799 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b82e99ecc994068b7823ef75d5b233f with delete_type TABLET_DATA_DELETED (replaced by tablet 4b76d36bac354543b8f7cef071aaa661) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.785633 12177 ts_tablet_manager.cc:1918] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.785763 12177 log.cc:1199] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/53bea49e49d64c7a82c96535db09c87d
I20250625 14:01:54.786119 12177 ts_tablet_manager.cc:1939] T 53bea49e49d64c7a82c96535db09c87d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.786761 12175 ts_tablet_manager.cc:1918] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.786870 12175 log.cc:1199] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/4a281b2956124ce4b9fd12560bf3d5c1
I20250625 14:01:54.787114 12175 ts_tablet_manager.cc:1939] T 4a281b2956124ce4b9fd12560bf3d5c1 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.787088 12173 ts_tablet_manager.cc:1918] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.787184 12173 log.cc:1199] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d69d6037befe407fb135b49a041c690a
I20250625 14:01:54.787379 12173 ts_tablet_manager.cc:1939] T d69d6037befe407fb135b49a041c690a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.787585 12177 tablet_replica.cc:331] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.787919 12175 tablet_replica.cc:331] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.788062 12175 raft_consensus.cc:2241] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.788184 12175 raft_consensus.cc:2270] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.788235 12172 tablet_bootstrap.cc:492] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.788352 12173 tablet_replica.cc:331] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.788353 12172 ts_tablet_manager.cc:1397] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.000s
I20250625 14:01:54.788472 12173 raft_consensus.cc:2241] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.788560 12173 raft_consensus.cc:2270] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.788564 12175 ts_tablet_manager.cc:1905] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.788923 12172 raft_consensus.cc:357] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.789052 12173 ts_tablet_manager.cc:1905] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.789073 12172 raft_consensus.cc:383] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.789114 12172 raft_consensus.cc:738] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.789355 12172 consensus_queue.cc:260] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.789614 12172 ts_tablet_manager.cc:1428] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.790030 12167 tablet_bootstrap.cc:492] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.790109 12167 ts_tablet_manager.cc:1397] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.115s user 0.001s sys 0.000s
I20250625 14:01:54.784840 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 53bea49e49d64c7a82c96535db09c87d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.790582 12167 raft_consensus.cc:357] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.790686 12167 raft_consensus.cc:383] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.790721 12167 raft_consensus.cc:738] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.790848 12167 consensus_queue.cc:260] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.791132 12167 ts_tablet_manager.cc:1428] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.791352 12167 tablet_bootstrap.cc:492] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.792295 12167 tablet_bootstrap.cc:654] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.793123 12173 ts_tablet_manager.cc:1918] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.793241 12173 log.cc:1199] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/bb24e0ce060c486bae8135e46827d956
I20250625 14:01:54.793478 12173 ts_tablet_manager.cc:1939] T bb24e0ce060c486bae8135e46827d956 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.795177 12172 tablet_bootstrap.cc:492] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.798452 12172 tablet_bootstrap.cc:654] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.798938 12173 tablet_replica.cc:331] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.799158 12173 raft_consensus.cc:2241] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.799154 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 4a281b2956124ce4b9fd12560bf3d5c1 (table default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
I20250625 14:01:54.799352 12173 raft_consensus.cc:2270] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.799372 12166 tablet_bootstrap.cc:492] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.799463 12166 ts_tablet_manager.cc:1397] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.000s
I20250625 14:01:54.799515 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 4dfe24e8280c4675a5a6af9d32fa526e (table default.Table_78f8eff133eb479ab5b94eef76b4992e [id=73fae6a7414940f7ac920b6623c21704]) successfully deleted
W20250625 14:01:54.799670 11517 catalog_manager.cc:4895] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet ff54429a3d3e40688aaea56b70dcdfae because the tablet was not found. No further retry: Not found: Tablet not found: ff54429a3d3e40688aaea56b70dcdfae
I20250625 14:01:54.799790 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d69d6037befe407fb135b49a041c690a (table default.Table_a13429dfda614c5c98a33e244bef1ba3 [id=a8a101206e2e4a35a3123e6f8a2074ce]) successfully deleted
I20250625 14:01:54.799906 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet bb24e0ce060c486bae8135e46827d956 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]) successfully deleted
W20250625 14:01:54.800025 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9da1d3ee457944399e60e0c5bdd8c428 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9da1d3ee457944399e60e0c5bdd8c428 already in progress: creating tablet
I20250625 14:01:54.799970 12166 raft_consensus.cc:357] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.800084 12166 raft_consensus.cc:383] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.800125 12166 raft_consensus.cc:738] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:54.800150 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4a281b2956124ce4b9fd12560bf3d5c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a281b2956124ce4b9fd12560bf3d5c1 already in progress: creating tablet
I20250625 14:01:54.800256 12166 consensus_queue.cc:260] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:54.800294 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8b82e99ecc994068b7823ef75d5b233f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b82e99ecc994068b7823ef75d5b233f already in progress: creating tablet
I20250625 14:01:54.800437 12173 ts_tablet_manager.cc:1905] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.800545 12166 ts_tablet_manager.cc:1428] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.800761 12166 tablet_bootstrap.cc:492] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.801769 12166 tablet_bootstrap.cc:654] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.801844 12177 raft_consensus.cc:2241] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.802035 12177 pending_rounds.cc:70] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:54.802073 12177 pending_rounds.cc:77] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523029824688128 op_type: NO_OP noop_request { }
I20250625 14:01:54.802135 12177 raft_consensus.cc:2887] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.802186 12177 raft_consensus.cc:2270] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.782537 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 4a281b2956124ce4b9fd12560bf3d5c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fee92d68eaa4b22a7f0c122aeb5bc44) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.805326 12166 tablet_bootstrap.cc:492] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.805418 12166 ts_tablet_manager.cc:1397] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
W20250625 14:01:54.805465 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92984f3be8454a969b7c39af97a11479 consensus state has no leader
I20250625 14:01:54.805687 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_04bedd118b064b669bbd67a9e6017fba" } modify_external_catalogs: true
I20250625 14:01:54.805786 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_04bedd118b064b669bbd67a9e6017fba" } modify_external_catalogs: true
I20250625 14:01:54.805850 12177 ts_tablet_manager.cc:1905] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.805900 12166 raft_consensus.cc:357] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.805989 12166 raft_consensus.cc:383] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.806017 12166 raft_consensus.cc:738] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.806133 12166 consensus_queue.cc:260] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.806449 12166 ts_tablet_manager.cc:1428] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.806608 12166 tablet_bootstrap.cc:492] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.807783 12166 tablet_bootstrap.cc:654] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.808298 12177 ts_tablet_manager.cc:1918] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.808370 12177 log.cc:1199] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9b83658ba82e498fbd48134a6a6867b3
I20250625 14:01:54.808399 12175 ts_tablet_manager.cc:1918] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.808477 12175 log.cc:1199] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/53bea49e49d64c7a82c96535db09c87d
I20250625 14:01:54.808702 12175 ts_tablet_manager.cc:1939] T 53bea49e49d64c7a82c96535db09c87d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.809613 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 53bea49e49d64c7a82c96535db09c87d (table default.Table_31fa2df49e0641a3bec420da08de1070 [id=4bdc41d7138c4a099d95a82864c85d8e]) successfully deleted
W20250625 14:01:54.809777 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8b82e99ecc994068b7823ef75d5b233f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b82e99ecc994068b7823ef75d5b233f already in progress: creating tablet
W20250625 14:01:54.809870 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a22eff28938b419f97ad971c486944ff because the tablet was not found. No further retry: Not found: Tablet not found: a22eff28938b419f97ad971c486944ff
I20250625 14:01:54.811082 12167 tablet_bootstrap.cc:492] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.811121 12166 tablet_bootstrap.cc:492] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.811196 12166 ts_tablet_manager.cc:1397] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:54.811203 12167 ts_tablet_manager.cc:1397] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250625 14:01:54.811389 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 53bea49e49d64c7a82c96535db09c87d (table default.Table_31fa2df49e0641a3bec420da08de1070 [id=4bdc41d7138c4a099d95a82864c85d8e]) successfully deleted
I20250625 14:01:54.811691 12166 raft_consensus.cc:357] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.811787 12166 raft_consensus.cc:383] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.811821 12166 raft_consensus.cc:738] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.811936 12166 consensus_queue.cc:260] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.812606 12166 ts_tablet_manager.cc:1428] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.813295 12167 raft_consensus.cc:357] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.813422 12167 raft_consensus.cc:383] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.813460 12167 raft_consensus.cc:738] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.813675 12167 consensus_queue.cc:260] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.808640 12177 ts_tablet_manager.cc:1939] T 9b83658ba82e498fbd48134a6a6867b3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.814487 12177 tablet_replica.cc:331] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:01:54.817504 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b76d36bac354543b8f7cef071aaa661 has no consensus state
I20250625 14:01:54.818132 12167 ts_tablet_manager.cc:1428] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:54.818444 11528 catalog_manager.cc:5582] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:54.818645 11528 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d (table default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]). Expected version 1 got 0
I20250625 14:01:54.818768 11528 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f0c5509615cf45339c455e8add91a96f (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]). Expected version 2 got 0
I20250625 14:01:54.818967 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 61acdd21d02e4576adba8f2ff24a154a (DEFAULT_TABLE table=default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9 [id=75fe7cfcdb0c446f9af9708ba107c0b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.819272 12167 tablet_bootstrap.cc:492] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:54.819459 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39ff4b0e7ac74ec294550775aaa44468 consensus state has no leader
I20250625 14:01:54.819765 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61acdd21d02e4576adba8f2ff24a154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.820331 12167 tablet_bootstrap.cc:654] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.820767 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9b83658ba82e498fbd48134a6a6867b3 (table default.Table_15fa1e0db4314493a834a5c7ff218574 [id=bf0cf9729bbd45619fd4c852f572bc60]) successfully deleted
I20250625 14:01:54.821810 12055 raft_consensus.cc:3058] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.822811 12265 raft_consensus.cc:491] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.822906 12265 raft_consensus.cc:513] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.823324 12265 leader_election.cc:290] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:54.824266 12584 tablet.cc:1722] T 80f4e61e39894e88b3497328da8f7d01 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.824383 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef65dc31dc5843fb9e25275af5935e73" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:54.824721 11855 leader_election.cc:343] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.825572 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 61acdd21d02e4576adba8f2ff24a154a (DEFAULT_TABLE table=default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9 [id=75fe7cfcdb0c446f9af9708ba107c0b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.825971 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 33790cc725df482e91daceca29c820eb (DEFAULT_TABLE table=default.Table_046e760e5933440995f2198870cdbc31 [id=6ef064ea2c9d4934903469536450aad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.826632 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33790cc725df482e91daceca29c820eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.821588 12172 tablet_bootstrap.cc:492] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.821930 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 33790cc725df482e91daceca29c820eb (DEFAULT_TABLE table=default.Table_046e760e5933440995f2198870cdbc31 [id=6ef064ea2c9d4934903469536450aad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.827306 11754 tablet_service.cc:1468] Processing CreateTablet for tablet fc948c61d54a4618856b64a12a32b2c4 (DEFAULT_TABLE table=default.Table_1809d17fc2ca4fc294f2c0b3cbec2866 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.827513 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33790cc725df482e91daceca29c820eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.827530 12175 tablet_replica.cc:331] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.827687 12175 raft_consensus.cc:2241] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.827800 12175 raft_consensus.cc:2270] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.828620 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc948c61d54a4618856b64a12a32b2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.829604 12173 ts_tablet_manager.cc:1918] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.822068 11764 tablet_service.cc:1468] Processing CreateTablet for tablet e62aba799c354c178db2d8c31ce7e969 (DEFAULT_TABLE table=default.Table_2135205cf6d1472983740c9119df79a9 [id=90c7ea61891b4b628602af4547ddb8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.829677 12173 log.cc:1199] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/53bea49e49d64c7a82c96535db09c87d
I20250625 14:01:54.829849 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62aba799c354c178db2d8c31ce7e969. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.829891 12173 ts_tablet_manager.cc:1939] T 53bea49e49d64c7a82c96535db09c87d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.830979 11897 tablet_service.cc:1468] Processing CreateTablet for tablet e7300adf77db4dafa942e06f07e635a9 (DEFAULT_TABLE table=default.Table_daa46b6e09604fbe821817cc42384742 [id=ccb915c6ee95448296116b2791b3ed0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.831521 12030 tablet_service.cc:1468] Processing CreateTablet for tablet e62aba799c354c178db2d8c31ce7e969 (DEFAULT_TABLE table=default.Table_2135205cf6d1472983740c9119df79a9 [id=90c7ea61891b4b628602af4547ddb8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.831732 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62aba799c354c178db2d8c31ce7e969. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.831665 11527 catalog_manager.cc:5582] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:54.831951 11527 catalog_manager.cc:5582] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:54.832142 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 33790cc725df482e91daceca29c820eb (DEFAULT_TABLE table=default.Table_046e760e5933440995f2198870cdbc31 [id=6ef064ea2c9d4934903469536450aad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.822170 11762 tablet_service.cc:1468] Processing CreateTablet for tablet e7300adf77db4dafa942e06f07e635a9 (DEFAULT_TABLE table=default.Table_daa46b6e09604fbe821817cc42384742 [id=ccb915c6ee95448296116b2791b3ed0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.832265 11527 catalog_manager.cc:5582] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:54.832423 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7300adf77db4dafa942e06f07e635a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.832428 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_b5db9b5292a6461bac446f5ebc358c27 [id=f8e4990b036541f1b033de99bff1accc]). Expected version 1 got 0
I20250625 14:01:54.833909 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489] alter complete (version 2)
I20250625 14:01:54.823639 11763 tablet_service.cc:1468] Processing CreateTablet for tablet c474af1901c74e6895c3a08f1cc7c65c (DEFAULT_TABLE table=default.Table_86978c9f798f4082adf63c1c04b549a6 [id=db2410fbfdb04e9980e32af6f24ae771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.834425 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c474af1901c74e6895c3a08f1cc7c65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.834568 12167 tablet_bootstrap.cc:492] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
W20250625 14:01:54.834565 11528 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet f0c5509615cf45339c455e8add91a96f (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet f0c5509615cf45339c455e8add91a96f consensus state has no leader
I20250625 14:01:54.834760 12167 ts_tablet_manager.cc:1397] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250625 14:01:54.835260 11902 tablet_service.cc:1468] Processing CreateTablet for tablet e62aba799c354c178db2d8c31ce7e969 (DEFAULT_TABLE table=default.Table_2135205cf6d1472983740c9119df79a9 [id=90c7ea61891b4b628602af4547ddb8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.835376 12030 tablet_service.cc:1468] Processing CreateTablet for tablet c474af1901c74e6895c3a08f1cc7c65c (DEFAULT_TABLE table=default.Table_86978c9f798f4082adf63c1c04b549a6 [id=db2410fbfdb04e9980e32af6f24ae771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.835592 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c474af1901c74e6895c3a08f1cc7c65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.835587 12167 raft_consensus.cc:357] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.835703 12167 raft_consensus.cc:383] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.835734 12167 raft_consensus.cc:738] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.835850 12167 consensus_queue.cc:260] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.824119 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef65dc31dc5843fb9e25275af5935e73" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.836578 12238 raft_consensus.cc:491] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.836632 12167 ts_tablet_manager.cc:1428] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:54.836659 12238 raft_consensus.cc:513] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.836805 12167 tablet_bootstrap.cc:492] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.837004 12238 leader_election.cc:290] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:54.837177 11858 leader_election.cc:343] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.837260 11858 leader_election.cc:304] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.824389 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 96984bb93836413a85f112f7d162598f (DEFAULT_TABLE table=default.Table_4d04289158c94a1a95157a785c3d5829 [id=ffe2f2ab5919440396e245783c966fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.837661 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96984bb93836413a85f112f7d162598f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.837836 12167 tablet_bootstrap.cc:654] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.838848 12167 tablet_bootstrap.cc:492] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.838923 12167 ts_tablet_manager.cc:1397] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:54.839370 12167 raft_consensus.cc:357] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.839493 12167 raft_consensus.cc:383] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.839527 12167 raft_consensus.cc:738] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.825191 11757 tablet_service.cc:1468] Processing CreateTablet for tablet e307709d217643358c7c3efb3dd73747 (DEFAULT_TABLE table=default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.839653 12167 consensus_queue.cc:260] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.839821 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e307709d217643358c7c3efb3dd73747. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.839921 12167 ts_tablet_manager.cc:1428] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:54.840080 12167 tablet_bootstrap.cc:492] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.840620 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 144ba67ce1fa419cac46e40ebcc078e6
I20250625 14:01:54.841615 12167 tablet_bootstrap.cc:654] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.825858 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 61acdd21d02e4576adba8f2ff24a154a (DEFAULT_TABLE table=default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9 [id=75fe7cfcdb0c446f9af9708ba107c0b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.842125 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61acdd21d02e4576adba8f2ff24a154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.826478 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d (DEFAULT_TABLE table=default.Table_009dda51059342099345e5463b33f6f5 [id=5344fd676e7a42d8b33297cda611d5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.845118 12265 raft_consensus.cc:2747] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.845306 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704ecf1ea8dd423ead2a0d1be113c03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.845757 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91fe26db32a44fb08efa3809f0fddfae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.846254 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91fe26db32a44fb08efa3809f0fddfae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.846419 11920 raft_consensus.cc:2466] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:54.846576 11717 leader_election.cc:343] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.846715 11717 leader_election.cc:304] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.846910 12205 raft_consensus.cc:2802] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.846962 12205 raft_consensus.cc:491] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.847021 12205 raft_consensus.cc:3058] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.826680 11756 tablet_service.cc:1468] Processing CreateTablet for tablet e3af8a01ca1f49afb8aa1834807abf7e (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.847458 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3af8a01ca1f49afb8aa1834807abf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.847947 12205 raft_consensus.cc:513] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.848241 12205 leader_election.cc:290] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.849040 12166 tablet_bootstrap.cc:492] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.827044 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 5bba2990cca6441fb954b2f30f561708 (DEFAULT_TABLE table=default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.849525 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bba2990cca6441fb954b2f30f561708. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.827318 12172 ts_tablet_manager.cc:1397] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.001s
I20250625 14:01:54.849750 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91fe26db32a44fb08efa3809f0fddfae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.849853 11920 raft_consensus.cc:3058] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.850170 12172 raft_consensus.cc:357] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.850226 12166 tablet_bootstrap.cc:654] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.850257 12172 raft_consensus.cc:383] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.850288 12172 raft_consensus.cc:738] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.850442 12172 consensus_queue.cc:260] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.850787 12172 ts_tablet_manager.cc:1428] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.850898 11920 raft_consensus.cc:2466] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.851287 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "91fe26db32a44fb08efa3809f0fddfae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.851552 11717 leader_election.cc:304] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.851732 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7300adf77db4dafa942e06f07e635a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.851807 11717 leader_election.cc:343] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.852399 12238 raft_consensus.cc:2802] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.852488 12238 raft_consensus.cc:695] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.852610 12238 consensus_queue.cc:237] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.853503 12166 tablet_bootstrap.cc:492] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.853598 12166 ts_tablet_manager.cc:1397] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:54.853961 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61acdd21d02e4576adba8f2ff24a154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.854101 12166 raft_consensus.cc:357] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.854234 12166 raft_consensus.cc:383] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.854281 12166 raft_consensus.cc:738] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.854697 12166 consensus_queue.cc:260] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.855020 12166 ts_tablet_manager.cc:1428] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.855190 12265 raft_consensus.cc:491] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.855257 12265 raft_consensus.cc:513] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.855582 12265 leader_election.cc:290] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.855808 12166 tablet_bootstrap.cc:492] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.856052 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "25160014ecf74c2ab6f1faca42d30c47" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.856160 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "25160014ecf74c2ab6f1faca42d30c47" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:54.856600 11858 leader_election.cc:343] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.856861 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62aba799c354c178db2d8c31ce7e969. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.856928 12172 tablet_bootstrap.cc:492] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.856868 12166 tablet_bootstrap.cc:654] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:54.857352 11855 leader_election.cc:343] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.857429 11855 leader_election.cc:304] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.857690 12265 raft_consensus.cc:2747] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.858244 12167 tablet_bootstrap.cc:492] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.858377 12167 ts_tablet_manager.cc:1397] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:01:54.858843 12172 tablet_bootstrap.cc:654] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.858858 12167 raft_consensus.cc:357] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.858958 12167 raft_consensus.cc:383] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.858985 12167 raft_consensus.cc:738] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.859092 12167 consensus_queue.cc:260] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.859184 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33790cc725df482e91daceca29c820eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.859350 12167 ts_tablet_manager.cc:1428] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.859516 12167 tablet_bootstrap.cc:492] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.860935 12171 raft_consensus.cc:491] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.861034 12171 raft_consensus.cc:513] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.861395 12167 tablet_bootstrap.cc:654] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.861411 12171 leader_election.cc:290] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.862561 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d1c412286d94eedac62cf4f1f939f68" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.862722 11920 raft_consensus.cc:2391] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:54.862952 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d1c412286d94eedac62cf4f1f939f68" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.863317 11993 leader_election.cc:304] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.863571 12171 raft_consensus.cc:3058] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.863747 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.864420 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 5d1979e44eab46c7a54a204603963839 (DEFAULT_TABLE table=default.Table_f8f9e822f0d4483f8b4af1775c472dc2 [id=0a1fbbbc90124c79b0735327a9836f18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.864524 11902 tablet_service.cc:1468] Processing CreateTablet for tablet c474af1901c74e6895c3a08f1cc7c65c (DEFAULT_TABLE table=default.Table_86978c9f798f4082adf63c1c04b549a6 [id=db2410fbfdb04e9980e32af6f24ae771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.864619 12171 raft_consensus.cc:2747] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.864809 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c474af1901c74e6895c3a08f1cc7c65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.865401 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_18fd74110fdc485d839fae5cc2b22cfd" } modify_external_catalogs: true
I20250625 14:01:54.865424 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e16bd386c64c4f6ea20141ecdc8b91ad" } modify_external_catalogs: true
I20250625 14:01:54.865558 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_18fd74110fdc485d839fae5cc2b22cfd" } modify_external_catalogs: true
I20250625 14:01:54.865563 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e16bd386c64c4f6ea20141ecdc8b91ad" } modify_external_catalogs: true
I20250625 14:01:54.868067 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 96984bb93836413a85f112f7d162598f (DEFAULT_TABLE table=default.Table_4d04289158c94a1a95157a785c3d5829 [id=ffe2f2ab5919440396e245783c966fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.868433 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96984bb93836413a85f112f7d162598f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.869778 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1979e44eab46c7a54a204603963839. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.870078 12177 raft_consensus.cc:2241] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.870353 12177 pending_rounds.cc:70] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:54.870395 12177 pending_rounds.cc:77] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523030029651968 op_type: NO_OP noop_request { }
I20250625 14:01:54.870452 12177 raft_consensus.cc:2887] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:54.870510 12177 raft_consensus.cc:2270] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.871328 12177 ts_tablet_manager.cc:1905] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.871883 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b77e6933073d4d4eb6a1a937e5d0347e" } modify_external_catalogs: true
I20250625 14:01:54.871995 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b77e6933073d4d4eb6a1a937e5d0347e" } modify_external_catalogs: true
I20250625 14:01:54.873211 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d (DEFAULT_TABLE table=default.Table_009dda51059342099345e5463b33f6f5 [id=5344fd676e7a42d8b33297cda611d5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.873364 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d (DEFAULT_TABLE table=default.Table_009dda51059342099345e5463b33f6f5 [id=5344fd676e7a42d8b33297cda611d5bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.873517 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704ecf1ea8dd423ead2a0d1be113c03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.873611 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704ecf1ea8dd423ead2a0d1be113c03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.874076 12171 raft_consensus.cc:491] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.874157 12171 raft_consensus.cc:513] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.874573 12171 leader_election.cc:290] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.875766 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.875995 11898 tablet_service.cc:1468] Processing CreateTablet for tablet e307709d217643358c7c3efb3dd73747 (DEFAULT_TABLE table=default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.876255 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e307709d217643358c7c3efb3dd73747. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.876773 12171 raft_consensus.cc:491] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 14:01:54.876804 11990 leader_election.cc:343] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: c5e5954a01aa472999e9ac079f706f4b
I20250625 14:01:54.876861 12171 raft_consensus.cc:513] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.877283 12171 leader_election.cc:290] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.877795 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8d6c5552b204ec1b2f5e4bf9eba5640" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.877944 11920 raft_consensus.cc:2391] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:54.878531 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 96984bb93836413a85f112f7d162598f (DEFAULT_TABLE table=default.Table_4d04289158c94a1a95157a785c3d5829 [id=ffe2f2ab5919440396e245783c966fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.878762 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96984bb93836413a85f112f7d162598f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.878818 12032 tablet_service.cc:1468] Processing CreateTablet for tablet e7300adf77db4dafa942e06f07e635a9 (DEFAULT_TABLE table=default.Table_daa46b6e09604fbe821817cc42384742 [id=ccb915c6ee95448296116b2791b3ed0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.879063 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7300adf77db4dafa942e06f07e635a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:54.881886 11993 leader_election.cc:343] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: c5e5954a01aa472999e9ac079f706f4b
I20250625 14:01:54.881976 11993 leader_election.cc:304] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.882062 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 53bea49e49d64c7a82c96535db09c87d (table default.Table_31fa2df49e0641a3bec420da08de1070 [id=4bdc41d7138c4a099d95a82864c85d8e]) successfully deleted
I20250625 14:01:54.882215 12171 raft_consensus.cc:2747] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.883983 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 5bba2990cca6441fb954b2f30f561708 (DEFAULT_TABLE table=default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.884056 11897 tablet_service.cc:1468] Processing CreateTablet for tablet fc948c61d54a4618856b64a12a32b2c4 (DEFAULT_TABLE table=default.Table_1809d17fc2ca4fc294f2c0b3cbec2866 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.884263 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bba2990cca6441fb954b2f30f561708. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.884967 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc948c61d54a4618856b64a12a32b2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.886405 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a8d6c5552b204ec1b2f5e4bf9eba5640" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.886862 11993 leader_election.cc:304] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.886857 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9a5399f5e7f14c7985451d22a883e2eb" } new_table_name: "default.Table_3d82e197e7174db08e444c89b45c77be" modify_external_catalogs: true
I20250625 14:01:54.887142 12171 raft_consensus.cc:3058] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.887534 12030 tablet_service.cc:1468] Processing CreateTablet for tablet e307709d217643358c7c3efb3dd73747 (DEFAULT_TABLE table=default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.888044 12171 raft_consensus.cc:2747] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.890022 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e307709d217643358c7c3efb3dd73747. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.890769 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 5bba2990cca6441fb954b2f30f561708 (DEFAULT_TABLE table=default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.891242 12238 raft_consensus.cc:491] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.891345 12238 raft_consensus.cc:513] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.891707 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bba2990cca6441fb954b2f30f561708. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.891714 12238 leader_election.cc:290] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.892880 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fc2766f8e0b544b0b48a0e7e5952d672" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.891084 11895 tablet_service.cc:1468] Processing CreateTablet for tablet e3af8a01ca1f49afb8aa1834807abf7e (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.893436 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3af8a01ca1f49afb8aa1834807abf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.893574 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.893761 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet ef65dc31dc5843fb9e25275af5935e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.892623 12175 ts_tablet_manager.cc:1905] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.894204 11717 leader_election.cc:343] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.894246 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fc2766f8e0b544b0b48a0e7e5952d672" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.894383 11920 raft_consensus.cc:2466] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.894624 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.894632 11717 leader_election.cc:304] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.894392 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.894816 12238 raft_consensus.cc:2802] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.894822 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 with delete_type TABLET_DATA_DELETED (replaced by tablet 68a0cfeac48042bdaea66c3b0e370480) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.894869 12238 raft_consensus.cc:491] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.894912 12238 raft_consensus.cc:3058] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.895996 12238 raft_consensus.cc:513] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.896337 12238 leader_election.cc:290] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.896888 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fc2766f8e0b544b0b48a0e7e5952d672" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.896914 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fc2766f8e0b544b0b48a0e7e5952d672" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.896996 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.897023 11920 raft_consensus.cc:3058] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:54.897352 11717 leader_election.cc:343] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.897850 11920 raft_consensus.cc:2466] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.898344 12175 ts_tablet_manager.cc:1918] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.898418 12175 log.cc:1199] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8a4d01792d40471ab6d5bafa1a308351
I20250625 14:01:54.898626 12175 ts_tablet_manager.cc:1939] T 8a4d01792d40471ab6d5bafa1a308351 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.899453 12175 tablet_replica.cc:331] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.899600 12175 raft_consensus.cc:2241] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.899705 12175 raft_consensus.cc:2270] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.900455 11717 leader_election.cc:304] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.900514 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.900738 12238 raft_consensus.cc:2802] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.900841 12238 raft_consensus.cc:695] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.900997 12238 consensus_queue.cc:237] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.901130 12036 tablet_service.cc:1468] Processing CreateTablet for tablet fc948c61d54a4618856b64a12a32b2c4 (DEFAULT_TABLE table=default.Table_1809d17fc2ca4fc294f2c0b3cbec2866 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.901360 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 5d1979e44eab46c7a54a204603963839 (DEFAULT_TABLE table=default.Table_f8f9e822f0d4483f8b4af1775c472dc2 [id=0a1fbbbc90124c79b0735327a9836f18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.901450 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc948c61d54a4618856b64a12a32b2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.901620 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1979e44eab46c7a54a204603963839. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.902529 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 5d1979e44eab46c7a54a204603963839 (DEFAULT_TABLE table=default.Table_f8f9e822f0d4483f8b4af1775c472dc2 [id=0a1fbbbc90124c79b0735327a9836f18]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.902798 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1979e44eab46c7a54a204603963839. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.904592 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8a4d01792d40471ab6d5bafa1a308351 (table default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]) successfully deleted
W20250625 14:01:54.904745 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8b82e99ecc994068b7823ef75d5b233f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b82e99ecc994068b7823ef75d5b233f already in progress: creating tablet
I20250625 14:01:54.905337 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.906635 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]). Expected version 1 got 0
I20250625 14:01:54.906667 12056 raft_consensus.cc:1273] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:54.907168 12238 consensus_queue.cc:1035] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.908442 11920 raft_consensus.cc:1273] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:54.908631 11531 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 6e170055982e4eb6ae2f7ee4b7665643
I20250625 14:01:54.908999 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet ab957f1fd4214efbb6233f312617c728 with delete_type TABLET_DATA_DELETED (replaced by tablet ee3cc1074818466a97d04f0136eaea92) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.909196 12238 consensus_queue.cc:1035] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.909731 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 36da902c99bf4416aa0769438182e443
I20250625 14:01:54.910264 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f0614c0f5cc248abab27fbb94b971289"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.910537 12177 ts_tablet_manager.cc:1918] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:54.910604 12177 log.cc:1199] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8a4d01792d40471ab6d5bafa1a308351
W20250625 14:01:54.910778 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0614c0f5cc248abab27fbb94b971289 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.910869 12177 ts_tablet_manager.cc:1939] T 8a4d01792d40471ab6d5bafa1a308351 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:54.911371 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 36da902c99bf4416aa0769438182e443 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.912037 12265 raft_consensus.cc:491] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.912124 12265 raft_consensus.cc:513] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.912493 12265 leader_election.cc:290] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:54.912968 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0c5509615cf45339c455e8add91a96f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.914345 12172 tablet_bootstrap.cc:492] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:54.914456 12172 ts_tablet_manager.cc:1397] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.002s
W20250625 14:01:54.914441 11858 leader_election.cc:343] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.914965 12172 raft_consensus.cc:357] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.915088 12172 raft_consensus.cc:383] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.915122 12172 raft_consensus.cc:738] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.915243 12172 consensus_queue.cc:260] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.916792 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5bba2990cca6441fb954b2f30f561708
I20250625 14:01:54.918401 12032 tablet_service.cc:1468] Processing CreateTablet for tablet e3af8a01ca1f49afb8aa1834807abf7e (DEFAULT_TABLE table=default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.918758 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3af8a01ca1f49afb8aa1834807abf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.918943 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]). Expected version 1 got 0
I20250625 14:01:54.919356 12172 ts_tablet_manager.cc:1428] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:01:54.919600 12172 tablet_bootstrap.cc:492] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:54.919792 12171 raft_consensus.cc:491] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.919878 12171 raft_consensus.cc:513] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.920320 12171 leader_election.cc:290] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.920572 12171 raft_consensus.cc:491] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.920645 12171 raft_consensus.cc:513] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:54.920847 11990 leader_election.cc:343] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 4a281b2956124ce4b9fd12560bf3d5c1
I20250625 14:01:54.920943 12171 leader_election.cc:290] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.921193 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44d41513c1d444cba5288a05f2c4652c" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.921567 12172 tablet_bootstrap.cc:654] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.922726 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 22cfc7f3b1564e4f91114cd5e049da0d from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:54.924407 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet c5e5954a01aa472999e9ac079f706f4b with delete_type TABLET_DATA_DELETED (replaced by tablet ef65dc31dc5843fb9e25275af5935e73) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.924551 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4a281b2956124ce4b9fd12560bf3d5c1" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.924685 11783 raft_consensus.cc:2466] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:54.924885 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44d41513c1d444cba5288a05f2c4652c" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:54.925019 11784 raft_consensus.cc:2391] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:54.925002 12055 raft_consensus.cc:3058] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.925215 12173 tablet_replica.cc:331] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.925355 12173 raft_consensus.cc:2241] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.925455 12173 raft_consensus.cc:2270] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.925657 11993 leader_election.cc:304] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:01:54.926023 11993 leader_election.cc:304] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:54.926059 12173 ts_tablet_manager.cc:1905] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.926244 12178 raft_consensus.cc:2802] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.926298 12178 raft_consensus.cc:491] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.926379 12178 raft_consensus.cc:3058] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.927294 12590 mvcc.cc:204] Tried to move back new op lower bound from 7171523029057564672 to 7171523026534834176. Current Snapshot: MvccSnapshot[applied={T|T < 7171523029057564672}]
I20250625 14:01:54.927316 12178 raft_consensus.cc:513] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.927413 12584 tablet.cc:1722] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.927660 12178 leader_election.cc:290] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:54.927749 12178 raft_consensus.cc:3058] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.928485 12173 ts_tablet_manager.cc:1918] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.928553 12173 log.cc:1199] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c5e5954a01aa472999e9ac079f706f4b
I20250625 14:01:54.928789 12173 ts_tablet_manager.cc:1939] T c5e5954a01aa472999e9ac079f706f4b P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.929039 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 5bba2990cca6441fb954b2f30f561708 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.929124 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 36da902c99bf4416aa0769438182e443 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.929433 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b83658ba82e498fbd48134a6a6867b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.928550 12178 raft_consensus.cc:2747] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:54.929898 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7302430d7e4a4610bfe271c114718d35 consensus state has no leader
W20250625 14:01:54.930174 11990 leader_election.cc:343] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 4a281b2956124ce4b9fd12560bf3d5c1
I20250625 14:01:54.931180 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.931560 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 4a281b2956124ce4b9fd12560bf3d5c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8fee92d68eaa4b22a7f0c122aeb5bc44) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.931778 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0c5509615cf45339c455e8add91a96f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.932049 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 5bba2990cca6441fb954b2f30f561708 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.932089 12054 raft_consensus.cc:3058] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.932197 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 36da902c99bf4416aa0769438182e443 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.933190 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4a281b2956124ce4b9fd12560bf3d5c1" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:54.933311 11784 raft_consensus.cc:3058] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:54.933347 11855 leader_election.cc:343] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.933427 11855 leader_election.cc:304] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.933554 12265 raft_consensus.cc:2747] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.934206 11784 raft_consensus.cc:2466] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:54.934738 11993 leader_election.cc:304] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:01:54.934844 12238 raft_consensus.cc:491] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.934947 12238 raft_consensus.cc:513] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.935115 12668 raft_consensus.cc:2802] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.935303 12238 leader_election.cc:290] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.935559 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "599bd5368dfc4ea0bd23ea4f18fe3c60" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.935657 12265 consensus_queue.cc:1035] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.935667 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "599bd5368dfc4ea0bd23ea4f18fe3c60" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.935335 12668 raft_consensus.cc:695] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:54.935997 12173 tablet_replica.cc:331] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.936187 12173 raft_consensus.cc:2241] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.936328 12173 raft_consensus.cc:2270] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:54.936384 11717 leader_election.cc:343] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:54.936520 11717 leader_election.cc:343] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.936578 11717 leader_election.cc:304] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:54.936736 12238 raft_consensus.cc:2747] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:54.937045 12173 ts_tablet_manager.cc:1905] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.938937 12175 ts_tablet_manager.cc:1905] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.939607 12173 ts_tablet_manager.cc:1918] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:54.939731 12173 log.cc:1199] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/36da902c99bf4416aa0769438182e443
I20250625 14:01:54.940029 12173 ts_tablet_manager.cc:1939] T 36da902c99bf4416aa0769438182e443 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.940563 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:54.940856 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 5bba2990cca6441fb954b2f30f561708 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:54.941017 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.941360 12173 tablet_replica.cc:331] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.941536 12173 raft_consensus.cc:2241] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.941691 12173 raft_consensus.cc:2270] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.941896 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_03ca42d86d7d454699eea52f84b29ffb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:54.942268 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03ca42d86d7d454699eea52f84b29ffb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:54.942694 12233 tablet.cc:1722] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.943174 12173 ts_tablet_manager.cc:1905] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.944448 12584 tablet.cc:1722] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.944880 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 22cfc7f3b1564e4f91114cd5e049da0d
I20250625 14:01:54.935968 12668 consensus_queue.cc:237] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.945178 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 22cfc7f3b1564e4f91114cd5e049da0d deleted and replaced by tablet bfdb34255cb147c48a322514b7a7a19d
I20250625 14:01:54.947532 12173 ts_tablet_manager.cc:1918] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.950038 12175 ts_tablet_manager.cc:1918] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.950744 12175 log.cc:1199] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9b83658ba82e498fbd48134a6a6867b3
I20250625 14:01:54.951675 12205 raft_consensus.cc:491] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.951778 12205 raft_consensus.cc:513] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.952150 12205 leader_election.cc:290] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:54.953042 12265 consensus_queue.cc:1035] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.953461 12166 tablet_bootstrap.cc:492] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.953560 12166 ts_tablet_manager.cc:1397] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.000s
I20250625 14:01:54.954074 12166 raft_consensus.cc:357] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.954183 12166 raft_consensus.cc:383] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.954221 12166 raft_consensus.cc:738] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.954342 12166 consensus_queue.cc:260] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.954667 12166 ts_tablet_manager.cc:1428] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.954852 12166 tablet_bootstrap.cc:492] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.955452 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c5e5954a01aa472999e9ac079f706f4b (table default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]) successfully deleted
W20250625 14:01:54.955616 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5bba2990cca6441fb954b2f30f561708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bba2990cca6441fb954b2f30f561708 already in progress: creating tablet
I20250625 14:01:54.956178 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 36da902c99bf4416aa0769438182e443 (table default.Table_18fd74110fdc485d839fae5cc2b22cfd [id=a32feaf4c2f74d1bbd361e7680395682]) successfully deleted
I20250625 14:01:54.959030 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]). Expected version 1 got 0
I20250625 14:01:54.960765 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc92f5f36ae94fe09b6017efc6ebbcaf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.960911 11920 raft_consensus.cc:2466] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.961418 12177 tablet_replica.cc:331] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:54.961570 12177 raft_consensus.cc:2241] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.961846 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8a4d01792d40471ab6d5bafa1a308351 (table default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]) successfully deleted
I20250625 14:01:54.962684 12210 mvcc.cc:204] Tried to move back new op lower bound from 7171523030645604352 to 7171523029267431424. Current Snapshot: MvccSnapshot[applied={T|T < 7171523030645604352}]
I20250625 14:01:54.963093 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 22cfc7f3b1564e4f91114cd5e049da0d with delete_type TABLET_DATA_DELETED (replaced by tablet bfdb34255cb147c48a322514b7a7a19d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:54.963152 12430 tablet.cc:1722] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:54.963944 11783 raft_consensus.cc:1273] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:54.964810 12600 consensus_queue.cc:1035] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:54.965032 11855 consensus_peers.cc:487] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:54.956667 12167 tablet_bootstrap.cc:492] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:54.966329 12167 ts_tablet_manager.cc:1397] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.107s user 0.002s sys 0.000s
I20250625 14:01:54.966500 12265 consensus_queue.cc:1035] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.960031 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 22cfc7f3b1564e4f91114cd5e049da0d with delete_type TABLET_DATA_DELETED (replaced by tablet bfdb34255cb147c48a322514b7a7a19d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:54.966900 12167 raft_consensus.cc:357] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.967008 12167 raft_consensus.cc:383] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.967042 12167 raft_consensus.cc:738] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.967168 12167 consensus_queue.cc:260] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.967483 12167 ts_tablet_manager.cc:1428] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.967665 12167 tablet_bootstrap.cc:492] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:54.960788 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc92f5f36ae94fe09b6017efc6ebbcaf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:54.968015 11717 leader_election.cc:304] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.968168 12180 raft_consensus.cc:2802] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.968225 12180 raft_consensus.cc:491] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.968282 12180 raft_consensus.cc:3058] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.968600 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 22cfc7f3b1564e4f91114cd5e049da0d with delete_type TABLET_DATA_DELETED (replaced by tablet bfdb34255cb147c48a322514b7a7a19d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:54.969381 12180 raft_consensus.cc:513] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.969738 12180 leader_election.cc:290] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:01:54.970093 11717 leader_election.cc:343] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.970238 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc92f5f36ae94fe09b6017efc6ebbcaf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.971397 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bc92f5f36ae94fe09b6017efc6ebbcaf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.971518 11920 raft_consensus.cc:3058] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:54.972086 11717 leader_election.cc:343] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:54.972185 12177 raft_consensus.cc:2270] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.972568 12167 tablet_bootstrap.cc:654] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.972596 11920 raft_consensus.cc:2466] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:54.973455 11717 leader_election.cc:304] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:54.973665 12238 raft_consensus.cc:2802] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:54.973754 12238 raft_consensus.cc:695] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:54.973896 12238 consensus_queue.cc:237] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:54.975236 11527 catalog_manager.cc:5582] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:54.975476 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 91fe26db32a44fb08efa3809f0fddfae (table default.Table_07d074214aae4c1ab81b65f2859410a6 [id=9aceda4c69be483c9c6efff41eb01322]). Expected version 1 got 0
I20250625 14:01:54.978703 12173 log.cc:1199] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9b83658ba82e498fbd48134a6a6867b3
I20250625 14:01:54.978718 12180 raft_consensus.cc:491] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:54.978823 12180 raft_consensus.cc:513] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.979171 12180 leader_election.cc:290] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.979352 12173 ts_tablet_manager.cc:1939] T 9b83658ba82e498fbd48134a6a6867b3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:54.979712 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 882da47c1f5a496f8df2ba2d3501b453 (DEFAULT_TABLE table=default.Table_8abc4f3249834149817f4c730d26b806 [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.980216 12173 tablet_replica.cc:331] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:54.980227 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882da47c1f5a496f8df2ba2d3501b453. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.984086 12265 consensus_queue.cc:1035] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:54.984973 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 882da47c1f5a496f8df2ba2d3501b453 (DEFAULT_TABLE table=default.Table_8abc4f3249834149817f4c730d26b806 [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.985276 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882da47c1f5a496f8df2ba2d3501b453. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.986195 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 56250a60d7104f22bd4b2206f3a5df14 (DEFAULT_TABLE table=default.Table_7b8124c1ff214ffaa4645d62d65091ff [id=e1d9126672684e808d499d3902fc371b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:54.986460 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56250a60d7104f22bd4b2206f3a5df14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.980381 12173 raft_consensus.cc:2241] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:54.989742 12173 pending_rounds.cc:70] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:01:54.990465 12175 ts_tablet_manager.cc:1939] T 9b83658ba82e498fbd48134a6a6867b3 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:54.990680 12166 tablet_bootstrap.cc:654] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.991365 12175 tablet_replica.cc:331] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:54.991459 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b4141fcafbc4a6f96504bf47539b8ae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:54.991832 11920 raft_consensus.cc:2466] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:54.992223 12175 raft_consensus.cc:2241] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:54.992321 12166 tablet_bootstrap.cc:492] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:54.992345 11717 leader_election.cc:304] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:54.992431 12166 ts_tablet_manager.cc:1397] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20250625 14:01:54.992785 12180 raft_consensus.cc:2802] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:54.992846 12180 raft_consensus.cc:491] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:54.992884 12180 raft_consensus.cc:3058] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:54.992902 12177 ts_tablet_manager.cc:1905] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:54.992919 12166 raft_consensus.cc:357] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.993027 12166 raft_consensus.cc:383] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:54.993062 12166 raft_consensus.cc:738] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:54.993199 12166 consensus_queue.cc:260] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:54.993512 12166 ts_tablet_manager.cc:1428] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:54.993712 12166 tablet_bootstrap.cc:492] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:54.993927 12180 raft_consensus.cc:513] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:54.994860 12166 tablet_bootstrap.cc:654] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:54.995043 12177 ts_tablet_manager.cc:1918] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:54.995107 12177 log.cc:1199] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/4a281b2956124ce4b9fd12560bf3d5c1
I20250625 14:01:54.995775 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184] alter complete (version 1)
I20250625 14:01:54.995865 12180 leader_election.cc:290] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:54.996964 12175 raft_consensus.cc:2270] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.997167 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b4141fcafbc4a6f96504bf47539b8ae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:54.998123 12175 ts_tablet_manager.cc:1905] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:54.999927 11717 leader_election.cc:343] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.000196 12430 tablet.cc:1722] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.001065 12175 ts_tablet_manager.cc:1918] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.001206 12175 log.cc:1199] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6b4141fcafbc4a6f96504bf47539b8ae
I20250625 14:01:55.001502 12175 ts_tablet_manager.cc:1939] T 6b4141fcafbc4a6f96504bf47539b8ae P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.001686 12233 tablet.cc:1722] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.004341 12175 tablet_replica.cc:331] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.004511 12175 raft_consensus.cc:2241] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.004616 12175 raft_consensus.cc:2270] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.005169 12175 ts_tablet_manager.cc:1905] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.005343 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9b83658ba82e498fbd48134a6a6867b3 (table default.Table_15fa1e0db4314493a834a5c7ff218574 [id=bf0cf9729bbd45619fd4c852f572bc60]) successfully deleted
I20250625 14:01:55.005503 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9b83658ba82e498fbd48134a6a6867b3 (table default.Table_15fa1e0db4314493a834a5c7ff218574 [id=bf0cf9729bbd45619fd4c852f572bc60]) successfully deleted
W20250625 14:01:55.005631 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 144ba67ce1fa419cac46e40ebcc078e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 144ba67ce1fa419cac46e40ebcc078e6 already in progress: creating tablet
I20250625 14:01:55.005919 12166 tablet_bootstrap.cc:492] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.007750 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 (DEFAULT_TABLE table=default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.008436 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 4617bb8a015d42188beba9df61df2c9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.008488 12166 ts_tablet_manager.cc:1397] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:55.008538 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 1f5c017990c54099b1cdbddc75a12e10 (DEFAULT_TABLE table=default.Table_c99e790aef874f6c8875c93bd8df8256 [id=b1f7726fb4e44a9992a4ef7a1afb339d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.008634 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.008755 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5c017990c54099b1cdbddc75a12e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.008997 12166 raft_consensus.cc:357] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.009088 12166 raft_consensus.cc:383] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.009116 12166 raft_consensus.cc:738] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.009236 12166 consensus_queue.cc:260] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.009491 12166 ts_tablet_manager.cc:1428] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.009663 12166 tablet_bootstrap.cc:492] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.007786 11895 tablet_service.cc:1468] Processing CreateTablet for tablet baf41b19a5ba4eddb65d31567b375eaa (DEFAULT_TABLE table=default.Table_f4d1651a42f04c3ea03c9db2668e3c62 [id=d9660eb383fc48bca21f1567f0862813]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.010422 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf41b19a5ba4eddb65d31567b375eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.011714 12166 tablet_bootstrap.cc:654] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.012050 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e370508891634b749a576b24d57d3593"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.012471 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e370508891634b749a576b24d57d3593 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.008116 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 4b76d36bac354543b8f7cef071aaa661 (DEFAULT_TABLE table=default.Table_626e2cc613e149589b0a39ca9ff4c057 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.013589 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b76d36bac354543b8f7cef071aaa661. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.014123 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 92984f3be8454a969b7c39af97a11479 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.014278 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_602e5344bce84d3f81394779588ad1c0" } new_table_name: "default.Table_56262f7334bf48819421af1329c18542" modify_external_catalogs: true
I20250625 14:01:55.015086 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_009dda51059342099345e5463b33f6f5" } modify_external_catalogs: true
I20250625 14:01:55.015182 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_009dda51059342099345e5463b33f6f5" } modify_external_catalogs: true
I20250625 14:01:55.008281 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 56250a60d7104f22bd4b2206f3a5df14 (DEFAULT_TABLE table=default.Table_7b8124c1ff214ffaa4645d62d65091ff [id=e1d9126672684e808d499d3902fc371b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.015559 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a27e38c613104c93938f9c49b2849c1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.015684 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56250a60d7104f22bd4b2206f3a5df14. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.015879 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a27e38c613104c93938f9c49b2849c1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.016590 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_0b3cb311c8ff42a6a5488448051f33a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.016872 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b3cb311c8ff42a6a5488448051f33a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.017494 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 8363c9c6dab64a30b08ab92a152a3ee5 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.017597 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 56250a60d7104f22bd4b2206f3a5df14 (DEFAULT_TABLE table=default.Table_7b8124c1ff214ffaa4645d62d65091ff [id=e1d9126672684e808d499d3902fc371b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.017660 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet d2afe02902a54045be3b435ed7585b08 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.017875 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56250a60d7104f22bd4b2206f3a5df14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.018002 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 882da47c1f5a496f8df2ba2d3501b453 (DEFAULT_TABLE table=default.Table_8abc4f3249834149817f4c730d26b806 [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.018227 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882da47c1f5a496f8df2ba2d3501b453. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.019052 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 (DEFAULT_TABLE table=default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.019264 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.020035 11759 tablet_service.cc:1468] Processing CreateTablet for tablet baf41b19a5ba4eddb65d31567b375eaa (DEFAULT_TABLE table=default.Table_f4d1651a42f04c3ea03c9db2668e3c62 [id=d9660eb383fc48bca21f1567f0862813]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.020241 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf41b19a5ba4eddb65d31567b375eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.021704 12175 ts_tablet_manager.cc:1918] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.021782 12175 log.cc:1199] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/ef65dc31dc5843fb9e25275af5935e73
I20250625 14:01:55.021862 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 4b76d36bac354543b8f7cef071aaa661 (DEFAULT_TABLE table=default.Table_626e2cc613e149589b0a39ca9ff4c057 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.022002 12175 ts_tablet_manager.cc:1939] T ef65dc31dc5843fb9e25275af5935e73 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.022042 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b76d36bac354543b8f7cef071aaa661. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.023500 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 25160014ecf74c2ab6f1faca42d30c47 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.023758 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 1f5c017990c54099b1cdbddc75a12e10 (DEFAULT_TABLE table=default.Table_c99e790aef874f6c8875c93bd8df8256 [id=b1f7726fb4e44a9992a4ef7a1afb339d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.023885 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f0614c0f5cc248abab27fbb94b971289" } new_table_name: "default.Table_3a4c3cc5db934840bc6467d6478d117e" modify_external_catalogs: true
I20250625 14:01:55.023975 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5c017990c54099b1cdbddc75a12e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.991473 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b4141fcafbc4a6f96504bf47539b8ae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.025965 12173 pending_rounds.cc:77] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523030826799104 op_type: NO_OP noop_request { }
I20250625 14:01:55.026050 12173 raft_consensus.cc:2887] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20250625 14:01:54.990340 12670 consensus_queue.cc:1162] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87a003e25dbf461ebec24a29ad7016ed" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:01:55.026109 12173 raft_consensus.cc:2270] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:54.994381 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 1f5c017990c54099b1cdbddc75a12e10 (DEFAULT_TABLE table=default.Table_c99e790aef874f6c8875c93bd8df8256 [id=b1f7726fb4e44a9992a4ef7a1afb339d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.026477 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5c017990c54099b1cdbddc75a12e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.994652 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 (DEFAULT_TABLE table=default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.028779 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:54.994891 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 4b76d36bac354543b8f7cef071aaa661 (DEFAULT_TABLE table=default.Table_626e2cc613e149589b0a39ca9ff4c057 [id=d60959d1e4b14c1d820f04d9bfedfe11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.031040 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b76d36bac354543b8f7cef071aaa661. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.031926 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6b4141fcafbc4a6f96504bf47539b8ae (table default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]) successfully deleted
I20250625 14:01:55.032855 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 with delete_type TABLET_DATA_DELETED (replaced by tablet 68a0cfeac48042bdaea66c3b0e370480) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.032917 12172 tablet_bootstrap.cc:492] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.032991 12172 ts_tablet_manager.cc:1397] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.113s user 0.001s sys 0.000s
I20250625 14:01:54.996822 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6b4141fcafbc4a6f96504bf47539b8ae" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:54.999037 12167 tablet_bootstrap.cc:492] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.033274 12167 ts_tablet_manager.cc:1397] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.000s
W20250625 14:01:55.033421 11717 leader_election.cc:343] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.033725 12172 raft_consensus.cc:357] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.033742 12167 raft_consensus.cc:357] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.033835 12172 raft_consensus.cc:383] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.033850 12167 raft_consensus.cc:383] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.033870 12172 raft_consensus.cc:738] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.033882 12167 raft_consensus.cc:738] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.033990 12167 consensus_queue.cc:260] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.033996 12172 consensus_queue.cc:260] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.034353 12167 ts_tablet_manager.cc:1428] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.034554 12167 tablet_bootstrap.cc:492] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.034806 12177 ts_tablet_manager.cc:1939] T 4a281b2956124ce4b9fd12560bf3d5c1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.035456 12177 tablet_replica.cc:331] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.035593 12167 tablet_bootstrap.cc:654] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.035584 12177 raft_consensus.cc:2241] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.035718 12177 pending_rounds.cc:70] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:55.035746 12177 pending_rounds.cc:77] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523030934597632 op_type: NO_OP noop_request { }
I20250625 14:01:55.035794 12177 raft_consensus.cc:2887] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:55.035841 12177 raft_consensus.cc:2270] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.036178 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 4a281b2956124ce4b9fd12560bf3d5c1 (table default.Table_8387efde7ac24eddb291cf6f17ec0041 [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
W20250625 14:01:55.036360 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 144ba67ce1fa419cac46e40ebcc078e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 144ba67ce1fa419cac46e40ebcc078e6 already in progress: creating tablet
I20250625 14:01:55.036734 12172 ts_tablet_manager.cc:1428] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:55.007025 12030 tablet_service.cc:1468] Processing CreateTablet for tablet baf41b19a5ba4eddb65d31567b375eaa (DEFAULT_TABLE table=default.Table_f4d1651a42f04c3ea03c9db2668e3c62 [id=d9660eb383fc48bca21f1567f0862813]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.037715 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf41b19a5ba4eddb65d31567b375eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.036926 12172 tablet_bootstrap.cc:492] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.039402 12172 tablet_bootstrap.cc:654] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.040071 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 92984f3be8454a969b7c39af97a11479
I20250625 14:01:55.040307 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 92984f3be8454a969b7c39af97a11479 deleted and replaced by tablet 5227c93e932a4ed4b3d03990d7ed7b69
I20250625 14:01:55.042682 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68] alter complete (version 1)
I20250625 14:01:55.043052 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e43289a5fa434695a866d39a58d5c776"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.043424 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e43289a5fa434695a866d39a58d5c776 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:55.045948 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c940a9f7ada54b48940e90c822c84735 consensus state has no leader
W20250625 14:01:55.046298 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 097b49d0283541478241e6c699504174 has no consensus state
I20250625 14:01:55.046552 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_37908936fde84cea9245460dac5d2283"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.046936 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37908936fde84cea9245460dac5d2283 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.047094 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d2afe02902a54045be3b435ed7585b08
I20250625 14:01:55.047360 11533 catalog_manager.cc:6652] ReplaceTablet: tablet d2afe02902a54045be3b435ed7585b08 deleted and replaced by tablet 87974ef08b3b4cc299ae643c0cb5d694
I20250625 14:01:55.047514 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8387efde7ac24eddb291cf6f17ec0041" } new_table_name: "default.Table_12a1e16f6b284bbca04f3f1c10950265" modify_external_catalogs: true
I20250625 14:01:55.048373 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b5db9b5292a6461bac446f5ebc358c27" } new_table_name: "default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0" modify_external_catalogs: true
I20250625 14:01:55.046847 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1d7b4535b298478b82f91b4918344234"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.049381 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d7b4535b298478b82f91b4918344234 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.050735 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1e3673ebd97b4210b4ca490b2dd1fb06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.050809 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 92984f3be8454a969b7c39af97a11479 with delete_type TABLET_DATA_DELETED (replaced by tablet 5227c93e932a4ed4b3d03990d7ed7b69) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:55.051108 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e3673ebd97b4210b4ca490b2dd1fb06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.051754 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet d2afe02902a54045be3b435ed7585b08 with delete_type TABLET_DATA_DELETED (replaced by tablet 87974ef08b3b4cc299ae643c0cb5d694) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:55.051951 11717 leader_election.cc:343] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.052039 11717 leader_election.cc:304] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:55.052300 12180 raft_consensus.cc:2747] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.054623 12558 raft_consensus.cc:491] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.054720 12558 raft_consensus.cc:513] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.055086 12558 leader_election.cc:290] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.055667 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39ff4b0e7ac74ec294550775aaa44468" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:55.056026 11858 leader_election.cc:343] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.058187 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet b7eee5c995064aacb406daddb888edb6 with delete_type TABLET_DATA_DELETED (replaced by tablet 8363c9c6dab64a30b08ab92a152a3ee5) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.058671 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet d2afe02902a54045be3b435ed7585b08 with delete_type TABLET_DATA_DELETED (replaced by tablet 87974ef08b3b4cc299ae643c0cb5d694) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.058810 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 92984f3be8454a969b7c39af97a11479 with delete_type TABLET_DATA_DELETED (replaced by tablet 5227c93e932a4ed4b3d03990d7ed7b69) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.060189 12173 ts_tablet_manager.cc:1905] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.060344 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39ff4b0e7ac74ec294550775aaa44468" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.061044 12175 tablet_replica.cc:331] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.061204 12175 raft_consensus.cc:2241] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.061322 12175 raft_consensus.cc:2270] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.062027 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet d2afe02902a54045be3b435ed7585b08 with delete_type TABLET_DATA_DELETED (replaced by tablet 87974ef08b3b4cc299ae643c0cb5d694) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:55.062186 11855 leader_election.cc:343] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.062260 11855 leader_election.cc:304] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.062460 12600 raft_consensus.cc:2747] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.062537 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet ef65dc31dc5843fb9e25275af5935e73 (table default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]) successfully deleted
I20250625 14:01:55.062947 12175 ts_tablet_manager.cc:1905] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.063642 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 92984f3be8454a969b7c39af97a11479 with delete_type TABLET_DATA_DELETED (replaced by tablet 5227c93e932a4ed4b3d03990d7ed7b69) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.065225 12175 ts_tablet_manager.cc:1918] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.065304 12175 log.cc:1199] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/bc92f5f36ae94fe09b6017efc6ebbcaf
I20250625 14:01:55.065518 12175 ts_tablet_manager.cc:1939] T bc92f5f36ae94fe09b6017efc6ebbcaf P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.068651 12166 tablet_bootstrap.cc:492] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.068760 12166 ts_tablet_manager.cc:1397] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
I20250625 14:01:55.069303 12166 raft_consensus.cc:357] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.069432 12166 raft_consensus.cc:383] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.069471 12166 raft_consensus.cc:738] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.069591 12166 consensus_queue.cc:260] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.069907 12166 ts_tablet_manager.cc:1428] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:55.070132 12166 tablet_bootstrap.cc:492] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:55.070591 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 consensus state has no leader
I20250625 14:01:55.071267 12166 tablet_bootstrap.cc:654] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.077497 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_03ca42d86d7d454699eea52f84b29ffb" } modify_external_catalogs: true
I20250625 14:01:55.077652 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_03ca42d86d7d454699eea52f84b29ffb" } modify_external_catalogs: true
I20250625 14:01:55.078552 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 4031eab780324944bc63fc77848fb209 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.081274 11920 raft_consensus.cc:1273] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:55.081931 12238 consensus_queue.cc:1035] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.082208 12055 raft_consensus.cc:1273] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:55.085278 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0 [id=f8e4990b036541f1b033de99bff1accc]). Expected version 2 got 0
I20250625 14:01:55.085984 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 704ecf1ea8dd423ead2a0d1be113c03d
I20250625 14:01:55.086974 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.087327 12238 consensus_queue.cc:1035] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.087742 12173 ts_tablet_manager.cc:1918] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.088582 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.088714 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.090698 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 097b49d0283541478241e6c699504174 (DEFAULT_TABLE table=default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.091096 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097b49d0283541478241e6c699504174. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.091949 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 (DEFAULT_TABLE table=default.Table_03ca42d86d7d454699eea52f84b29ffb [id=e32fff7acb81496caed3c543cbb849fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.092206 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72efc3ed21e3404eb0a0ba4326513601. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.091264 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 (DEFAULT_TABLE table=default.Table_03ca42d86d7d454699eea52f84b29ffb [id=e32fff7acb81496caed3c543cbb849fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.092424 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72efc3ed21e3404eb0a0ba4326513601. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.092172 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 097b49d0283541478241e6c699504174 (DEFAULT_TABLE table=default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.094934 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097b49d0283541478241e6c699504174. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.094950 12177 ts_tablet_manager.cc:1905] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.095789 11897 tablet_service.cc:1468] Processing CreateTablet for tablet bfdb34255cb147c48a322514b7a7a19d (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.096055 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb34255cb147c48a322514b7a7a19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.095368 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.096272 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 (DEFAULT_TABLE table=default.Table_03ca42d86d7d454699eea52f84b29ffb [id=e32fff7acb81496caed3c543cbb849fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.097186 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72efc3ed21e3404eb0a0ba4326513601. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.088773 12173 log.cc:1199] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/4a281b2956124ce4b9fd12560bf3d5c1
I20250625 14:01:55.098237 12173 ts_tablet_manager.cc:1939] T 4a281b2956124ce4b9fd12560bf3d5c1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.098253 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 097b49d0283541478241e6c699504174 (DEFAULT_TABLE table=default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.098522 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 097b49d0283541478241e6c699504174. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.098886 12175 tablet_replica.cc:331] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.099013 12175 raft_consensus.cc:2241] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.099110 12175 raft_consensus.cc:2270] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.096513 11755 tablet_service.cc:1468] Processing CreateTablet for tablet bfdb34255cb147c48a322514b7a7a19d (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.099532 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb34255cb147c48a322514b7a7a19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.100572 12173 tablet_replica.cc:331] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.100703 12173 raft_consensus.cc:2241] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.100797 12173 raft_consensus.cc:2270] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.096665 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 7541b0989fe04486be69997611bb8ca1 (DEFAULT_TABLE table=default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.101620 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7541b0989fe04486be69997611bb8ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.101784 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 7541b0989fe04486be69997611bb8ca1 (DEFAULT_TABLE table=default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.102035 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7541b0989fe04486be69997611bb8ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.104391 12233 tablet.cc:1722] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:55.106217 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8363c9c6dab64a30b08ab92a152a3ee5
I20250625 14:01:55.106293 12166 tablet_bootstrap.cc:492] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.106410 12166 ts_tablet_manager.cc:1397] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.001s
I20250625 14:01:55.106532 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 8363c9c6dab64a30b08ab92a152a3ee5 deleted and replaced by tablet 339813cd0c194f07bfc4edefd6a05ef3
I20250625 14:01:55.106874 12430 tablet.cc:1722] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:55.106920 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 72efc3ed21e3404eb0a0ba4326513601
I20250625 14:01:55.106940 12166 raft_consensus.cc:357] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.107034 12166 raft_consensus.cc:383] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.107066 12166 raft_consensus.cc:738] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.107198 12166 consensus_queue.cc:260] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.107478 12166 ts_tablet_manager.cc:1428] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:55.101375 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 7541b0989fe04486be69997611bb8ca1 (DEFAULT_TABLE table=default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.107868 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7541b0989fe04486be69997611bb8ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.109730 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 339813cd0c194f07bfc4edefd6a05ef3) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.109825 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 339813cd0c194f07bfc4edefd6a05ef3) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.110121 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.110836 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 339813cd0c194f07bfc4edefd6a05ef3) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.110930 12030 tablet_service.cc:1468] Processing CreateTablet for tablet bfdb34255cb147c48a322514b7a7a19d (DEFAULT_TABLE table=default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.111020 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.111299 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb34255cb147c48a322514b7a7a19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.111936 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.112254 12167 tablet_bootstrap.cc:492] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.112342 12167 ts_tablet_manager.cc:1397] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.000s
I20250625 14:01:55.112874 12167 raft_consensus.cc:357] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.112974 12167 raft_consensus.cc:383] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.113022 12167 raft_consensus.cc:738] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.113138 12167 consensus_queue.cc:260] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.113411 12167 ts_tablet_manager.cc:1428] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.113808 12167 tablet_bootstrap.cc:492] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.114487 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 4a281b2956124ce4b9fd12560bf3d5c1 (table default.Table_12a1e16f6b284bbca04f3f1c10950265 [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
W20250625 14:01:55.114629 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 22cfc7f3b1564e4f91114cd5e049da0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22cfc7f3b1564e4f91114cd5e049da0d already in progress: creating tablet
I20250625 14:01:55.114864 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet bc92f5f36ae94fe09b6017efc6ebbcaf (table default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]) successfully deleted
I20250625 14:01:55.114900 12167 tablet_bootstrap.cc:654] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.115089 12175 ts_tablet_manager.cc:1905] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.116885 12166 tablet_bootstrap.cc:492] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.117668 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0 [id=f8e4990b036541f1b033de99bff1accc]). Expected version 2 got 0
I20250625 14:01:55.117929 12166 tablet_bootstrap.cc:654] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.119213 12173 ts_tablet_manager.cc:1905] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.119199 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0 [id=f8e4990b036541f1b033de99bff1accc]). Expected version 2 got 0
I20250625 14:01:55.123045 12167 tablet_bootstrap.cc:492] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.123147 12167 ts_tablet_manager.cc:1397] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:55.123622 12167 raft_consensus.cc:357] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.123720 12167 raft_consensus.cc:383] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.123749 12167 raft_consensus.cc:738] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.123845 12167 consensus_queue.cc:260] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.124155 12167 ts_tablet_manager.cc:1428] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.124359 12177 ts_tablet_manager.cc:1918] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.124441 12177 log.cc:1199] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/bc92f5f36ae94fe09b6017efc6ebbcaf
I20250625 14:01:55.124699 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9" } modify_external_catalogs: true
I20250625 14:01:55.124825 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9" } modify_external_catalogs: true
I20250625 14:01:55.125105 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_10c989b9d71841c59c66d2a9c4f77021" } modify_external_catalogs: true
I20250625 14:01:55.125209 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_10c989b9d71841c59c66d2a9c4f77021" } modify_external_catalogs: true
I20250625 14:01:55.125774 12167 tablet_bootstrap.cc:492] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.126025 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0 [id=f8e4990b036541f1b033de99bff1accc] alter complete (version 2)
I20250625 14:01:55.127307 12175 ts_tablet_manager.cc:1918] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.130155 12167 tablet_bootstrap.cc:654] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.132843 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet da2c9696938143f69ea1305ee076d84d
I20250625 14:01:55.133600 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet da2c9696938143f69ea1305ee076d84d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.130393 12177 ts_tablet_manager.cc:1939] T bc92f5f36ae94fe09b6017efc6ebbcaf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.135076 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet bc92f5f36ae94fe09b6017efc6ebbcaf (table default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]) successfully deleted
I20250625 14:01:55.133301 12584 tablet.cc:1722] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:55.136448 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet da2c9696938143f69ea1305ee076d84d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.136889 12177 tablet_replica.cc:331] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.137058 12177 raft_consensus.cc:2241] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.137272 12177 raft_consensus.cc:2270] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.138101 12172 tablet_bootstrap.cc:492] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.138206 12172 ts_tablet_manager.cc:1397] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.101s user 0.003s sys 0.000s
I20250625 14:01:55.134666 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet da2c9696938143f69ea1305ee076d84d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.138368 12175 log.cc:1199] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/fc2766f8e0b544b0b48a0e7e5952d672
I20250625 14:01:55.138691 12175 ts_tablet_manager.cc:1939] T fc2766f8e0b544b0b48a0e7e5952d672 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.138754 12172 raft_consensus.cc:357] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.138865 12172 raft_consensus.cc:383] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.138897 12172 raft_consensus.cc:738] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.139017 12172 consensus_queue.cc:260] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.139304 12172 ts_tablet_manager.cc:1428] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.139318 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d (table default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]). Expected version 1 got 0
I20250625 14:01:55.139382 12173 ts_tablet_manager.cc:1918] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.139451 12173 log.cc:1199] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b7eee5c995064aacb406daddb888edb6
I20250625 14:01:55.139504 12172 tablet_bootstrap.cc:492] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.139688 12173 ts_tablet_manager.cc:1939] T b7eee5c995064aacb406daddb888edb6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.140617 12172 tablet_bootstrap.cc:654] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.141114 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_56b605b35a0d4335b2916c5748f8ab38" } modify_external_catalogs: true
I20250625 14:01:55.141232 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_56b605b35a0d4335b2916c5748f8ab38" } modify_external_catalogs: true
I20250625 14:01:55.141501 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2135205cf6d1472983740c9119df79a9" } new_table_name: "default.Table_c2a2490948a24ff68ac7093e9fc54954" modify_external_catalogs: true
I20250625 14:01:55.144546 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 8a4d01792d40471ab6d5bafa1a308351 with delete_type TABLET_DATA_DELETED (replaced by tablet bc92f5f36ae94fe09b6017efc6ebbcaf) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.145145 12172 tablet_bootstrap.cc:492] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.145255 12172 ts_tablet_manager.cc:1397] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:55.145632 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b7eee5c995064aacb406daddb888edb6 (table default.Table_dba49d3cdee64ffba6f3959bed8da9ba [id=05ba3fb82ea74715a67dbefb3018db83]) successfully deleted
I20250625 14:01:55.145753 12172 raft_consensus.cc:357] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.145884 12172 raft_consensus.cc:383] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.145932 12172 raft_consensus.cc:738] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.146045 12172 consensus_queue.cc:260] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.146384 12172 ts_tablet_manager.cc:1428] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.146585 12172 tablet_bootstrap.cc:492] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.146615 12175 tablet_replica.cc:331] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.146701 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.146762 12175 raft_consensus.cc:2241] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.146883 12175 raft_consensus.cc:2270] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:55.147135 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.147593 12172 tablet_bootstrap.cc:654] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.149911 12175 ts_tablet_manager.cc:1905] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.150852 12173 tablet_replica.cc:331] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:01:55.151409 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e62aba799c354c178db2d8c31ce7e969 consensus state has no leader
I20250625 14:01:55.151803 12173 raft_consensus.cc:2241] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.151865 12180 consensus_queue.cc:1035] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.152015 12173 raft_consensus.cc:2270] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.155426 12173 ts_tablet_manager.cc:1905] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.160247 11759 tablet_service.cc:1468] Processing CreateTablet for tablet deee7c3fb5204c63a6618f628848bc81 (DEFAULT_TABLE table=default.Table_e370508891634b749a576b24d57d3593 [id=ae16a007c35f4784b80230d2eb49b42c]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:55.160426 11717 consensus_peers.cc:487] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:55.160387 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 96ec205b0f31484a91054fedf619b9ab (DEFAULT_TABLE table=default.Table_1e3673ebd97b4210b4ca490b2dd1fb06 [id=62132df62b3a42fb9886592b9b885d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.160542 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deee7c3fb5204c63a6618f628848bc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.160744 11761 tablet_service.cc:1468] Processing CreateTablet for tablet a7e0385d1c584c2d9560cbe138686565 (DEFAULT_TABLE table=default.Table_e43289a5fa434695a866d39a58d5c776 [id=d02b8ccb415e4358832eb8334c21a8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.160940 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e0385d1c584c2d9560cbe138686565. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.161967 12173 ts_tablet_manager.cc:1918] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.162036 12173 log.cc:1199] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/4031eab780324944bc63fc77848fb209
I20250625 14:01:55.162251 12173 ts_tablet_manager.cc:1939] T 4031eab780324944bc63fc77848fb209 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.162515 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (DEFAULT_TABLE table=default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.162726 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5227c93e932a4ed4b3d03990d7ed7b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.164084 12558 raft_consensus.cc:491] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.164171 12558 raft_consensus.cc:513] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.164604 12558 leader_election.cc:290] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.164784 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 87974ef08b3b4cc299ae643c0cb5d694 (DEFAULT_TABLE table=default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.165028 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87974ef08b3b4cc299ae643c0cb5d694. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.166010 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet fc2766f8e0b544b0b48a0e7e5952d672 (table default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
W20250625 14:01:55.166215 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 144ba67ce1fa419cac46e40ebcc078e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 144ba67ce1fa419cac46e40ebcc078e6 already in progress: creating tablet
I20250625 14:01:55.167160 11762 tablet_service.cc:1468] Processing CreateTablet for tablet cb0b1a9a04ca4911b5f6e441d0239977 (DEFAULT_TABLE table=default.Table_37908936fde84cea9245460dac5d2283 [id=7ebc2c88eb074eb598b2cfda5e4e81bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.167532 12166 tablet_bootstrap.cc:492] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.167634 12166 ts_tablet_manager.cc:1397] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.001s
I20250625 14:01:55.164985 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92975891d7b24729b4b5514d8f8aecd8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.167835 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 49c8487f502b4f5299387daa9e89604b (DEFAULT_TABLE table=default.Table_a27e38c613104c93938f9c49b2849c1c [id=34fbaa73d2f1419384ee51b9dffb33f1]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:55.168067 11858 leader_election.cc:343] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.168119 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 49c8487f502b4f5299387daa9e89604b (DEFAULT_TABLE table=default.Table_a27e38c613104c93938f9c49b2849c1c [id=34fbaa73d2f1419384ee51b9dffb33f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.160247 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d (DEFAULT_TABLE table=default.Table_0b3cb311c8ff42a6a5488448051f33a8 [id=c8d56c06b27f4a54ae3a23126f7d04a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.168213 12166 raft_consensus.cc:357] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.168324 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c8487f502b4f5299387daa9e89604b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.168334 12166 raft_consensus.cc:383] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.168367 12166 raft_consensus.cc:738] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.168498 12166 consensus_queue.cc:260] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.168612 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ec205b0f31484a91054fedf619b9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.168731 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c8487f502b4f5299387daa9e89604b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.168778 12166 ts_tablet_manager.cc:1428] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.168977 12166 tablet_bootstrap.cc:492] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.170228 12166 tablet_bootstrap.cc:654] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.170495 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc7e962e4b146bc88a06fde969eb99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.171164 12175 ts_tablet_manager.cc:1918] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.171227 12175 log.cc:1199] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/25160014ecf74c2ab6f1faca42d30c47
I20250625 14:01:55.171437 12175 ts_tablet_manager.cc:1939] T 25160014ecf74c2ab6f1faca42d30c47 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.172369 12175 tablet_replica.cc:331] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.172500 12175 raft_consensus.cc:2241] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.172542 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0b1a9a04ca4911b5f6e441d0239977. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.172631 12175 raft_consensus.cc:2270] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.173166 12175 ts_tablet_manager.cc:1905] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.175415 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92975891d7b24729b4b5514d8f8aecd8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.175490 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 49c8487f502b4f5299387daa9e89604b (DEFAULT_TABLE table=default.Table_a27e38c613104c93938f9c49b2849c1c [id=34fbaa73d2f1419384ee51b9dffb33f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.175733 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c8487f502b4f5299387daa9e89604b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.175772 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d (DEFAULT_TABLE table=default.Table_0b3cb311c8ff42a6a5488448051f33a8 [id=c8d56c06b27f4a54ae3a23126f7d04a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.176023 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc7e962e4b146bc88a06fde969eb99d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.177285 11855 leader_election.cc:343] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.177271 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9aa153abf09346f4a92998fa6a4c1cb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.177371 11855 leader_election.cc:304] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.177572 12558 raft_consensus.cc:2747] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:55.177698 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9aa153abf09346f4a92998fa6a4c1cb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.178207 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 6bcdf4d901e34ab5ba2c36fe53456f0e from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.178646 12173 tablet_replica.cc:331] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.178788 12173 raft_consensus.cc:2241] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.179004 12173 raft_consensus.cc:2270] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.182611 12175 ts_tablet_manager.cc:1918] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.182700 12177 ts_tablet_manager.cc:1905] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.184700 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 61acdd21d02e4576adba8f2ff24a154a
I20250625 14:01:55.185055 12030 tablet_service.cc:1468] Processing CreateTablet for tablet deee7c3fb5204c63a6618f628848bc81 (DEFAULT_TABLE table=default.Table_e370508891634b749a576b24d57d3593 [id=ae16a007c35f4784b80230d2eb49b42c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.185421 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deee7c3fb5204c63a6618f628848bc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.185421 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 61acdd21d02e4576adba8f2ff24a154a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.186339 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 96ec205b0f31484a91054fedf619b9ab (DEFAULT_TABLE table=default.Table_1e3673ebd97b4210b4ca490b2dd1fb06 [id=62132df62b3a42fb9886592b9b885d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.186566 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ec205b0f31484a91054fedf619b9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.188668 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 87974ef08b3b4cc299ae643c0cb5d694 (DEFAULT_TABLE table=default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.188881 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87974ef08b3b4cc299ae643c0cb5d694. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.188961 12177 ts_tablet_manager.cc:1918] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.188949 12036 tablet_service.cc:1468] Processing CreateTablet for tablet a7e0385d1c584c2d9560cbe138686565 (DEFAULT_TABLE table=default.Table_e43289a5fa434695a866d39a58d5c776 [id=d02b8ccb415e4358832eb8334c21a8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.189025 12177 log.cc:1199] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6b4141fcafbc4a6f96504bf47539b8ae
I20250625 14:01:55.189152 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e0385d1c584c2d9560cbe138686565. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.189184 12177 ts_tablet_manager.cc:1939] T 6b4141fcafbc4a6f96504bf47539b8ae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.190099 12177 tablet_replica.cc:331] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.190256 12177 raft_consensus.cc:2241] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.190485 12177 raft_consensus.cc:2270] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.190904 12177 ts_tablet_manager.cc:1905] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.191079 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 205f83a0ffbc440492e241a75657f1b8
I20250625 14:01:55.191170 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (DEFAULT_TABLE table=default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.191376 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5227c93e932a4ed4b3d03990d7ed7b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.191570 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6bcdf4d901e34ab5ba2c36fe53456f0e
I20250625 14:01:55.191820 11530 catalog_manager.cc:6652] ReplaceTablet: tablet 6bcdf4d901e34ab5ba2c36fe53456f0e deleted and replaced by tablet 54f0be19f9134fa3a88ae867b108c7e8
I20250625 14:01:55.192162 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 205f83a0ffbc440492e241a75657f1b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.192831 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e with delete_type TABLET_DATA_DELETED (replaced by tablet 54f0be19f9134fa3a88ae867b108c7e8) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.193944 12177 ts_tablet_manager.cc:1918] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.194010 12177 log.cc:1199] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/36da902c99bf4416aa0769438182e443
I20250625 14:01:55.194283 12177 ts_tablet_manager.cc:1939] T 36da902c99bf4416aa0769438182e443 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:55.194456 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d2afe02902a54045be3b435ed7585b08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2afe02902a54045be3b435ed7585b08 already in progress: creating tablet
W20250625 14:01:55.194603 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 92984f3be8454a969b7c39af97a11479 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92984f3be8454a969b7c39af97a11479 already in progress: creating tablet
I20250625 14:01:55.194784 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 4031eab780324944bc63fc77848fb209 (table default.Table_73d3dbf418e2463ba09893538dd70097 [id=3ef8fa0543a14c90b4c42e770323f83f]) successfully deleted
W20250625 14:01:55.194957 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 704ecf1ea8dd423ead2a0d1be113c03d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 704ecf1ea8dd423ead2a0d1be113c03d already in progress: creating tablet
W20250625 14:01:55.195052 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8363c9c6dab64a30b08ab92a152a3ee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8363c9c6dab64a30b08ab92a152a3ee5 already in progress: creating tablet
I20250625 14:01:55.195055 12177 tablet_replica.cc:331] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.194802 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6b4141fcafbc4a6f96504bf47539b8ae (table default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]) successfully deleted
W20250625 14:01:55.195122 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 72efc3ed21e3404eb0a0ba4326513601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72efc3ed21e3404eb0a0ba4326513601 already in progress: creating tablet
I20250625 14:01:55.195181 12177 raft_consensus.cc:2241] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:01:55.195221 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9b83658ba82e498fbd48134a6a6867b3 because the tablet was not found. No further retry: Not found: Tablet not found: 9b83658ba82e498fbd48134a6a6867b3
I20250625 14:01:55.195297 12177 raft_consensus.cc:2270] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.195333 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 36da902c99bf4416aa0769438182e443 (table default.Table_18fd74110fdc485d839fae5cc2b22cfd [id=a32feaf4c2f74d1bbd361e7680395682]) successfully deleted
W20250625 14:01:55.195473 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 5bba2990cca6441fb954b2f30f561708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bba2990cca6441fb954b2f30f561708 already in progress: creating tablet
I20250625 14:01:55.195536 12036 tablet_service.cc:1468] Processing CreateTablet for tablet cb0b1a9a04ca4911b5f6e441d0239977 (DEFAULT_TABLE table=default.Table_37908936fde84cea9245460dac5d2283 [id=7ebc2c88eb074eb598b2cfda5e4e81bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.195819 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0b1a9a04ca4911b5f6e441d0239977. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.196342 12172 tablet_bootstrap.cc:492] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.196424 12172 ts_tablet_manager.cc:1397] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.000s
I20250625 14:01:55.197099 12172 raft_consensus.cc:357] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.197199 12172 raft_consensus.cc:383] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.197228 12172 raft_consensus.cc:738] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.197413 12172 consensus_queue.cc:260] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.197782 12172 ts_tablet_manager.cc:1428] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:55.198012 12172 tablet_bootstrap.cc:492] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.199673 12208 raft_consensus.cc:491] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.199751 12208 raft_consensus.cc:513] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.199961 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 61acdd21d02e4576adba8f2ff24a154a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.200127 12208 leader_election.cc:290] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.201092 12173 ts_tablet_manager.cc:1905] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.201545 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e with delete_type TABLET_DATA_DELETED (replaced by tablet 54f0be19f9134fa3a88ae867b108c7e8) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.201680 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 205f83a0ffbc440492e241a75657f1b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.201658 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_10a18d192fee4f6092695ec20f30a5ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.202033 12167 tablet_bootstrap.cc:492] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.202121 12167 ts_tablet_manager.cc:1397] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.000s
I20250625 14:01:55.202335 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ab957f1fd4214efbb6233f312617c728" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.202663 12167 raft_consensus.cc:357] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.202765 12167 raft_consensus.cc:383] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.202796 12167 raft_consensus.cc:738] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.203099 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 7ebac6abf36f44fb93f556b59b2dd022 (DEFAULT_TABLE table=default.Table_1d7b4535b298478b82f91b4918344234 [id=5c8c581dd0874ff4899ea9d857c40a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.203348 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ebac6abf36f44fb93f556b59b2dd022. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.204020 12172 tablet_bootstrap.cc:654] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.204674 11717 leader_election.cc:343] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.205356 12177 ts_tablet_manager.cc:1905] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.205516 12167 consensus_queue.cc:260] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.205955 12167 ts_tablet_manager.cc:1428] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:55.206229 12167 tablet_bootstrap.cc:492] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.206212 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 25160014ecf74c2ab6f1faca42d30c47 (table default.Table_1bc57951e55e40f2aa6b5736e5f9b500 [id=c8ce791eeb3845f2ba3e8ad40955506b]) successfully deleted
I20250625 14:01:55.207691 12177 ts_tablet_manager.cc:1918] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.207759 12177 log.cc:1199] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/22cfc7f3b1564e4f91114cd5e049da0d
I20250625 14:01:55.207993 12177 ts_tablet_manager.cc:1939] T 22cfc7f3b1564e4f91114cd5e049da0d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.184473 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d (DEFAULT_TABLE table=default.Table_0b3cb311c8ff42a6a5488448051f33a8 [id=c8d56c06b27f4a54ae3a23126f7d04a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.208323 12175 log.cc:1199] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/ab957f1fd4214efbb6233f312617c728
I20250625 14:01:55.208508 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc7e962e4b146bc88a06fde969eb99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.208667 12177 tablet_replica.cc:331] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.208787 12177 raft_consensus.cc:2241] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.208923 12177 pending_rounds.cc:70] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:55.208950 12177 pending_rounds.cc:77] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523030636261376 op_type: NO_OP noop_request { }
I20250625 14:01:55.209000 12177 raft_consensus.cc:2887] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:55.209053 12177 raft_consensus.cc:2270] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.185032 11898 tablet_service.cc:1468] Processing CreateTablet for tablet deee7c3fb5204c63a6618f628848bc81 (DEFAULT_TABLE table=default.Table_e370508891634b749a576b24d57d3593 [id=ae16a007c35f4784b80230d2eb49b42c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.209487 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deee7c3fb5204c63a6618f628848bc81. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.209493 12173 ts_tablet_manager.cc:1918] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.209733 12177 ts_tablet_manager.cc:1905] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.209836 12175 ts_tablet_manager.cc:1939] T ab957f1fd4214efbb6233f312617c728 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.210345 12167 tablet_bootstrap.cc:654] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.211426 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 22cfc7f3b1564e4f91114cd5e049da0d (table default.Table_7f1415a5baff45288950d6b31c93d71a [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:55.186614 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 96ec205b0f31484a91054fedf619b9ab (DEFAULT_TABLE table=default.Table_1e3673ebd97b4210b4ca490b2dd1fb06 [id=62132df62b3a42fb9886592b9b885d31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.211750 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ec205b0f31484a91054fedf619b9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.211935 12175 tablet_replica.cc:331] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.212057 12177 ts_tablet_manager.cc:1918] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.212073 12175 raft_consensus.cc:2241] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.212126 12177 log.cc:1199] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/fc2766f8e0b544b0b48a0e7e5952d672
I20250625 14:01:55.212203 12175 raft_consensus.cc:2270] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.212708 12177 ts_tablet_manager.cc:1939] T fc2766f8e0b544b0b48a0e7e5952d672 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.212791 12173 log.cc:1199] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/da2c9696938143f69ea1305ee076d84d
I20250625 14:01:55.213068 12173 ts_tablet_manager.cc:1939] T da2c9696938143f69ea1305ee076d84d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.213182 12175 ts_tablet_manager.cc:1905] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.213217 12205 consensus_queue.cc:1035] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.187052 11895 tablet_service.cc:1468] Processing CreateTablet for tablet a7e0385d1c584c2d9560cbe138686565 (DEFAULT_TABLE table=default.Table_e43289a5fa434695a866d39a58d5c776 [id=d02b8ccb415e4358832eb8334c21a8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.213939 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e0385d1c584c2d9560cbe138686565. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.214020 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet fc2766f8e0b544b0b48a0e7e5952d672 (table default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
W20250625 14:01:55.214478 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 92984f3be8454a969b7c39af97a11479 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92984f3be8454a969b7c39af97a11479 already in progress: creating tablet
I20250625 14:01:55.214515 12173 tablet_replica.cc:331] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.214636 12173 raft_consensus.cc:2241] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.214661 12177 tablet_replica.cc:331] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.214742 12173 raft_consensus.cc:2270] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.214773 12177 raft_consensus.cc:2241] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.214932 12177 raft_consensus.cc:2270] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.215530 12177 ts_tablet_manager.cc:1905] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.187489 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (DEFAULT_TABLE table=default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.216032 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5227c93e932a4ed4b3d03990d7ed7b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.217382 12173 ts_tablet_manager.cc:1905] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.217543 12177 ts_tablet_manager.cc:1918] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.217603 12177 log.cc:1199] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d2afe02902a54045be3b435ed7585b08
I20250625 14:01:55.217854 12177 ts_tablet_manager.cc:1939] T d2afe02902a54045be3b435ed7585b08 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.188653 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 87974ef08b3b4cc299ae643c0cb5d694 (DEFAULT_TABLE table=default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.218190 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87974ef08b3b4cc299ae643c0cb5d694. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.218199 12175 ts_tablet_manager.cc:1918] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.218277 12175 log.cc:1199] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/36da902c99bf4416aa0769438182e443
I20250625 14:01:55.218513 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d2afe02902a54045be3b435ed7585b08 (table default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]) successfully deleted
I20250625 14:01:55.218586 12175 ts_tablet_manager.cc:1939] T 36da902c99bf4416aa0769438182e443 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.218987 12172 tablet_bootstrap.cc:492] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.219060 12172 ts_tablet_manager.cc:1397] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:01:55.219203 12175 tablet_replica.cc:331] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.219328 12175 raft_consensus.cc:2241] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.219429 12175 raft_consensus.cc:2270] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.219511 12172 raft_consensus.cc:357] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.219606 12172 raft_consensus.cc:383] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.219632 12172 raft_consensus.cc:738] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.219748 12172 consensus_queue.cc:260] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.219988 12172 ts_tablet_manager.cc:1428] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.192843 11901 tablet_service.cc:1468] Processing CreateTablet for tablet cb0b1a9a04ca4911b5f6e441d0239977 (DEFAULT_TABLE table=default.Table_37908936fde84cea9245460dac5d2283 [id=7ebc2c88eb074eb598b2cfda5e4e81bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.220139 12172 tablet_bootstrap.cc:492] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.220302 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb0b1a9a04ca4911b5f6e441d0239977. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.221050 12172 tablet_bootstrap.cc:654] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.195669 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.199046 12166 tablet_bootstrap.cc:492] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.201201 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet 205f83a0ffbc440492e241a75657f1b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.222497 12166 ts_tablet_manager.cc:1397] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20250625 14:01:55.201505 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 61acdd21d02e4576adba8f2ff24a154a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.223011 12166 raft_consensus.cc:357] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.223114 12166 raft_consensus.cc:383] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.223146 12166 raft_consensus.cc:738] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.223261 12166 consensus_queue.cc:260] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.201625 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e with delete_type TABLET_DATA_DELETED (replaced by tablet 54f0be19f9134fa3a88ae867b108c7e8) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.202728 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ab957f1fd4214efbb6233f312617c728" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:55.223543 12166 ts_tablet_manager.cc:1428] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.203691 12558 raft_consensus.cc:491] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.223879 12558 raft_consensus.cc:513] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.224229 12173 ts_tablet_manager.cc:1918] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.224311 12173 log.cc:1199] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8a4d01792d40471ab6d5bafa1a308351
I20250625 14:01:55.224346 12558 leader_election.cc:290] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.224530 12173 ts_tablet_manager.cc:1939] T 8a4d01792d40471ab6d5bafa1a308351 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.224874 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4617bb8a015d42188beba9df61df2c9f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.224911 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4617bb8a015d42188beba9df61df2c9f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:55.225281 11855 leader_election.cc:343] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:55.225306 11717 leader_election.cc:343] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: Tablet not RUNNING: SHUTDOWN
I20250625 14:01:55.225373 11717 leader_election.cc:304] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
W20250625 14:01:55.225400 11858 leader_election.cc:343] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.225450 11858 leader_election.cc:304] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.225663 12205 raft_consensus.cc:2747] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.225834 12558 raft_consensus.cc:2747] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.226905 12167 tablet_bootstrap.cc:492] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.227016 12167 ts_tablet_manager.cc:1397] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.001s
I20250625 14:01:55.227164 12166 tablet_bootstrap.cc:492] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.227511 12167 raft_consensus.cc:357] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.227613 12167 raft_consensus.cc:383] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.227648 12167 raft_consensus.cc:738] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.227768 12167 consensus_queue.cc:260] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.228089 12167 ts_tablet_manager.cc:1428] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.228258 12166 tablet_bootstrap.cc:654] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.228271 12167 tablet_bootstrap.cc:492] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.229223 12167 tablet_bootstrap.cc:654] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.229218 12177 tablet_replica.cc:331] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.229372 12177 raft_consensus.cc:2241] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.229492 12177 raft_consensus.cc:2270] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.229931 12175 ts_tablet_manager.cc:1905] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.232781 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet d4a1580aeb4a4c1787c32b4d23e0fcaa from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.233258 12600 raft_consensus.cc:491] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.233336 12600 raft_consensus.cc:513] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.233660 12600 leader_election.cc:290] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.233728 12177 ts_tablet_manager.cc:1905] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.235690 12175 ts_tablet_manager.cc:1918] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.235761 12175 log.cc:1199] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/22cfc7f3b1564e4f91114cd5e049da0d
I20250625 14:01:55.235965 12175 ts_tablet_manager.cc:1939] T 22cfc7f3b1564e4f91114cd5e049da0d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.236932 12205 raft_consensus.cc:491] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.237048 12205 raft_consensus.cc:513] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.237478 12205 leader_election.cc:290] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:55.237673 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "599bd5368dfc4ea0bd23ea4f18fe3c60" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.237872 12177 ts_tablet_manager.cc:1918] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.237944 12177 log.cc:1199] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/25160014ecf74c2ab6f1faca42d30c47
W20250625 14:01:55.238091 11855 leader_election.cc:343] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.238155 12177 ts_tablet_manager.cc:1939] T 25160014ecf74c2ab6f1faca42d30c47 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.238415 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0c5509615cf45339c455e8add91a96f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:55.238539 11920 raft_consensus.cc:2466] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:55.239059 12177 tablet_replica.cc:331] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.239037 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0c5509615cf45339c455e8add91a96f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.239197 12177 raft_consensus.cc:2241] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.239217 11717 leader_election.cc:304] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:55.239302 12177 raft_consensus.cc:2270] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:55.239475 11717 leader_election.cc:343] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.239682 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 25160014ecf74c2ab6f1faca42d30c47 (table default.Table_1bc57951e55e40f2aa6b5736e5f9b500 [id=c8ce791eeb3845f2ba3e8ad40955506b]) successfully deleted
I20250625 14:01:55.239858 12205 raft_consensus.cc:2802] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 14:01:55.239857 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 704ecf1ea8dd423ead2a0d1be113c03d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 704ecf1ea8dd423ead2a0d1be113c03d already in progress: creating tablet
I20250625 14:01:55.239876 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "599bd5368dfc4ea0bd23ea4f18fe3c60" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.239908 12205 raft_consensus.cc:491] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.239965 12205 raft_consensus.cc:3058] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:55.239987 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8363c9c6dab64a30b08ab92a152a3ee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8363c9c6dab64a30b08ab92a152a3ee5 already in progress: creating tablet
I20250625 14:01:55.239980 11784 raft_consensus.cc:2466] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
W20250625 14:01:55.240114 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 72efc3ed21e3404eb0a0ba4326513601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72efc3ed21e3404eb0a0ba4326513601 already in progress: creating tablet
I20250625 14:01:55.240614 12175 tablet_replica.cc:331] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.240741 12175 raft_consensus.cc:2241] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.240825 12175 raft_consensus.cc:2270] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.240989 12205 raft_consensus.cc:513] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.241351 12205 leader_election.cc:290] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:55.241463 12175 ts_tablet_manager.cc:1905] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.241662 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0c5509615cf45339c455e8add91a96f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:55.241776 11920 raft_consensus.cc:3058] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.242169 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0c5509615cf45339c455e8add91a96f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:55.242673 11858 leader_election.cc:304] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.242777 11920 raft_consensus.cc:2466] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:55.242926 12558 raft_consensus.cc:2802] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.242972 12558 raft_consensus.cc:491] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250625 14:01:55.242978 11717 leader_election.cc:343] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.243014 12558 raft_consensus.cc:3058] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.243600 12175 ts_tablet_manager.cc:1918] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.243660 12175 log.cc:1199] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/4617bb8a015d42188beba9df61df2c9f
I20250625 14:01:55.243709 12558 raft_consensus.cc:513] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.243891 12600 raft_consensus.cc:491] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.243959 12600 raft_consensus.cc:513] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.244042 12175 ts_tablet_manager.cc:1939] T 4617bb8a015d42188beba9df61df2c9f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.244097 12558 leader_election.cc:290] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.244256 12600 leader_election.cc:290] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.244552 12175 tablet_replica.cc:331] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.244657 12175 raft_consensus.cc:2241] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.244737 12175 raft_consensus.cc:2270] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.244794 11717 leader_election.cc:304] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.244794 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbdc3547d8de48e8887ffeb5b0f71f82" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.245117 12177 ts_tablet_manager.cc:1905] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:55.245141 11855 leader_election.cc:343] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.246628 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "599bd5368dfc4ea0bd23ea4f18fe3c60" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:55.246953 11855 leader_election.cc:343] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.247172 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "599bd5368dfc4ea0bd23ea4f18fe3c60" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:55.247278 11784 raft_consensus.cc:3058] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.248216 11784 raft_consensus.cc:2466] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:55.249347 11858 leader_election.cc:304] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.249397 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbdc3547d8de48e8887ffeb5b0f71f82" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.249691 12600 raft_consensus.cc:2802] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.249776 12600 raft_consensus.cc:695] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:55.249926 12600 consensus_queue.cc:237] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.249986 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8abc4f3249834149817f4c730d26b806" } new_table_name: "default.Table_315e7726e574485ba15c66dfad56a12a" modify_external_catalogs: true
I20250625 14:01:55.251204 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_91566225a46e41818d4bda31310c44f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.251606 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91566225a46e41818d4bda31310c44f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.251883 12558 raft_consensus.cc:491] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.251889 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_37917022f1ad4c3288d7753c8e655bd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.251986 12558 raft_consensus.cc:513] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:55.252228 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37917022f1ad4c3288d7753c8e655bd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.252326 12558 leader_election.cc:290] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.252667 12177 ts_tablet_manager.cc:1918] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.252739 12177 log.cc:1199] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/da2c9696938143f69ea1305ee076d84d
I20250625 14:01:55.252825 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d8bbe1212a7438f9a06cc1a18c6e40a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.252995 12177 ts_tablet_manager.cc:1939] T da2c9696938143f69ea1305ee076d84d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:55.253227 11855 leader_election.cc:343] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.254349 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ab0822cedbab4155af1fea06eaf34d5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.254690 11858 leader_election.cc:343] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:55.254717 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab0822cedbab4155af1fea06eaf34d5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.254763 11858 leader_election.cc:304] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.254997 12558 raft_consensus.cc:2747] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.255910 11525 catalog_manager.cc:5582] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:55.256074 12205 raft_consensus.cc:2802] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.256181 12205 raft_consensus.cc:695] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:55.256330 12205 consensus_queue.cc:237] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.256356 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9d8bbe1212a7438f9a06cc1a18c6e40a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.257547 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7f1415a5baff45288950d6b31c93d71a" } new_table_name: "default.Table_5a6cb21f6391471fad9ad3a56e283930" modify_external_catalogs: true
I20250625 14:01:55.258121 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
W20250625 14:01:55.258288 11858 leader_election.cc:343] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.258394 11858 leader_election.cc:304] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.258615 12558 raft_consensus.cc:2747] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.258925 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 (DEFAULT_TABLE table=default.Table_9aa153abf09346f4a92998fa6a4c1cb0 [id=f7e3bef19fc644cf89f008469f969c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.259217 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5872bfb53bd04ac79d02f8d87a4ea090. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.259476 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10a18d192fee4f6092695ec20f30a5ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.260629 12175 ts_tablet_manager.cc:1905] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.261556 11761 tablet_service.cc:1468] Processing CreateTablet for tablet f6116f7e64ae4e19863629a0e88a7265 (DEFAULT_TABLE table=default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.261797 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6116f7e64ae4e19863629a0e88a7265. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.264070 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 54f0be19f9134fa3a88ae867b108c7e8 (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.264336 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f0be19f9134fa3a88ae867b108c7e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.264576 12175 ts_tablet_manager.cc:1918] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.264652 12175 log.cc:1199] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d2afe02902a54045be3b435ed7585b08
I20250625 14:01:55.264896 12175 ts_tablet_manager.cc:1939] T d2afe02902a54045be3b435ed7585b08 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.266541 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 339813cd0c194f07bfc4edefd6a05ef3 (DEFAULT_TABLE table=default.Table_dba49d3cdee64ffba6f3959bed8da9ba [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.266798 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339813cd0c194f07bfc4edefd6a05ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.266933 12175 tablet_replica.cc:331] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.267086 12175 raft_consensus.cc:2241] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.267203 12175 raft_consensus.cc:2270] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.269022 12175 ts_tablet_manager.cc:1905] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.269085 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 7ebac6abf36f44fb93f556b59b2dd022 (DEFAULT_TABLE table=default.Table_1d7b4535b298478b82f91b4918344234 [id=5c8c581dd0874ff4899ea9d857c40a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.269384 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ebac6abf36f44fb93f556b59b2dd022. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.258271 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 61acdd21d02e4576adba8f2ff24a154a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61acdd21d02e4576adba8f2ff24a154a already in progress: creating tablet
W20250625 14:01:55.269763 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 205f83a0ffbc440492e241a75657f1b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 205f83a0ffbc440492e241a75657f1b8 already in progress: creating tablet
W20250625 14:01:55.269897 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bcdf4d901e34ab5ba2c36fe53456f0e already in progress: creating tablet
I20250625 14:01:55.270411 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 9cf278e5ff7f4e0c9b9b25610a76c74d from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.270638 11532 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 39ff4b0e7ac74ec294550775aaa44468 (table default.Table_7887db4b4d5c4f2a8770f9f0b73832ec [id=12bf9473cabd4d199715d23c94a02005]). Expected version 1 got 0
I20250625 14:01:55.271194 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 96984bb93836413a85f112f7d162598f from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.271658 12175 ts_tablet_manager.cc:1918] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.271726 12175 log.cc:1199] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/da2c9696938143f69ea1305ee076d84d
I20250625 14:01:55.271986 12175 ts_tablet_manager.cc:1939] T da2c9696938143f69ea1305ee076d84d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.272886 12175 tablet_replica.cc:331] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.273026 12175 raft_consensus.cc:2241] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.273128 12175 raft_consensus.cc:2270] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.273556 12175 ts_tablet_manager.cc:1905] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.274770 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 7ebac6abf36f44fb93f556b59b2dd022 (DEFAULT_TABLE table=default.Table_1d7b4535b298478b82f91b4918344234 [id=5c8c581dd0874ff4899ea9d857c40a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.275048 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ebac6abf36f44fb93f556b59b2dd022. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.275409 12205 consensus_queue.cc:1035] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.275969 12175 ts_tablet_manager.cc:1918] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.276049 12175 log.cc:1199] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9d8bbe1212a7438f9a06cc1a18c6e40a
I20250625 14:01:55.276284 12175 ts_tablet_manager.cc:1939] T 9d8bbe1212a7438f9a06cc1a18c6e40a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.276289 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet d2afe02902a54045be3b435ed7585b08 with delete_type TABLET_DATA_DELETED (replaced by tablet 87974ef08b3b4cc299ae643c0cb5d694) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.276449 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet ab957f1fd4214efbb6233f312617c728 with delete_type TABLET_DATA_DELETED (replaced by tablet ee3cc1074818466a97d04f0136eaea92) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.276578 12177 tablet_replica.cc:331] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.276724 12177 raft_consensus.cc:2241] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.276842 12177 raft_consensus.cc:2270] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.278918 12177 ts_tablet_manager.cc:1905] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:55.280079 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 882da47c1f5a496f8df2ba2d3501b453 consensus state has no leader
I20250625 14:01:55.281208 12177 ts_tablet_manager.cc:1918] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.281319 12177 log.cc:1199] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/ab957f1fd4214efbb6233f312617c728
I20250625 14:01:55.281313 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 (DEFAULT_TABLE table=default.Table_9aa153abf09346f4a92998fa6a4c1cb0 [id=f7e3bef19fc644cf89f008469f969c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.281579 12177 ts_tablet_manager.cc:1939] T ab957f1fd4214efbb6233f312617c728 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.281587 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5872bfb53bd04ac79d02f8d87a4ea090. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.282107 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d2afe02902a54045be3b435ed7585b08 because the tablet was not found. No further retry: Not found: Tablet not found: d2afe02902a54045be3b435ed7585b08
W20250625 14:01:55.284536 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfdb34255cb147c48a322514b7a7a19d consensus state has no leader
I20250625 14:01:55.284561 12166 tablet_bootstrap.cc:492] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.284653 12166 ts_tablet_manager.cc:1397] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.000s
I20250625 14:01:55.284709 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 96984bb93836413a85f112f7d162598f
I20250625 14:01:55.284977 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 96984bb93836413a85f112f7d162598f deleted and replaced by tablet a25ceea16cbb4e339c2ebcc580c47270
I20250625 14:01:55.285157 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9cf278e5ff7f4e0c9b9b25610a76c74d
I20250625 14:01:55.285212 12166 raft_consensus.cc:357] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.285331 12166 raft_consensus.cc:383] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.285367 12166 raft_consensus.cc:738] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.285367 11531 catalog_manager.cc:6652] ReplaceTablet: tablet 9cf278e5ff7f4e0c9b9b25610a76c74d deleted and replaced by tablet 7cd1672cf1164e469a862c5b43ec6f12
I20250625 14:01:55.285519 12166 consensus_queue.cc:260] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.285848 12166 ts_tablet_manager.cc:1428] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.286049 12166 tablet_bootstrap.cc:492] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.286854 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e2d752997eb84bdc9bc702cc0afc16e6" } new_table_name: "default.Table_ec27a022d9e9492babebf395fc96724d" modify_external_catalogs: true
I20250625 14:01:55.286958 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f1b487c26148480799a5c15d9605202f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.287341 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1b487c26148480799a5c15d9605202f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.287663 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.288044 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.288702 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8a54b321a8a040eb9fbd1f842aa17161" } new_table_name: "default.Table_91d650533d9e4a8a80674057cfcf6964" modify_external_catalogs: true
I20250625 14:01:55.288748 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_624b939aea9f40bdbe04f0a87a83f8c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.289099 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_624b939aea9f40bdbe04f0a87a83f8c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.290055 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_55a7a183514a4c8fb0bccc8ee4751b96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.290431 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55a7a183514a4c8fb0bccc8ee4751b96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.291280 12166 tablet_bootstrap.cc:654] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.292124 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet ab957f1fd4214efbb6233f312617c728 (table default.Table_5987ef8c74ec45e2b5d841638a30ba99 [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
I20250625 14:01:55.292313 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.293357 12167 tablet_bootstrap.cc:492] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.293462 12167 ts_tablet_manager.cc:1397] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
I20250625 14:01:55.293838 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 (DEFAULT_TABLE table=default.Table_9aa153abf09346f4a92998fa6a4c1cb0 [id=f7e3bef19fc644cf89f008469f969c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.294008 12167 raft_consensus.cc:357] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.294135 12167 raft_consensus.cc:383] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.294188 12167 raft_consensus.cc:738] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.294342 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5872bfb53bd04ac79d02f8d87a4ea090. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.294348 12167 consensus_queue.cc:260] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.294682 12167 ts_tablet_manager.cc:1428] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.295297 12167 tablet_bootstrap.cc:492] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.295704 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d with delete_type TABLET_DATA_DELETED (replaced by tablet 7cd1672cf1164e469a862c5b43ec6f12) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.295837 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 96984bb93836413a85f112f7d162598f with delete_type TABLET_DATA_DELETED (replaced by tablet a25ceea16cbb4e339c2ebcc580c47270) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.295939 12177 tablet_replica.cc:331] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.296077 12177 raft_consensus.cc:2241] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.296097 12175 tablet_replica.cc:331] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.296208 12177 raft_consensus.cc:2270] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.296219 12175 raft_consensus.cc:2241] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.296343 12167 tablet_bootstrap.cc:654] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.296587 12175 raft_consensus.cc:2270] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.296792 12177 ts_tablet_manager.cc:1905] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.297070 12175 ts_tablet_manager.cc:1905] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.297616 12172 tablet_bootstrap.cc:492] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.297719 12172 ts_tablet_manager.cc:1397] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.000s
I20250625 14:01:55.298211 12172 raft_consensus.cc:357] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.298362 12172 raft_consensus.cc:383] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.298403 12172 raft_consensus.cc:738] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.298548 12172 consensus_queue.cc:260] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.298882 12172 ts_tablet_manager.cc:1428] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:55.299096 12172 tablet_bootstrap.cc:492] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.299243 12177 ts_tablet_manager.cc:1918] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.299307 12177 log.cc:1199] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9cf278e5ff7f4e0c9b9b25610a76c74d
I20250625 14:01:55.299548 12177 ts_tablet_manager.cc:1939] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.300143 12172 tablet_bootstrap.cc:654] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.300215 12175 ts_tablet_manager.cc:1918] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.300307 12175 log.cc:1199] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/144ba67ce1fa419cac46e40ebcc078e6
I20250625 14:01:55.300520 12175 ts_tablet_manager.cc:1939] T 144ba67ce1fa419cac46e40ebcc078e6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.300180 12030 tablet_service.cc:1468] Processing CreateTablet for tablet f6116f7e64ae4e19863629a0e88a7265 (DEFAULT_TABLE table=default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.304738 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6116f7e64ae4e19863629a0e88a7265. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.307269 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0b3cb311c8ff42a6a5488448051f33a8" } modify_external_catalogs: true
I20250625 14:01:55.307427 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0b3cb311c8ff42a6a5488448051f33a8" } modify_external_catalogs: true
I20250625 14:01:55.315490 11892 tablet_service.cc:1468] Processing CreateTablet for tablet f6116f7e64ae4e19863629a0e88a7265 (DEFAULT_TABLE table=default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.315857 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6116f7e64ae4e19863629a0e88a7265. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.316150 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_768e989533ee4c5a8ad6f761a51c058d" } modify_external_catalogs: true
I20250625 14:01:55.316342 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_768e989533ee4c5a8ad6f761a51c058d" } modify_external_catalogs: true
I20250625 14:01:55.317123 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 339813cd0c194f07bfc4edefd6a05ef3 (DEFAULT_TABLE table=default.Table_dba49d3cdee64ffba6f3959bed8da9ba [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.317301 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 339813cd0c194f07bfc4edefd6a05ef3 (DEFAULT_TABLE table=default.Table_dba49d3cdee64ffba6f3959bed8da9ba [id=05ba3fb82ea74715a67dbefb3018db83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.317405 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339813cd0c194f07bfc4edefd6a05ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.317582 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339813cd0c194f07bfc4edefd6a05ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.318552 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 54f0be19f9134fa3a88ae867b108c7e8 (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.319236 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f0be19f9134fa3a88ae867b108c7e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.320181 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f47cf7e6d24347a88da2ee8fbd6de1b1 consensus state has no leader
W20250625 14:01:55.320485 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7f797fe89204fa18340bfb43ab36cbf consensus state has no leader
I20250625 14:01:55.321431 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 54f0be19f9134fa3a88ae867b108c7e8 (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.321697 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f0be19f9134fa3a88ae867b108c7e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.322824 12167 tablet_bootstrap.cc:492] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.322927 12167 ts_tablet_manager.cc:1397] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20250625 14:01:55.323455 12167 raft_consensus.cc:357] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.323577 12167 raft_consensus.cc:383] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.323613 12167 raft_consensus.cc:738] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.323729 12167 consensus_queue.cc:260] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.324039 12167 ts_tablet_manager.cc:1428] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.324960 12167 tablet_bootstrap.cc:492] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.326489 11920 raft_consensus.cc:1273] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:55.327407 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:55.327777 12167 tablet_bootstrap.cc:654] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.327759 12208 consensus_queue.cc:1035] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.328796 12055 raft_consensus.cc:3058] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.329964 12055 raft_consensus.cc:1273] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:55.330839 12180 consensus_queue.cc:1035] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.331702 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9cf278e5ff7f4e0c9b9b25610a76c74d (table default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]) successfully deleted
W20250625 14:01:55.331894 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 96984bb93836413a85f112f7d162598f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96984bb93836413a85f112f7d162598f already in progress: creating tablet
I20250625 14:01:55.334708 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 91fe26db32a44fb08efa3809f0fddfae (table default.Table_07d074214aae4c1ab81b65f2859410a6 [id=9aceda4c69be483c9c6efff41eb01322]). Expected version 1 got 0
I20250625 14:01:55.335034 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_090b46fb5d524097805d01616f53df78" } modify_external_catalogs: true
I20250625 14:01:55.335150 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_090b46fb5d524097805d01616f53df78" } modify_external_catalogs: true
I20250625 14:01:55.335544 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 9d8bbe1212a7438f9a06cc1a18c6e40a from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.327562 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8a4d01792d40471ab6d5bafa1a308351 (table default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]) successfully deleted
I20250625 14:01:55.337692 12172 tablet_bootstrap.cc:492] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.337786 12172 ts_tablet_manager.cc:1397] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.002s
W20250625 14:01:55.337760 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 61acdd21d02e4576adba8f2ff24a154a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61acdd21d02e4576adba8f2ff24a154a already in progress: creating tablet
W20250625 14:01:55.337903 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bcdf4d901e34ab5ba2c36fe53456f0e already in progress: creating tablet
W20250625 14:01:55.338024 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 205f83a0ffbc440492e241a75657f1b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 205f83a0ffbc440492e241a75657f1b8 already in progress: creating tablet
I20250625 14:01:55.338483 12172 raft_consensus.cc:357] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.338588 12172 raft_consensus.cc:383] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.338618 12172 raft_consensus.cc:738] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.338749 12172 consensus_queue.cc:260] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.339040 12172 ts_tablet_manager.cc:1428] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.339394 12172 tablet_bootstrap.cc:492] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.342056 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet ab957f1fd4214efbb6233f312617c728 (table default.Table_5987ef8c74ec45e2b5d841638a30ba99 [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
I20250625 14:01:55.342175 12172 tablet_bootstrap.cc:654] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.342339 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 5bba2990cca6441fb954b2f30f561708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bba2990cca6441fb954b2f30f561708 already in progress: creating tablet
I20250625 14:01:55.342604 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 36da902c99bf4416aa0769438182e443 (table default.Table_18fd74110fdc485d839fae5cc2b22cfd [id=a32feaf4c2f74d1bbd361e7680395682]) successfully deleted
I20250625 14:01:55.342787 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 22cfc7f3b1564e4f91114cd5e049da0d (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:55.342903 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 4617bb8a015d42188beba9df61df2c9f (table default.Table_4c4a6ce84e424391a7e70a54a79913eb [id=d167abcc5579450c8d1850d50b1cf640]) successfully deleted
I20250625 14:01:55.346670 12166 tablet_bootstrap.cc:492] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.346782 12166 ts_tablet_manager.cc:1397] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.000s
I20250625 14:01:55.347337 12166 raft_consensus.cc:357] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.347479 12166 raft_consensus.cc:383] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.347519 12166 raft_consensus.cc:738] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.347683 12166 consensus_queue.cc:260] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.348865 12172 tablet_bootstrap.cc:492] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.348969 12172 ts_tablet_manager.cc:1397] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
I20250625 14:01:55.349512 12172 raft_consensus.cc:357] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.349615 12172 raft_consensus.cc:383] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.349584 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 8615e96c59474da5ae6214402aba4a46 (DEFAULT_TABLE table=default.Table_91566225a46e41818d4bda31310c44f1 [id=39a8705a1ef94a78b60acfd8169948c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.349644 12172 raft_consensus.cc:738] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.349762 12172 consensus_queue.cc:260] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.349843 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8615e96c59474da5ae6214402aba4a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.350037 12172 ts_tablet_manager.cc:1428] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:55.350245 12172 tablet_bootstrap.cc:492] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.350546 12167 tablet_bootstrap.cc:492] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.350639 12167 ts_tablet_manager.cc:1397] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20250625 14:01:55.351203 12167 raft_consensus.cc:357] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.351318 12167 raft_consensus.cc:383] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.351356 12167 raft_consensus.cc:738] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.352306 12233 tablet.cc:1722] T 91fe26db32a44fb08efa3809f0fddfae P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.353407 12166 ts_tablet_manager.cc:1428] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20250625 14:01:55.353662 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7cd1672cf1164e469a862c5b43ec6f12
I20250625 14:01:55.354450 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 0547992986704a949305e7c5d014b965 (DEFAULT_TABLE table=default.Table_37917022f1ad4c3288d7753c8e655bd6 [id=d1350de96d2845a39d309bd7b94f6e26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.354700 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0547992986704a949305e7c5d014b965. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.354763 12166 tablet_bootstrap.cc:492] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.351490 12167 consensus_queue.cc:260] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.356122 12167 ts_tablet_manager.cc:1428] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:01:55.356314 12167 tablet_bootstrap.cc:492] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.357301 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.357470 12172 tablet_bootstrap.cc:654] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.357605 12430 tablet.cc:1722] T 91fe26db32a44fb08efa3809f0fddfae P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.358604 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a27e38c613104c93938f9c49b2849c1c" } new_table_name: "default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a" modify_external_catalogs: true
I20250625 14:01:55.360649 12167 tablet_bootstrap.cc:654] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.361685 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7cd1672cf1164e469a862c5b43ec6f12 because the tablet was not found. No further retry: Not found: Tablet not found: 7cd1672cf1164e469a862c5b43ec6f12
W20250625 14:01:55.363267 11520 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 882da47c1f5a496f8df2ba2d3501b453 consensus state has no leader
I20250625 14:01:55.363632 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_86bc4127c128416a8881340b07e40d39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.364045 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86bc4127c128416a8881340b07e40d39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.365096 11755 tablet_service.cc:1468] Processing CreateTablet for tablet a25ceea16cbb4e339c2ebcc580c47270 (DEFAULT_TABLE table=default.Table_4d04289158c94a1a95157a785c3d5829 [id=ffe2f2ab5919440396e245783c966fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.365399 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25ceea16cbb4e339c2ebcc580c47270. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.366544 12668 raft_consensus.cc:491] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.366664 12668 raft_consensus.cc:513] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.366739 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7cc7e962e4b146bc88a06fde969eb99d
I20250625 14:01:55.367137 12668 leader_election.cc:290] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.367156 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet dbdc3547d8de48e8887ffeb5b0f71f82
I20250625 14:01:55.367552 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9cf278e5ff7f4e0c9b9b25610a76c74d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:55.369930 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.370097 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet dbdc3547d8de48e8887ffeb5b0f71f82 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:55.371044 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7cc7e962e4b146bc88a06fde969eb99d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cc7e962e4b146bc88a06fde969eb99d already in progress: creating tablet
W20250625 14:01:55.371222 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet dbdc3547d8de48e8887ffeb5b0f71f82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbdc3547d8de48e8887ffeb5b0f71f82 already in progress: creating tablet
W20250625 14:01:55.371465 11993 leader_election.cc:343] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 9cf278e5ff7f4e0c9b9b25610a76c74d
I20250625 14:01:55.371552 11993 leader_election.cc:304] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.371747 12668 raft_consensus.cc:2747] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.372282 11762 tablet_service.cc:1468] Processing CreateTablet for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 (DEFAULT_TABLE table=default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.372568 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.372697 12166 tablet_bootstrap.cc:654] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.373543 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d2afe02902a54045be3b435ed7585b08 (table default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]) successfully deleted
W20250625 14:01:55.373682 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 92984f3be8454a969b7c39af97a11479 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92984f3be8454a969b7c39af97a11479 already in progress: creating tablet
W20250625 14:01:55.374806 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 704ecf1ea8dd423ead2a0d1be113c03d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 704ecf1ea8dd423ead2a0d1be113c03d already in progress: creating tablet
W20250625 14:01:55.374939 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8363c9c6dab64a30b08ab92a152a3ee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8363c9c6dab64a30b08ab92a152a3ee5 already in progress: creating tablet
W20250625 14:01:55.375056 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 72efc3ed21e3404eb0a0ba4326513601 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 72efc3ed21e3404eb0a0ba4326513601 already in progress: creating tablet
I20250625 14:01:55.375149 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet da2c9696938143f69ea1305ee076d84d (table default.Table_10c989b9d71841c59c66d2a9c4f77021 [id=78536fe9fe35426dbf8b277c45594020]) successfully deleted
I20250625 14:01:55.375242 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9d8bbe1212a7438f9a06cc1a18c6e40a (table default.Table_4f90b19d20404564bb50d83322939821 [id=74f13a50680d4455a4fddc3eb7a3b3bd]) successfully deleted
W20250625 14:01:55.375341 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 205f83a0ffbc440492e241a75657f1b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 205f83a0ffbc440492e241a75657f1b8 already in progress: creating tablet
W20250625 14:01:55.375528 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 61acdd21d02e4576adba8f2ff24a154a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61acdd21d02e4576adba8f2ff24a154a already in progress: creating tablet
W20250625 14:01:55.375651 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bcdf4d901e34ab5ba2c36fe53456f0e already in progress: creating tablet
I20250625 14:01:55.375748 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 144ba67ce1fa419cac46e40ebcc078e6 (table default.Table_04bedd118b064b669bbd67a9e6017fba [id=1513365deec7433d8564e56a0dca7154]) successfully deleted
I20250625 14:01:55.376343 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 (DEFAULT_TABLE table=default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.376677 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd1672cf1164e469a862c5b43ec6f12. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.377070 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49c8487f502b4f5299387daa9e89604b consensus state has no leader
I20250625 14:01:55.381076 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 96984bb93836413a85f112f7d162598f with delete_type TABLET_DATA_DELETED (replaced by tablet a25ceea16cbb4e339c2ebcc580c47270) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.381626 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 96984bb93836413a85f112f7d162598f with delete_type TABLET_DATA_DELETED (replaced by tablet a25ceea16cbb4e339c2ebcc580c47270) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.382212 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d with delete_type TABLET_DATA_DELETED (replaced by tablet 7cd1672cf1164e469a862c5b43ec6f12) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.382536 12173 tablet_replica.cc:331] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.382689 12173 raft_consensus.cc:2241] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.382803 12173 raft_consensus.cc:2270] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.382874 12172 tablet_bootstrap.cc:492] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.382906 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cf278e5ff7f4e0c9b9b25610a76c74d with delete_type TABLET_DATA_DELETED (replaced by tablet 7cd1672cf1164e469a862c5b43ec6f12) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.382982 12172 ts_tablet_manager.cc:1397] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20250625 14:01:55.383087 12175 tablet_replica.cc:331] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.383239 12175 raft_consensus.cc:2241] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.383469 12175 raft_consensus.cc:2270] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.383484 12172 raft_consensus.cc:357] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.383601 12172 raft_consensus.cc:383] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.383635 12172 raft_consensus.cc:738] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.383919 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_07d074214aae4c1ab81b65f2859410a6 [id=9aceda4c69be483c9c6efff41eb01322] alter complete (version 1)
I20250625 14:01:55.384052 12172 consensus_queue.cc:260] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.384172 12175 ts_tablet_manager.cc:1905] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.384526 12172 ts_tablet_manager.cc:1428] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.384697 12172 tablet_bootstrap.cc:492] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.385700 12172 tablet_bootstrap.cc:654] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.386691 12173 ts_tablet_manager.cc:1905] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.386926 12584 tablet.cc:1722] T 91fe26db32a44fb08efa3809f0fddfae P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.387544 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cf032fd9d44e45eba5453bab85a976bb" } modify_external_catalogs: true
I20250625 14:01:55.387670 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cf032fd9d44e45eba5453bab85a976bb" } modify_external_catalogs: true
I20250625 14:01:55.389189 12173 ts_tablet_manager.cc:1918] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.389179 12175 ts_tablet_manager.cc:1918] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.389256 12173 log.cc:1199] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9cf278e5ff7f4e0c9b9b25610a76c74d
I20250625 14:01:55.389262 12175 log.cc:1199] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9cf278e5ff7f4e0c9b9b25610a76c74d
I20250625 14:01:55.389492 12173 ts_tablet_manager.cc:1939] T 9cf278e5ff7f4e0c9b9b25610a76c74d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.389571 12175 ts_tablet_manager.cc:1939] T 9cf278e5ff7f4e0c9b9b25610a76c74d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.390683 12167 tablet_bootstrap.cc:492] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.390782 12167 ts_tablet_manager.cc:1397] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20250625 14:01:55.391302 12167 raft_consensus.cc:357] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.391409 12167 raft_consensus.cc:383] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.391446 12167 raft_consensus.cc:738] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.391582 12167 consensus_queue.cc:260] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.392673 12167 ts_tablet_manager.cc:1428] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:55.392484 11755 tablet_service.cc:1468] Processing CreateTablet for tablet db4a9e4dfdd145bab965004ee5562e2b (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.392894 12167 tablet_bootstrap.cc:492] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.393178 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4a9e4dfdd145bab965004ee5562e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.393780 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_86bc4127c128416a8881340b07e40d39" } modify_external_catalogs: true
I20250625 14:01:55.393910 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_86bc4127c128416a8881340b07e40d39" } modify_external_catalogs: true
I20250625 14:01:55.394529 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.394989 12167 tablet_bootstrap.cc:654] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.395347 12175 tablet_replica.cc:331] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.395552 12175 raft_consensus.cc:2241] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.395740 12175 raft_consensus.cc:2270] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.396368 12175 ts_tablet_manager.cc:1905] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.397029 12180 raft_consensus.cc:491] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.397131 12180 raft_consensus.cc:513] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.397545 12180 leader_election.cc:290] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.398190 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4617bb8a015d42188beba9df61df2c9f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:55.399612 11717 leader_election.cc:343] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 4617bb8a015d42188beba9df61df2c9f
W20250625 14:01:55.399987 11717 leader_election.cc:343] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.401198 11717 leader_election.cc:304] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:55.401768 12668 raft_consensus.cc:491] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.401867 12668 raft_consensus.cc:513] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.402338 12668 leader_election.cc:290] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:01:55.403189 11990 leader_election.cc:343] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: a22eff28938b419f97ad971c486944ff
I20250625 14:01:55.403667 12180 raft_consensus.cc:2747] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.403967 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f40cfb7e1454489f9d01fd220e35b3e6
I20250625 14:01:55.404546 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cf7c90591044422fb0bd51e503ec2b0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.404949 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf7c90591044422fb0bd51e503ec2b0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:55.405278 11993 leader_election.cc:343] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: a22eff28938b419f97ad971c486944ff
I20250625 14:01:55.405351 11993 leader_election.cc:304] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.405586 12668 raft_consensus.cc:2747] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.405827 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet f6116f7e64ae4e19863629a0e88a7265 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.406561 12172 tablet_bootstrap.cc:492] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.406662 12172 ts_tablet_manager.cc:1397] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:01:55.407215 12175 ts_tablet_manager.cc:1918] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.407222 12172 raft_consensus.cc:357] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.407315 12175 log.cc:1199] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d4a1580aeb4a4c1787c32b4d23e0fcaa
I20250625 14:01:55.407332 12172 raft_consensus.cc:383] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.407375 12172 raft_consensus.cc:738] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.407496 12172 consensus_queue.cc:260] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.407565 12175 ts_tablet_manager.cc:1939] T d4a1580aeb4a4c1787c32b4d23e0fcaa P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.408718 12172 ts_tablet_manager.cc:1428] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:55.408970 12172 tablet_bootstrap.cc:492] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.409015 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 8615e96c59474da5ae6214402aba4a46 (DEFAULT_TABLE table=default.Table_91566225a46e41818d4bda31310c44f1 [id=39a8705a1ef94a78b60acfd8169948c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.409390 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8615e96c59474da5ae6214402aba4a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.409715 11528 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 471840a2874a46689499a4138ca8e2ff
I20250625 14:01:55.410158 12172 tablet_bootstrap.cc:654] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.413990 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet f40cfb7e1454489f9d01fd220e35b3e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.414299 12177 tablet_replica.cc:331] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.414470 12177 raft_consensus.cc:2241] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.414593 12177 raft_consensus.cc:2270] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.414829 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 8615e96c59474da5ae6214402aba4a46 (DEFAULT_TABLE table=default.Table_91566225a46e41818d4bda31310c44f1 [id=39a8705a1ef94a78b60acfd8169948c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.415015 12177 ts_tablet_manager.cc:1905] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.415288 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8615e96c59474da5ae6214402aba4a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.417410 12177 ts_tablet_manager.cc:1918] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.417477 12177 log.cc:1199] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f40cfb7e1454489f9d01fd220e35b3e6
I20250625 14:01:55.417738 12177 ts_tablet_manager.cc:1939] T f40cfb7e1454489f9d01fd220e35b3e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.419134 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.419181 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.419929 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 0547992986704a949305e7c5d014b965 (DEFAULT_TABLE table=default.Table_37917022f1ad4c3288d7753c8e655bd6 [id=d1350de96d2845a39d309bd7b94f6e26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.420289 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0547992986704a949305e7c5d014b965. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.420753 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f40cfb7e1454489f9d01fd220e35b3e6 (table default.Table_cf032fd9d44e45eba5453bab85a976bb [id=f598d49003534886af0cbb8abcb424ae]) successfully deleted
I20250625 14:01:55.423089 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.423187 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f6116f7e64ae4e19863629a0e88a7265
I20250625 14:01:55.423483 11526 catalog_manager.cc:6652] ReplaceTablet: tablet f6116f7e64ae4e19863629a0e88a7265 deleted and replaced by tablet 21f88f43067643dd80ec8a2f5fb370c1
I20250625 14:01:55.424785 12166 tablet_bootstrap.cc:492] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.424918 12166 ts_tablet_manager.cc:1397] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.001s
I20250625 14:01:55.425536 12166 raft_consensus.cc:357] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.425670 12166 raft_consensus.cc:383] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.425709 12166 raft_consensus.cc:738] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.425843 12166 consensus_queue.cc:260] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.426169 12166 ts_tablet_manager.cc:1428] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.426220 12032 tablet_service.cc:1468] Processing CreateTablet for tablet a25ceea16cbb4e339c2ebcc580c47270 (DEFAULT_TABLE table=default.Table_4d04289158c94a1a95157a785c3d5829 [id=ffe2f2ab5919440396e245783c966fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.426573 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25ceea16cbb4e339c2ebcc580c47270. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.426735 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet dbdc3547d8de48e8887ffeb5b0f71f82 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.426909 11892 tablet_service.cc:1468] Processing CreateTablet for tablet a25ceea16cbb4e339c2ebcc580c47270 (DEFAULT_TABLE table=default.Table_4d04289158c94a1a95157a785c3d5829 [id=ffe2f2ab5919440396e245783c966fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.426970 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 (DEFAULT_TABLE table=default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.427009 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet dbdc3547d8de48e8887ffeb5b0f71f82 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.427188 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25ceea16cbb4e339c2ebcc580c47270. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.427310 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd1672cf1164e469a862c5b43ec6f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.427289 12029 tablet_service.cc:1468] Processing CreateTablet for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 (DEFAULT_TABLE table=default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.427517 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.429752 11896 tablet_service.cc:1468] Processing CreateTablet for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 (DEFAULT_TABLE table=default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.429817 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 (DEFAULT_TABLE table=default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.430063 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd1672cf1164e469a862c5b43ec6f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.430066 11901 tablet_service.cc:1468] Processing CreateTablet for tablet db4a9e4dfdd145bab965004ee5562e2b (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:55.430217 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 96984bb93836413a85f112f7d162598f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96984bb93836413a85f112f7d162598f already in progress: creating tablet
W20250625 14:01:55.430505 11517 catalog_manager.cc:4895] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7cd1672cf1164e469a862c5b43ec6f12 because the tablet was not found. No further retry: Not found: Tablet not found: 7cd1672cf1164e469a862c5b43ec6f12
I20250625 14:01:55.431037 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 91fe26db32a44fb08efa3809f0fddfae (table default.Table_07d074214aae4c1ab81b65f2859410a6 [id=9aceda4c69be483c9c6efff41eb01322]). Expected version 1 got 0
I20250625 14:01:55.431102 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4a9e4dfdd145bab965004ee5562e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.431417 12175 tablet_replica.cc:331] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.431587 12175 raft_consensus.cc:2241] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.432461 12031 tablet_service.cc:1468] Processing CreateTablet for tablet db4a9e4dfdd145bab965004ee5562e2b (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.432711 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4a9e4dfdd145bab965004ee5562e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.433473 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.431697 12175 raft_consensus.cc:2270] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.435153 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.435700 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet f6116f7e64ae4e19863629a0e88a7265 with delete_type TABLET_DATA_DELETED (replaced by tablet 21f88f43067643dd80ec8a2f5fb370c1) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.437116 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:55.437613 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 96984bb93836413a85f112f7d162598f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96984bb93836413a85f112f7d162598f already in progress: creating tablet
I20250625 14:01:55.437788 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d4a1580aeb4a4c1787c32b4d23e0fcaa (table default.Table_6e0ca353af7d4a4aa7179de57cc9c962 [id=a4aac54fe4334c33b6fdbb81c472f827]) successfully deleted
I20250625 14:01:55.438647 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet f40cfb7e1454489f9d01fd220e35b3e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.438768 12172 tablet_bootstrap.cc:492] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.438879 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet f6116f7e64ae4e19863629a0e88a7265 with delete_type TABLET_DATA_DELETED (replaced by tablet 21f88f43067643dd80ec8a2f5fb370c1) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.438937 12172 ts_tablet_manager.cc:1397] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250625 14:01:55.439424 12172 raft_consensus.cc:357] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.439611 12172 raft_consensus.cc:383] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.439689 12172 raft_consensus.cc:738] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.439860 12172 consensus_queue.cc:260] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.440017 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]). Expected version 1 got 0
I20250625 14:01:55.440320 12172 ts_tablet_manager.cc:1428] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.441212 12172 tablet_bootstrap.cc:492] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.442380 12172 tablet_bootstrap.cc:654] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.444478 11529 catalog_manager.cc:5582] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:55.444725 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet f0c5509615cf45339c455e8add91a96f (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]). Expected version 2 got 0
I20250625 14:01:55.445865 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet f40cfb7e1454489f9d01fd220e35b3e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.446137 12173 tablet_replica.cc:331] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.446285 12173 raft_consensus.cc:2241] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.446751 12173 raft_consensus.cc:2270] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.446916 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet f47cf7e6d24347a88da2ee8fbd6de1b1 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.447229 12173 ts_tablet_manager.cc:1905] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.448086 12167 tablet_bootstrap.cc:492] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.448179 12167 ts_tablet_manager.cc:1397] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.055s user 0.000s sys 0.002s
I20250625 14:01:55.448774 12167 raft_consensus.cc:357] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.448896 12167 raft_consensus.cc:383] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.448930 12167 raft_consensus.cc:738] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.449055 12167 consensus_queue.cc:260] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.449404 12167 ts_tablet_manager.cc:1428] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250625 14:01:55.449613 12167 tablet_bootstrap.cc:492] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.450135 12558 raft_consensus.cc:491] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.450261 12558 raft_consensus.cc:513] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.450748 12558 leader_election.cc:290] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.450977 12167 tablet_bootstrap.cc:654] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.451898 12173 ts_tablet_manager.cc:1918] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.452520 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10506b2cb6c5468daa6ef270b6ed2d4d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:55.453485 11855 leader_election.cc:343] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.454898 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f47cf7e6d24347a88da2ee8fbd6de1b1
I20250625 14:01:55.455153 11528 catalog_manager.cc:6652] ReplaceTablet: tablet f47cf7e6d24347a88da2ee8fbd6de1b1 deleted and replaced by tablet 8feddd83af08466ea11c4a15a08d3c8b
I20250625 14:01:55.455617 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 975a71cb743443dc97228472e00b8c5c (DEFAULT_TABLE table=default.Table_624b939aea9f40bdbe04f0a87a83f8c3 [id=9ff06a3b7ae844e18bd0575488004bbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.455967 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975a71cb743443dc97228472e00b8c5c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.456787 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet dbdc3547d8de48e8887ffeb5b0f71f82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbdc3547d8de48e8887ffeb5b0f71f82 already in progress: creating tablet
I20250625 14:01:55.457252 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 (DEFAULT_TABLE table=default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.458470 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ece361f92a4c9a9df5ad3355f87db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.459651 12173 log.cc:1199] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f40cfb7e1454489f9d01fd220e35b3e6
I20250625 14:01:55.460033 12173 ts_tablet_manager.cc:1939] T f40cfb7e1454489f9d01fd220e35b3e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:55.460445 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f6116f7e64ae4e19863629a0e88a7265 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6116f7e64ae4e19863629a0e88a7265 already in progress: creating tablet
W20250625 14:01:55.460582 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7cc7e962e4b146bc88a06fde969eb99d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cc7e962e4b146bc88a06fde969eb99d already in progress: creating tablet
I20250625 14:01:55.460739 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 975a71cb743443dc97228472e00b8c5c (DEFAULT_TABLE table=default.Table_624b939aea9f40bdbe04f0a87a83f8c3 [id=9ff06a3b7ae844e18bd0575488004bbf]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:55.460841 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7cd1672cf1164e469a862c5b43ec6f12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cd1672cf1164e469a862c5b43ec6f12 already in progress: creating tablet
I20250625 14:01:55.461079 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975a71cb743443dc97228472e00b8c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.461395 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8feddd83af08466ea11c4a15a08d3c8b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.461756 12180 raft_consensus.cc:491] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.461853 12180 raft_consensus.cc:513] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.462270 12180 leader_election.cc:290] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.462502 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10506b2cb6c5468daa6ef270b6ed2d4d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.462628 11782 raft_consensus.cc:2466] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:55.463002 11858 leader_election.cc:304] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.463260 12558 raft_consensus.cc:2802] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.463323 12558 raft_consensus.cc:491] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.463372 12558 raft_consensus.cc:3058] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.463831 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 (DEFAULT_TABLE table=default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.464099 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ece361f92a4c9a9df5ad3355f87db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.464422 12558 raft_consensus.cc:513] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.464787 12558 leader_election.cc:290] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.465448 12180 raft_consensus.cc:491] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.465505 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10506b2cb6c5468daa6ef270b6ed2d4d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:55.465539 12180 raft_consensus.cc:513] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.465633 11782 raft_consensus.cc:3058] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.465960 12180 leader_election.cc:290] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:55.466503 11892 tablet_service.cc:1468] Processing CreateTablet for tablet d74f27d998b14ee890272812b718e468 (DEFAULT_TABLE table=default.Table_f1b487c26148480799a5c15d9605202f [id=06f86a5adb9a4fccb3756ff3fc5aef9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.466785 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74f27d998b14ee890272812b718e468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.466872 11782 raft_consensus.cc:2466] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:55.467695 11858 leader_election.cc:304] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:55.468164 12600 raft_consensus.cc:2802] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.468258 12600 raft_consensus.cc:695] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:55.468389 12600 consensus_queue.cc:237] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.460753 11894 tablet_service.cc:1468] Processing CreateTablet for tablet f61d1400161440e49365680085a3fe63 (DEFAULT_TABLE table=default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.470372 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61d1400161440e49365680085a3fe63. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.470921 12033 tablet_service.cc:1468] Processing CreateTablet for tablet d74f27d998b14ee890272812b718e468 (DEFAULT_TABLE table=default.Table_f1b487c26148480799a5c15d9605202f [id=06f86a5adb9a4fccb3756ff3fc5aef9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.471108 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet a22eff28938b419f97ad971c486944ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5bba2990cca6441fb954b2f30f561708) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.471402 12031 tablet_service.cc:1468] Processing CreateTablet for tablet f61d1400161440e49365680085a3fe63 (DEFAULT_TABLE table=default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.472047 12166 tablet_bootstrap.cc:492] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.473281 12166 tablet_bootstrap.cc:654] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.473841 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8feddd83af08466ea11c4a15a08d3c8b) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.474572 12175 ts_tablet_manager.cc:1905] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.476692 12175 ts_tablet_manager.cc:1918] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.476792 12175 log.cc:1199] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/aac4b7bbfad9493598b31a86e2c045c0
I20250625 14:01:55.477020 12175 ts_tablet_manager.cc:1939] T aac4b7bbfad9493598b31a86e2c045c0 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.477380 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbdc3547d8de48e8887ffeb5b0f71f82" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:55.477521 11920 raft_consensus.cc:2466] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:55.477586 12175 tablet_replica.cc:331] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.477722 12175 raft_consensus.cc:2241] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.477811 12175 raft_consensus.cc:2270] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.478382 12175 ts_tablet_manager.cc:1905] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.479188 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet f6116f7e64ae4e19863629a0e88a7265 with delete_type TABLET_DATA_DELETED (replaced by tablet 21f88f43067643dd80ec8a2f5fb370c1) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.479532 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet ef65dc31dc5843fb9e25275af5935e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.479555 11761 tablet_service.cc:1468] Processing CreateTablet for tablet f61d1400161440e49365680085a3fe63 (DEFAULT_TABLE table=default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.479574 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 (DEFAULT_TABLE table=default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.479626 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 4617bb8a015d42188beba9df61df2c9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.479808 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61d1400161440e49365680085a3fe63. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.479900 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.479943 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ece361f92a4c9a9df5ad3355f87db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.480127 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8feddd83af08466ea11c4a15a08d3c8b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.480165 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 975a71cb743443dc97228472e00b8c5c (DEFAULT_TABLE table=default.Table_624b939aea9f40bdbe04f0a87a83f8c3 [id=9ff06a3b7ae844e18bd0575488004bbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.480367 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975a71cb743443dc97228472e00b8c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.482380 12177 tablet_replica.cc:331] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.482447 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10506b2cb6c5468daa6ef270b6ed2d4d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:55.482514 12177 raft_consensus.cc:2241] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.482623 12177 raft_consensus.cc:2270] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.482937 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ef65dc31dc5843fb9e25275af5935e73" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.483052 12057 raft_consensus.cc:2466] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:55.483196 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbdc3547d8de48e8887ffeb5b0f71f82" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.483261 11762 tablet_service.cc:1468] Processing CreateTablet for tablet d74f27d998b14ee890272812b718e468 (DEFAULT_TABLE table=default.Table_f1b487c26148480799a5c15d9605202f [id=06f86a5adb9a4fccb3756ff3fc5aef9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.483355 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5987ef8c74ec45e2b5d841638a30ba99" } new_table_name: "default.Table_950ea773e03943f79810fce3d2b243da" modify_external_catalogs: true
I20250625 14:01:55.483493 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74f27d998b14ee890272812b718e468. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.483551 11855 leader_election.cc:343] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.484557 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61d1400161440e49365680085a3fe63. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.485023 12175 ts_tablet_manager.cc:1918] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.485093 12175 log.cc:1199] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/dbdc3547d8de48e8887ffeb5b0f71f82
I20250625 14:01:55.485330 12175 ts_tablet_manager.cc:1939] T dbdc3547d8de48e8887ffeb5b0f71f82 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.486080 12177 ts_tablet_manager.cc:1905] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.487520 12167 tablet_bootstrap.cc:492] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.487617 12167 ts_tablet_manager.cc:1397] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.002s
I20250625 14:01:55.487783 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 0547992986704a949305e7c5d014b965 (DEFAULT_TABLE table=default.Table_37917022f1ad4c3288d7753c8e655bd6 [id=d1350de96d2845a39d309bd7b94f6e26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.488176 12177 ts_tablet_manager.cc:1918] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.488242 12177 log.cc:1199] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/ef65dc31dc5843fb9e25275af5935e73
I20250625 14:01:55.488200 12167 raft_consensus.cc:357] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.488317 12167 raft_consensus.cc:383] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.488354 12167 raft_consensus.cc:738] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.488443 12177 ts_tablet_manager.cc:1939] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.488493 12167 consensus_queue.cc:260] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.488816 12167 ts_tablet_manager.cc:1428] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20250625 14:01:55.489058 12167 tablet_bootstrap.cc:492] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.490166 12167 tablet_bootstrap.cc:654] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.490918 12177 tablet_replica.cc:331] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.491048 12177 raft_consensus.cc:2241] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.491138 12177 raft_consensus.cc:2270] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.492509 12600 raft_consensus.cc:491] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.492614 12600 raft_consensus.cc:513] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.493036 12600 leader_election.cc:290] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:01:55.493851 11855 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 082a46d213c545b18acbcac1b699d140
I20250625 14:01:55.494014 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4388cbd6078f4906b12285dbc0e7189a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.494117 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e407283f16824e65ba9d6ff88904672f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.494488 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4388cbd6078f4906b12285dbc0e7189a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.495348 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_626e2cc613e149589b0a39ca9ff4c057" } new_table_name: "default.Table_06a503f6355b478caf948985a84c15f6" modify_external_catalogs: true
W20250625 14:01:55.495502 11858 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 082a46d213c545b18acbcac1b699d140
I20250625 14:01:55.495584 11858 leader_election.cc:304] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.495791 12600 raft_consensus.cc:2747] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.496268 12166 tablet_bootstrap.cc:492] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.496361 12166 ts_tablet_manager.cc:1397] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20250625 14:01:55.496857 12668 raft_consensus.cc:491] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.496953 12668 raft_consensus.cc:513] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.497051 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0547992986704a949305e7c5d014b965. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.497349 12668 leader_election.cc:290] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:01:55.494488 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e407283f16824e65ba9d6ff88904672f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.497982 12166 raft_consensus.cc:357] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.498096 12166 raft_consensus.cc:383] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.498143 12166 raft_consensus.cc:738] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.498270 12166 consensus_queue.cc:260] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.498612 12166 ts_tablet_manager.cc:1428] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:55.498821 12166 tablet_bootstrap.cc:492] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.498858 12177 ts_tablet_manager.cc:1905] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.500984 12166 tablet_bootstrap.cc:654] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.502490 11920 raft_consensus.cc:1273] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:55.502913 11717 leader_election.cc:304] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:55.503270 12175 tablet_replica.cc:331] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:01:55.503393 11990 leader_election.cc:343] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: d2afe02902a54045be3b435ed7585b08
I20250625 14:01:55.503432 12175 raft_consensus.cc:2241] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.503613 12180 raft_consensus.cc:2802] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.503647 12175 raft_consensus.cc:2270] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.503695 12180 raft_consensus.cc:491] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.503747 12180 raft_consensus.cc:3058] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.504091 12175 ts_tablet_manager.cc:1905] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.504624 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e85a2e6d3b004839ba2c86758577dddb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.504822 12180 raft_consensus.cc:513] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:55.505059 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e85a2e6d3b004839ba2c86758577dddb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.505245 12180 leader_election.cc:290] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:55.505589 11717 leader_election.cc:343] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: ef65dc31dc5843fb9e25275af5935e73
I20250625 14:01:55.505963 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_71763ac380284b57b2934b0ef542d711"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.506217 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 7302430d7e4a4610bfe271c114718d35 from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:55.506388 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71763ac380284b57b2934b0ef542d711 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.506392 12180 consensus_queue.cc:1035] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:55.507336 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f6116f7e64ae4e19863629a0e88a7265 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6116f7e64ae4e19863629a0e88a7265 already in progress: creating tablet
I20250625 14:01:55.511191 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet ef65dc31dc5843fb9e25275af5935e73 (table default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]) successfully deleted
W20250625 14:01:55.512933 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee3cc1074818466a97d04f0136eaea92 consensus state has no leader
I20250625 14:01:55.513165 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet d4a1580aeb4a4c1787c32b4d23e0fcaa from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.513316 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dbdc3547d8de48e8887ffeb5b0f71f82" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:55.513937 11717 leader_election.cc:304] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
W20250625 14:01:55.514071 11717 raft_consensus.cc:2684] T ef65dc31dc5843fb9e25275af5935e73 P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:55.515738 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74f27d998b14ee890272812b718e468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.516373 12173 tablet_replica.cc:331] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.516501 12173 raft_consensus.cc:2241] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.516588 12173 raft_consensus.cc:2270] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.517050 12175 ts_tablet_manager.cc:1918] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.517128 12175 log.cc:1199] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f40cfb7e1454489f9d01fd220e35b3e6
I20250625 14:01:55.517105 12173 ts_tablet_manager.cc:1905] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.517408 12175 ts_tablet_manager.cc:1939] T f40cfb7e1454489f9d01fd220e35b3e6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.519371 12173 ts_tablet_manager.cc:1918] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.519505 12173 log.cc:1199] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a22eff28938b419f97ad971c486944ff
I20250625 14:01:55.520733 12173 ts_tablet_manager.cc:1939] T a22eff28938b419f97ad971c486944ff P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.521353 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]). Expected version 1 got 0
I20250625 14:01:55.522876 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 39ff4b0e7ac74ec294550775aaa44468 (table default.Table_7887db4b4d5c4f2a8770f9f0b73832ec [id=12bf9473cabd4d199715d23c94a02005]). Expected version 1 got 0
I20250625 14:01:55.525084 12166 tablet_bootstrap.cc:492] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.525202 12166 ts_tablet_manager.cc:1397] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
W20250625 14:01:55.514482 11717 leader_election.cc:343] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.525693 12166 raft_consensus.cc:357] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.525805 12166 raft_consensus.cc:383] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.525836 12166 raft_consensus.cc:738] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.525962 12166 consensus_queue.cc:260] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.526233 12166 ts_tablet_manager.cc:1428] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.526238 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e370508891634b749a576b24d57d3593" } new_table_name: "default.Table_e97f0540e97b415fa28869e09d50620e" modify_external_catalogs: true
I20250625 14:01:55.526466 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fe87d71898b848e49fed4a97af4cefa9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.526823 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe87d71898b848e49fed4a97af4cefa9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.528147 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_72fe4368faa447cb81e9db0cad9a87e3" } new_table_name: "default.Table_82021dac408c42e9898349055acf8936" modify_external_catalogs: true
W20250625 14:01:55.528208 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b76d36bac354543b8f7cef071aaa661 consensus state has no leader
I20250625 14:01:55.528369 11528 catalog_manager.cc:5582] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:55.528599 11528 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f0c5509615cf45339c455e8add91a96f (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]). Expected version 2 got 0
I20250625 14:01:55.529825 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_28a04ff7c30341e4a4be38f90d04c527"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.530212 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28a04ff7c30341e4a4be38f90d04c527 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.531117 12166 tablet_bootstrap.cc:492] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.531442 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ba88e68554e349be85cfbc86283df3e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.531788 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba88e68554e349be85cfbc86283df3e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.533633 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7302430d7e4a4610bfe271c114718d35
I20250625 14:01:55.533957 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 7302430d7e4a4610bfe271c114718d35 deleted and replaced by tablet 7b78fd0d543449bdb2e95fee6a53e93f
W20250625 14:01:55.536201 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet deee7c3fb5204c63a6618f628848bc81 consensus state has no leader
I20250625 14:01:55.538409 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ac11fbf6c80047a78d8983642c8746dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.538853 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac11fbf6c80047a78d8983642c8746dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.542945 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet aac4b7bbfad9493598b31a86e2c045c0 (table default.Table_eb9b89668d974648ad501f6f3863cd81 [id=fe0b85589c3e4db4b88979ef94ffec30]) successfully deleted
I20250625 14:01:55.515443 12177 ts_tablet_manager.cc:1918] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.543220 12177 log.cc:1199] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/4617bb8a015d42188beba9df61df2c9f
W20250625 14:01:55.543329 11717 consensus_peers.cc:487] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:55.543524 12177 ts_tablet_manager.cc:1939] T 4617bb8a015d42188beba9df61df2c9f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.543569 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet dbdc3547d8de48e8887ffeb5b0f71f82 (table default.Table_768e989533ee4c5a8ad6f761a51c058d [id=1e3e09853928482bae0b4b3d489dea3c]) successfully deleted
W20250625 14:01:55.543700 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7cc7e962e4b146bc88a06fde969eb99d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cc7e962e4b146bc88a06fde969eb99d already in progress: creating tablet
I20250625 14:01:55.543864 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f40cfb7e1454489f9d01fd220e35b3e6 (table default.Table_cf032fd9d44e45eba5453bab85a976bb [id=f598d49003534886af0cbb8abcb424ae]) successfully deleted
W20250625 14:01:55.543995 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f6116f7e64ae4e19863629a0e88a7265 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6116f7e64ae4e19863629a0e88a7265 already in progress: creating tablet
W20250625 14:01:55.544102 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f47cf7e6d24347a88da2ee8fbd6de1b1 already in progress: creating tablet
I20250625 14:01:55.545207 12177 tablet_replica.cc:331] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.545358 12177 raft_consensus.cc:2241] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.545472 12177 raft_consensus.cc:2270] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.545630 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 4617bb8a015d42188beba9df61df2c9f from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:55.545482 11717 leader_election.cc:343] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:55.546490 11993 leader_election.cc:343] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: d2afe02902a54045be3b435ed7585b08
I20250625 14:01:55.546568 11993 leader_election.cc:304] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.546799 12668 raft_consensus.cc:2747] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.547693 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 4617bb8a015d42188beba9df61df2c9f (table default.Table_4c4a6ce84e424391a7e70a54a79913eb [id=d167abcc5579450c8d1850d50b1cf640]) successfully deleted
I20250625 14:01:55.547719 12177 ts_tablet_manager.cc:1905] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.548713 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (DEFAULT_TABLE table=default.Table_cf7c90591044422fb0bd51e503ec2b0f [id=db9eb49b2b2d49bb8dc446545f82064b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.549000 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.550135 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet dbdc3547d8de48e8887ffeb5b0f71f82 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.550295 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.550568 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 21f88f43067643dd80ec8a2f5fb370c1 (DEFAULT_TABLE table=default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.552101 12166 tablet_bootstrap.cc:654] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.553597 12668 raft_consensus.cc:491] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.553700 12668 raft_consensus.cc:513] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.553987 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f88f43067643dd80ec8a2f5fb370c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.554153 12668 leader_election.cc:290] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.554525 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 6b4141fcafbc4a6f96504bf47539b8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.554683 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet d2afe02902a54045be3b435ed7585b08 with delete_type TABLET_DATA_DELETED (replaced by tablet 87974ef08b3b4cc299ae643c0cb5d694) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.554687 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "599bd5368dfc4ea0bd23ea4f18fe3c60" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:01:55.555358 11717 leader_election.cc:343] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: dbdc3547d8de48e8887ffeb5b0f71f82
I20250625 14:01:55.555436 11717 leader_election.cc:304] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:55.556946 12167 tablet_bootstrap.cc:492] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.556931 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (DEFAULT_TABLE table=default.Table_cf7c90591044422fb0bd51e503ec2b0f [id=db9eb49b2b2d49bb8dc446545f82064b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.557057 12167 ts_tablet_manager.cc:1397] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.002s
I20250625 14:01:55.557601 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_046e760e5933440995f2198870cdbc31" } modify_external_catalogs: true
I20250625 14:01:55.557623 12167 raft_consensus.cc:357] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.557726 12167 raft_consensus.cc:383] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.557760 12167 raft_consensus.cc:738] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.557744 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_046e760e5933440995f2198870cdbc31" } modify_external_catalogs: true
I20250625 14:01:55.557906 12167 consensus_queue.cc:260] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.558279 12167 ts_tablet_manager.cc:1428] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:55.558583 12167 tablet_bootstrap.cc:492] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.558722 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.559670 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 7302430d7e4a4610bfe271c114718d35 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b78fd0d543449bdb2e95fee6a53e93f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.560447 12177 ts_tablet_manager.cc:1918] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.560540 12177 log.cc:1199] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9d8bbe1212a7438f9a06cc1a18c6e40a
I20250625 14:01:55.560787 12177 ts_tablet_manager.cc:1939] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.560837 12167 tablet_bootstrap.cc:654] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.562093 12173 tablet_replica.cc:331] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.562260 12173 raft_consensus.cc:2241] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.562508 12173 raft_consensus.cc:2270] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.563108 12173 ts_tablet_manager.cc:1905] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.564540 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (DEFAULT_TABLE table=default.Table_cf7c90591044422fb0bd51e503ec2b0f [id=db9eb49b2b2d49bb8dc446545f82064b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.564950 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.566229 12173 ts_tablet_manager.cc:1918] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.566411 12173 log.cc:1199] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6b4141fcafbc4a6f96504bf47539b8ae
I20250625 14:01:55.566617 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet ef65dc31dc5843fb9e25275af5935e73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.566730 12173 ts_tablet_manager.cc:1939] T 6b4141fcafbc4a6f96504bf47539b8ae P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.567839 12173 tablet_replica.cc:331] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.568043 12173 raft_consensus.cc:2241] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.568174 12173 raft_consensus.cc:2270] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.568728 12173 ts_tablet_manager.cc:1905] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.570642 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e4a50929a7434ef0bd4f961f077f4ff8" } modify_external_catalogs: true
I20250625 14:01:55.570775 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e4a50929a7434ef0bd4f961f077f4ff8" } modify_external_catalogs: true
I20250625 14:01:55.571208 12173 ts_tablet_manager.cc:1918] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.571386 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ec27a022d9e9492babebf395fc96724d" } modify_external_catalogs: true
I20250625 14:01:55.571486 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ec27a022d9e9492babebf395fc96724d" } modify_external_catalogs: true
I20250625 14:01:55.571656 12238 raft_consensus.cc:2747] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.572290 12177 tablet_replica.cc:331] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.572502 12177 raft_consensus.cc:2241] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.572516 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 21f88f43067643dd80ec8a2f5fb370c1 (DEFAULT_TABLE table=default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.572809 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f88f43067643dd80ec8a2f5fb370c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.573789 12177 raft_consensus.cc:2270] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.573846 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 33790cc725df482e91daceca29c820eb
I20250625 14:01:55.574550 12233 tablet.cc:1722] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:55.574826 12177 ts_tablet_manager.cc:1905] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.577637 12177 ts_tablet_manager.cc:1918] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.577725 12177 log.cc:1199] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/dbdc3547d8de48e8887ffeb5b0f71f82
I20250625 14:01:55.577930 12177 ts_tablet_manager.cc:1939] T dbdc3547d8de48e8887ffeb5b0f71f82 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.578831 12177 tablet_replica.cc:331] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.578981 12177 raft_consensus.cc:2241] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.579097 12177 raft_consensus.cc:2270] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.579056 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e85a2e6d3b004839ba2c86758577dddb" } new_table_name: "default.Table_7854449269c249a3bce7ffeebec57005" modify_external_catalogs: true
I20250625 14:01:55.580037 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9dccf2a8326549a294042b644e384248"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.580452 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9dccf2a8326549a294042b644e384248 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.580699 12173 log.cc:1199] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d2afe02902a54045be3b435ed7585b08
I20250625 14:01:55.580972 12173 ts_tablet_manager.cc:1939] T d2afe02902a54045be3b435ed7585b08 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.581651 12173 tablet_replica.cc:331] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.583936 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 7302430d7e4a4610bfe271c114718d35 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b78fd0d543449bdb2e95fee6a53e93f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.584206 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f40cfb7e1454489f9d01fd220e35b3e6 (table default.Table_cf032fd9d44e45eba5453bab85a976bb [id=f598d49003534886af0cbb8abcb424ae]) successfully deleted
W20250625 14:01:55.584357 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f47cf7e6d24347a88da2ee8fbd6de1b1 already in progress: creating tablet
I20250625 14:01:55.584530 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a22eff28938b419f97ad971c486944ff (table default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]) successfully deleted
I20250625 14:01:55.584730 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6b4141fcafbc4a6f96504bf47539b8ae (table default.Table_154ef6ebeb3243549454095410cf6797 [id=ebec371abf684c79ba15ee71846c47de]) successfully deleted
I20250625 14:01:55.584841 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d2afe02902a54045be3b435ed7585b08 (table default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]) successfully deleted
I20250625 14:01:55.585875 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9d8bbe1212a7438f9a06cc1a18c6e40a (table default.Table_4f90b19d20404564bb50d83322939821 [id=74f13a50680d4455a4fddc3eb7a3b3bd]) successfully deleted
I20250625 14:01:55.572712 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 21f88f43067643dd80ec8a2f5fb370c1 (DEFAULT_TABLE table=default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.586474 12166 tablet_bootstrap.cc:492] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
W20250625 14:01:55.586488 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f47cf7e6d24347a88da2ee8fbd6de1b1 already in progress: creating tablet
I20250625 14:01:55.586580 12166 ts_tablet_manager.cc:1397] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.001s
I20250625 14:01:55.586705 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f88f43067643dd80ec8a2f5fb370c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.587117 12166 raft_consensus.cc:357] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.587251 12166 raft_consensus.cc:383] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.587287 12166 raft_consensus.cc:738] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.587415 12166 consensus_queue.cc:260] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.587728 12166 ts_tablet_manager.cc:1428] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:55.587963 12166 tablet_bootstrap.cc:492] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.589002 12166 tablet_bootstrap.cc:654] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.589850 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 92975891d7b24729b4b5514d8f8aecd8
I20250625 14:01:55.590070 12173 raft_consensus.cc:2241] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.590190 12173 raft_consensus.cc:2270] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.590282 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8feddd83af08466ea11c4a15a08d3c8b
I20250625 14:01:55.591709 12173 ts_tablet_manager.cc:1905] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.583457 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 7302430d7e4a4610bfe271c114718d35 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b78fd0d543449bdb2e95fee6a53e93f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.595661 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet dbdc3547d8de48e8887ffeb5b0f71f82 (table default.Table_768e989533ee4c5a8ad6f761a51c058d [id=1e3e09853928482bae0b4b3d489dea3c]) successfully deleted
I20250625 14:01:55.595847 12430 tablet.cc:1722] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:55.596057 12167 tablet_bootstrap.cc:492] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
W20250625 14:01:55.596135 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1dc443822d504733b5d67e212020df0e consensus state has no leader
I20250625 14:01:55.596151 12167 ts_tablet_manager.cc:1397] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.000s
I20250625 14:01:55.596738 12167 raft_consensus.cc:357] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.596855 12167 raft_consensus.cc:383] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.596895 12167 raft_consensus.cc:738] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.596894 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "599bd5368dfc4ea0bd23ea4f18fe3c60" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.597057 11782 raft_consensus.cc:2391] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:55.597028 12167 consensus_queue.cc:260] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.598423 12172 tablet_bootstrap.cc:492] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.598485 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 with delete_type TABLET_DATA_DELETED (replaced by tablet e3af8a01ca1f49afb8aa1834807abf7e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.598518 12172 ts_tablet_manager.cc:1397] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.157s user 0.000s sys 0.002s
I20250625 14:01:55.598659 12175 tablet_replica.cc:331] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.598788 12175 raft_consensus.cc:2241] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.598898 12175 raft_consensus.cc:2270] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.599238 12172 raft_consensus.cc:357] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.599349 12172 raft_consensus.cc:383] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.599382 12172 raft_consensus.cc:738] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.599514 12172 consensus_queue.cc:260] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.599808 12172 ts_tablet_manager.cc:1428] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.600040 12172 tablet_bootstrap.cc:492] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.601012 12172 tablet_bootstrap.cc:654] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.601313 12175 ts_tablet_manager.cc:1905] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.601613 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 33790cc725df482e91daceca29c820eb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.601951 11756 tablet_service.cc:1468] Processing CreateTablet for tablet d9ed251f36e34e33b35489e9c0c45f9d (DEFAULT_TABLE table=default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.602214 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ed251f36e34e33b35489e9c0c45f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.602393 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 33790cc725df482e91daceca29c820eb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.603710 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 33790cc725df482e91daceca29c820eb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.603768 12175 ts_tablet_manager.cc:1918] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.603822 12175 log.cc:1199] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/68a0cfeac48042bdaea66c3b0e370480
I20250625 14:01:55.604046 12175 ts_tablet_manager.cc:1939] T 68a0cfeac48042bdaea66c3b0e370480 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.604387 12031 tablet_service.cc:1468] Processing CreateTablet for tablet d9ed251f36e34e33b35489e9c0c45f9d (DEFAULT_TABLE table=default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.604610 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.604769 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 with delete_type TABLET_DATA_DELETED (replaced by tablet fc948c61d54a4618856b64a12a32b2c4) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.604823 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b (DEFAULT_TABLE table=default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.605065 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8feddd83af08466ea11c4a15a08d3c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.605213 11901 tablet_service.cc:1468] Processing CreateTablet for tablet d9ed251f36e34e33b35489e9c0c45f9d (DEFAULT_TABLE table=default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.605458 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ed251f36e34e33b35489e9c0c45f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.606711 11993 leader_election.cc:304] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.607142 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 92975891d7b24729b4b5514d8f8aecd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.607429 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 1dc443822d504733b5d67e212020df0e (DEFAULT_TABLE table=default.Table_e85a2e6d3b004839ba2c86758577dddb [id=7e7a74b6fc62426db15b91037d400d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.607672 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc443822d504733b5d67e212020df0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.607703 12668 raft_consensus.cc:3058] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.607795 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9dccf2a8326549a294042b644e384248" } modify_external_catalogs: true
I20250625 14:01:55.607944 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9dccf2a8326549a294042b644e384248" } modify_external_catalogs: true
I20250625 14:01:55.608096 12172 tablet_bootstrap.cc:492] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.608188 12172 ts_tablet_manager.cc:1397] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250625 14:01:55.608672 12172 raft_consensus.cc:357] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.608780 12172 raft_consensus.cc:383] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.608812 12172 raft_consensus.cc:738] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.609027 12172 consensus_queue.cc:260] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.609326 12668 raft_consensus.cc:2747] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.610183 12172 ts_tablet_manager.cc:1428] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:55.610401 12172 tablet_bootstrap.cc:492] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.610513 12167 ts_tablet_manager.cc:1428] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20250625 14:01:55.611232 12167 tablet_bootstrap.cc:492] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.612406 12167 tablet_bootstrap.cc:654] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.612999 12584 tablet.cc:1722] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.613101 12172 tablet_bootstrap.cc:654] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.613052 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9aa153abf09346f4a92998fa6a4c1cb0" } modify_external_catalogs: true
I20250625 14:01:55.613176 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9aa153abf09346f4a92998fa6a4c1cb0" } modify_external_catalogs: true
I20250625 14:01:55.614522 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ed251f36e34e33b35489e9c0c45f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.614537 12233 tablet.cc:1722] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.617077 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 1dc443822d504733b5d67e212020df0e (DEFAULT_TABLE table=default.Table_e85a2e6d3b004839ba2c86758577dddb [id=7e7a74b6fc62426db15b91037d400d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.617110 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f0c5509615cf45339c455e8add91a96f (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]). Expected version 2 got 0
I20250625 14:01:55.617471 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc443822d504733b5d67e212020df0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.619218 11528 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 1c958d5cde7144708a163e346608d156
I20250625 14:01:55.619455 12177 ts_tablet_manager.cc:1905] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.623232 12173 ts_tablet_manager.cc:1918] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.624195 12177 ts_tablet_manager.cc:1918] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.624595 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a3faac0915c648f7add30508a11e4224"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.625075 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3faac0915c648f7add30508a11e4224 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.626829 12177 log.cc:1199] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/144ba67ce1fa419cac46e40ebcc078e6
I20250625 14:01:55.627189 12177 ts_tablet_manager.cc:1939] T 144ba67ce1fa419cac46e40ebcc078e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.627933 12177 tablet_replica.cc:331] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.628371 12173 log.cc:1199] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/ef65dc31dc5843fb9e25275af5935e73
I20250625 14:01:55.628795 12177 raft_consensus.cc:2241] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.629453 12173 ts_tablet_manager.cc:1939] T ef65dc31dc5843fb9e25275af5935e73 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.629563 12177 raft_consensus.cc:2270] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.630208 12167 tablet_bootstrap.cc:492] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.630340 12167 ts_tablet_manager.cc:1397] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20250625 14:01:55.630847 12167 raft_consensus.cc:357] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.630970 12167 raft_consensus.cc:383] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.631004 12167 raft_consensus.cc:738] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.631125 12167 consensus_queue.cc:260] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.631383 12167 ts_tablet_manager.cc:1428] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.632699 12167 tablet_bootstrap.cc:492] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.633836 12167 tablet_bootstrap.cc:654] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.634008 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 704ecf1ea8dd423ead2a0d1be113c03d from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.635519 12177 ts_tablet_manager.cc:1905] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.637535 12180 raft_consensus.cc:491] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.637626 12180 raft_consensus.cc:513] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.637971 12180 leader_election.cc:290] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.642012 12172 tablet_bootstrap.cc:492] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.642127 12172 ts_tablet_manager.cc:1397] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:01:55.642926 12172 raft_consensus.cc:357] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.643045 12172 raft_consensus.cc:383] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.643077 12172 raft_consensus.cc:738] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.643196 12172 consensus_queue.cc:260] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.643476 12172 ts_tablet_manager.cc:1428] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.643658 12172 tablet_bootstrap.cc:492] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.607348 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 1dc443822d504733b5d67e212020df0e (DEFAULT_TABLE table=default.Table_e85a2e6d3b004839ba2c86758577dddb [id=7e7a74b6fc62426db15b91037d400d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.610023 12175 tablet_replica.cc:331] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.644454 12175 raft_consensus.cc:2241] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.644575 12175 raft_consensus.cc:2270] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.644804 12172 tablet_bootstrap.cc:654] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.645172 12175 ts_tablet_manager.cc:1905] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.612051 12430 tablet.cc:1722] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.614063 12166 tablet_bootstrap.cc:492] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.646489 12166 ts_tablet_manager.cc:1397] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.001s
I20250625 14:01:55.646520 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc443822d504733b5d67e212020df0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.646950 12166 raft_consensus.cc:357] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.647045 12166 raft_consensus.cc:383] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.647073 12166 raft_consensus.cc:738] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.647212 12166 consensus_queue.cc:260] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.647506 12166 ts_tablet_manager.cc:1428] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.621651 12600 raft_consensus.cc:491] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.647701 12175 ts_tablet_manager.cc:1918] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.647694 12600 raft_consensus.cc:513] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.639004 12558 consensus_queue.cc:1035] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20250625 14:01:55.648145 12600 leader_election.cc:290] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.648334 12167 tablet_bootstrap.cc:492] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.648418 12167 ts_tablet_manager.cc:1397] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:55.648600 12175 log.cc:1199] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9da1d3ee457944399e60e0c5bdd8c428
I20250625 14:01:55.648864 12175 ts_tablet_manager.cc:1939] T 9da1d3ee457944399e60e0c5bdd8c428 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.648931 12167 raft_consensus.cc:357] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.649041 12167 raft_consensus.cc:383] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.649073 12167 raft_consensus.cc:738] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.649197 12167 consensus_queue.cc:260] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.649174 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b (DEFAULT_TABLE table=default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.649551 12167 ts_tablet_manager.cc:1428] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.649766 12167 tablet_bootstrap.cc:492] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.650418 12166 tablet_bootstrap.cc:492] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.651083 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92984f3be8454a969b7c39af97a11479" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:55.651646 11855 leader_election.cc:343] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.651834 12166 tablet_bootstrap.cc:654] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.652002 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92984f3be8454a969b7c39af97a11479" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.652144 11784 raft_consensus.cc:2466] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:55.653206 11858 leader_election.cc:304] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.653584 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8feddd83af08466ea11c4a15a08d3c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.656100 12600 raft_consensus.cc:2802] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.656189 12600 raft_consensus.cc:491] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.656236 12600 raft_consensus.cc:3058] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.657298 12600 raft_consensus.cc:513] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.657646 12600 leader_election.cc:290] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.657948 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5872bfb53bd04ac79d02f8d87a4ea090
I20250625 14:01:55.658123 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92984f3be8454a969b7c39af97a11479" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:55.658541 11855 leader_election.cc:343] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.658737 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92984f3be8454a969b7c39af97a11479" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:55.658854 11784 raft_consensus.cc:3058] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.659909 11784 raft_consensus.cc:2466] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:55.661245 11858 leader_election.cc:304] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.663250 12167 tablet_bootstrap.cc:654] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.664312 12600 raft_consensus.cc:2802] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.664420 12600 raft_consensus.cc:695] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:55.664558 12600 consensus_queue.cc:237] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.665284 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b (DEFAULT_TABLE table=default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.665572 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8feddd83af08466ea11c4a15a08d3c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.666764 12166 tablet_bootstrap.cc:492] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.666851 12166 ts_tablet_manager.cc:1397] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250625 14:01:55.667357 12166 raft_consensus.cc:357] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.667460 12166 raft_consensus.cc:383] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.667490 12166 raft_consensus.cc:738] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.667618 12166 consensus_queue.cc:260] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.667954 12166 ts_tablet_manager.cc:1428] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.668097 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 92975891d7b24729b4b5514d8f8aecd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.668159 12166 tablet_bootstrap.cc:492] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.668275 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 92984f3be8454a969b7c39af97a11479 with delete_type TABLET_DATA_DELETED (replaced by tablet 5227c93e932a4ed4b3d03990d7ed7b69) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.668605 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 92975891d7b24729b4b5514d8f8aecd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.669250 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.670001 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.670627 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 144ba67ce1fa419cac46e40ebcc078e6 (table default.Table_04bedd118b064b669bbd67a9e6017fba [id=1513365deec7433d8564e56a0dca7154]) successfully deleted
I20250625 14:01:55.671888 12175 tablet_replica.cc:331] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.672041 12175 raft_consensus.cc:2241] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.670526 12177 ts_tablet_manager.cc:1918] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.672137 12177 log.cc:1199] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/92975891d7b24729b4b5514d8f8aecd8
I20250625 14:01:55.672206 12175 pending_rounds.cc:70] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:55.672237 12175 pending_rounds.cc:77] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523033763889152 op_type: NO_OP noop_request { }
I20250625 14:01:55.672297 12175 raft_consensus.cc:2887] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:55.672348 12175 raft_consensus.cc:2270] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.672480 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet cb7bbd1c627f4da6b2e1812eed472c83 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.672717 12177 ts_tablet_manager.cc:1939] T 92975891d7b24729b4b5514d8f8aecd8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.673823 12166 tablet_bootstrap.cc:654] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.674844 12172 tablet_bootstrap.cc:492] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.674849 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_82021dac408c42e9898349055acf8936 [id=8cc7744ad13545cba212ea3affd17d9d] alter complete (version 1)
I20250625 14:01:55.674937 12172 ts_tablet_manager.cc:1397] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:01:55.675402 12172 raft_consensus.cc:357] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.675503 12172 raft_consensus.cc:383] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.675530 12172 raft_consensus.cc:738] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
W20250625 14:01:55.675550 12733 consensus_queue.cc:1162] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfff52620fea460d850827814b790c35" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:01:55.675644 12172 consensus_queue.cc:260] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.675910 12172 ts_tablet_manager.cc:1428] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.676083 12172 tablet_bootstrap.cc:492] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.676272 12167 tablet_bootstrap.cc:492] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.676369 12167 ts_tablet_manager.cc:1397] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.000s
I20250625 14:01:55.677037 12172 tablet_bootstrap.cc:654] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.676995 12167 raft_consensus.cc:357] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.677117 12167 raft_consensus.cc:383] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.677156 12167 raft_consensus.cc:738] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.677309 12167 consensus_queue.cc:260] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.677588 12167 ts_tablet_manager.cc:1428] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.677825 12167 tablet_bootstrap.cc:492] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.678854 12167 tablet_bootstrap.cc:654] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.678890 12172 tablet_bootstrap.cc:492] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.678977 12172 ts_tablet_manager.cc:1397] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:55.679420 12172 raft_consensus.cc:357] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.679523 12172 raft_consensus.cc:383] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.679555 12172 raft_consensus.cc:738] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.679654 12172 consensus_queue.cc:260] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.680140 12175 ts_tablet_manager.cc:1905] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.680174 12172 ts_tablet_manager.cc:1428] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.680353 12172 tablet_bootstrap.cc:492] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.681380 12172 tablet_bootstrap.cc:654] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.682487 12166 tablet_bootstrap.cc:492] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.682576 12166 ts_tablet_manager.cc:1397] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20250625 14:01:55.683051 12166 raft_consensus.cc:357] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.683176 12166 raft_consensus.cc:383] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.683208 12166 raft_consensus.cc:738] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.683322 12166 consensus_queue.cc:260] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.683599 12166 ts_tablet_manager.cc:1428] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:55.683779 12166 tablet_bootstrap.cc:492] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.684118 12175 ts_tablet_manager.cc:1918] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.684284 12175 log.cc:1199] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/92984f3be8454a969b7c39af97a11479
I20250625 14:01:55.684618 12175 ts_tablet_manager.cc:1939] T 92984f3be8454a969b7c39af97a11479 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.684804 12166 tablet_bootstrap.cc:654] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.685674 12167 tablet_bootstrap.cc:492] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.685777 12167 ts_tablet_manager.cc:1397] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:55.686285 12167 raft_consensus.cc:357] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.686446 12167 raft_consensus.cc:383] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.686478 12167 raft_consensus.cc:738] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.686615 12265 consensus_queue.cc:1035] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.687126 12175 tablet_replica.cc:331] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.687290 12175 raft_consensus.cc:2241] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.687393 12175 raft_consensus.cc:2270] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.687754 12175 ts_tablet_manager.cc:1905] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.690151 12175 ts_tablet_manager.cc:1918] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.690244 12175 log.cc:1199] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/92975891d7b24729b4b5514d8f8aecd8
I20250625 14:01:55.690501 12175 ts_tablet_manager.cc:1939] T 92975891d7b24729b4b5514d8f8aecd8 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.690521 12166 tablet_bootstrap.cc:492] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.690600 12166 ts_tablet_manager.cc:1397] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20250625 14:01:55.691040 12166 raft_consensus.cc:357] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.691144 12166 raft_consensus.cc:383] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.691172 12166 raft_consensus.cc:738] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.691162 12167 consensus_queue.cc:260] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.691286 12166 consensus_queue.cc:260] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.691535 12166 ts_tablet_manager.cc:1428] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.692204 12166 tablet_bootstrap.cc:492] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.692236 12167 ts_tablet_manager.cc:1428] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20250625 14:01:55.692509 12167 tablet_bootstrap.cc:492] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.693614 12167 tablet_bootstrap.cc:654] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.693897 12166 tablet_bootstrap.cc:654] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.695942 12167 tablet_bootstrap.cc:492] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.696053 12167 ts_tablet_manager.cc:1397] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:01:55.696552 12167 raft_consensus.cc:357] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.696655 12167 raft_consensus.cc:383] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.696684 12167 raft_consensus.cc:738] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.696815 12167 consensus_queue.cc:260] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.697013 12172 tablet_bootstrap.cc:492] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.697077 12167 ts_tablet_manager.cc:1428] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.697100 12172 ts_tablet_manager.cc:1397] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20250625 14:01:55.697260 12167 tablet_bootstrap.cc:492] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.697561 12172 raft_consensus.cc:357] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.697662 12172 raft_consensus.cc:383] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.697692 12172 raft_consensus.cc:738] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.697803 12172 consensus_queue.cc:260] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.698069 12172 ts_tablet_manager.cc:1428] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.698236 12172 tablet_bootstrap.cc:492] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.699173 12172 tablet_bootstrap.cc:654] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.698272 12167 tablet_bootstrap.cc:654] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.701939 12166 tablet_bootstrap.cc:492] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.702052 12166 ts_tablet_manager.cc:1397] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20250625 14:01:55.702553 12166 raft_consensus.cc:357] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.702658 12166 raft_consensus.cc:383] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.702693 12166 raft_consensus.cc:738] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.702816 12166 consensus_queue.cc:260] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.703907 12166 ts_tablet_manager.cc:1428] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20250625 14:01:55.704166 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7302430d7e4a4610bfe271c114718d35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7302430d7e4a4610bfe271c114718d35 already in progress: creating tablet
W20250625 14:01:55.704357 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 33790cc725df482e91daceca29c820eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33790cc725df482e91daceca29c820eb already in progress: creating tablet
W20250625 14:01:55.704514 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8feddd83af08466ea11c4a15a08d3c8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8feddd83af08466ea11c4a15a08d3c8b already in progress: creating tablet
I20250625 14:01:55.704501 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39ff4b0e7ac74ec294550775aaa44468" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:55.704612 11920 raft_consensus.cc:2466] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:55.704785 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 58eacad688d747118971f4c4ad163871 (DEFAULT_TABLE table=default.Table_ac11fbf6c80047a78d8983642c8746dc [id=96c998c0c13e49aeaa4b3fff136f2e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.704846 11761 tablet_service.cc:1468] Processing CreateTablet for tablet ff4973a4d8ec46c7aa640fcaf40b5c87 (DEFAULT_TABLE table=default.Table_28a04ff7c30341e4a4be38f90d04c527 [id=f3860c2db83d4b749f36457eccc92d57]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:55.705052 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7302430d7e4a4610bfe271c114718d35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7302430d7e4a4610bfe271c114718d35 already in progress: creating tablet
I20250625 14:01:55.705103 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58eacad688d747118971f4c4ad163871. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.704852 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f (DEFAULT_TABLE table=default.Table_3d82e197e7174db08e444c89b45c77be [id=1cf0251105444beca355668b5a0da27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.705168 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 68a0cfeac48042bdaea66c3b0e370480 (table default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
I20250625 14:01:55.705282 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78fd0d543449bdb2e95fee6a53e93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.705248 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 6a483b01a74c424db2a10c3215783411 (DEFAULT_TABLE table=default.Table_71763ac380284b57b2934b0ef542d711 [id=73b6c64b51d344b89b94deab58c14218]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:55.705348 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 33790cc725df482e91daceca29c820eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33790cc725df482e91daceca29c820eb already in progress: creating tablet
I20250625 14:01:55.705425 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a483b01a74c424db2a10c3215783411. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.705484 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9da1d3ee457944399e60e0c5bdd8c428 (table default.Table_1809d17fc2ca4fc294f2c0b3cbec2866 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
I20250625 14:01:55.706506 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 (DEFAULT_TABLE table=default.Table_ba88e68554e349be85cfbc86283df3e7 [id=86457396dd0e41c59a0e4b3805825778]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.706733 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0752a7f1371e42d68d83afe41d2f1da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.708227 12172 tablet_bootstrap.cc:492] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.708317 12172 ts_tablet_manager.cc:1397] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:55.708710 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.708799 12172 raft_consensus.cc:357] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.708913 12172 raft_consensus.cc:383] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.708948 12172 raft_consensus.cc:738] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.709090 12172 consensus_queue.cc:260] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.709396 12172 ts_tablet_manager.cc:1428] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.709559 12172 tablet_bootstrap.cc:492] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.710420 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 92984f3be8454a969b7c39af97a11479 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]) successfully deleted
I20250625 14:01:55.710464 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39ff4b0e7ac74ec294550775aaa44468" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.710559 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 92975891d7b24729b4b5514d8f8aecd8 (table default.Table_e4a50929a7434ef0bd4f961f077f4ff8 [id=cd58fd19f8994edf8a5854d80684e399]) successfully deleted
I20250625 14:01:55.710614 12056 raft_consensus.cc:2466] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:55.710668 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8feddd83af08466ea11c4a15a08d3c8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8feddd83af08466ea11c4a15a08d3c8b already in progress: creating tablet
I20250625 14:01:55.711081 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet ef65dc31dc5843fb9e25275af5935e73 (table default.Table_6cd4de10d95046caa0f949f76701914f [id=8c20cc15d9c4490bb66991db4a7eea38]) successfully deleted
I20250625 14:01:55.711481 12172 tablet_bootstrap.cc:654] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.711485 11759 tablet_service.cc:1468] Processing CreateTablet for tablet edfce8c80bb341a48fb1b59def057571 (DEFAULT_TABLE table=default.Table_4388cbd6078f4906b12285dbc0e7189a [id=2883f9d8cb1d40b19d6efe5c5f871a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.711562 11755 tablet_service.cc:1468] Processing CreateTablet for tablet e9c835f1c3dc47c09fcd413793c7b468 (DEFAULT_TABLE table=default.Table_fe87d71898b848e49fed4a97af4cefa9 [id=b434548c0974419586018378be509878]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.711774 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfce8c80bb341a48fb1b59def057571. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.713464 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4973a4d8ec46c7aa640fcaf40b5c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.714022 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet cb7bbd1c627f4da6b2e1812eed472c83
I20250625 14:01:55.715076 11528 catalog_manager.cc:6652] ReplaceTablet: tablet cb7bbd1c627f4da6b2e1812eed472c83 deleted and replaced by tablet 94232e8e88e84350b5f150a6eb433c92
I20250625 14:01:55.715811 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c835f1c3dc47c09fcd413793c7b468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.715636 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 92975891d7b24729b4b5514d8f8aecd8 (table default.Table_e4a50929a7434ef0bd4f961f077f4ff8 [id=cd58fd19f8994edf8a5854d80684e399]) successfully deleted
W20250625 14:01:55.716646 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 5872bfb53bd04ac79d02f8d87a4ea090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5872bfb53bd04ac79d02f8d87a4ea090 already in progress: creating tablet
I20250625 14:01:55.717343 11717 leader_election.cc:304] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:55.717535 12208 raft_consensus.cc:2802] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.717608 12208 raft_consensus.cc:491] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.717655 12208 raft_consensus.cc:3058] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:55.711200 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7302430d7e4a4610bfe271c114718d35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7302430d7e4a4610bfe271c114718d35 already in progress: creating tablet
W20250625 14:01:55.718150 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 33790cc725df482e91daceca29c820eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33790cc725df482e91daceca29c820eb already in progress: creating tablet
W20250625 14:01:55.718442 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 92975891d7b24729b4b5514d8f8aecd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92975891d7b24729b4b5514d8f8aecd8 already in progress: creating tablet
W20250625 14:01:55.718570 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8feddd83af08466ea11c4a15a08d3c8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8feddd83af08466ea11c4a15a08d3c8b already in progress: creating tablet
I20250625 14:01:55.718545 12208 raft_consensus.cc:513] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.718593 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_86978c9f798f4082adf63c1c04b549a6" } new_table_name: "default.Table_0484c8fc78484d04841a05f84b8d7dfe" modify_external_catalogs: true
I20250625 14:01:55.718891 12208 leader_election.cc:290] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.719297 12031 tablet_service.cc:1468] Processing CreateTablet for tablet ff4973a4d8ec46c7aa640fcaf40b5c87 (DEFAULT_TABLE table=default.Table_28a04ff7c30341e4a4be38f90d04c527 [id=f3860c2db83d4b749f36457eccc92d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.719599 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4973a4d8ec46c7aa640fcaf40b5c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.704121 12166 tablet_bootstrap.cc:492] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.721055 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet cb7bbd1c627f4da6b2e1812eed472c83 with delete_type TABLET_DATA_DELETED (replaced by tablet 94232e8e88e84350b5f150a6eb433c92) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.721244 12177 tablet_replica.cc:331] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.721395 12177 raft_consensus.cc:2241] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.721603 12177 raft_consensus.cc:2270] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.721993 12177 ts_tablet_manager.cc:1905] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.722136 11897 tablet_service.cc:1468] Processing CreateTablet for tablet ff4973a4d8ec46c7aa640fcaf40b5c87 (DEFAULT_TABLE table=default.Table_28a04ff7c30341e4a4be38f90d04c527 [id=f3860c2db83d4b749f36457eccc92d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.722353 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39ff4b0e7ac74ec294550775aaa44468" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:55.722486 12056 raft_consensus.cc:3058] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.724521 12167 tablet_bootstrap.cc:492] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.724628 12167 ts_tablet_manager.cc:1397] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:01:55.725277 12167 raft_consensus.cc:357] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.725416 12167 raft_consensus.cc:383] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.725455 12167 raft_consensus.cc:738] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.725534 12177 ts_tablet_manager.cc:1918] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.725612 12177 log.cc:1199] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/cb7bbd1c627f4da6b2e1812eed472c83
I20250625 14:01:55.725591 12167 consensus_queue.cc:260] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.725867 12177 ts_tablet_manager.cc:1939] T cb7bbd1c627f4da6b2e1812eed472c83 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.725937 12167 ts_tablet_manager.cc:1428] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.726032 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet bfdb34255cb147c48a322514b7a7a19d from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.726143 12167 tablet_bootstrap.cc:492] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.727398 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "39ff4b0e7ac74ec294550775aaa44468" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:55.727533 11920 raft_consensus.cc:3058] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.727646 12167 tablet_bootstrap.cc:654] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.727674 12056 raft_consensus.cc:2466] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:55.728135 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 6a483b01a74c424db2a10c3215783411 (DEFAULT_TABLE table=default.Table_71763ac380284b57b2934b0ef542d711 [id=73b6c64b51d344b89b94deab58c14218]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.728407 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a483b01a74c424db2a10c3215783411. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.728631 11920 raft_consensus.cc:2466] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:55.729022 12166 tablet_bootstrap.cc:654] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.729383 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4973a4d8ec46c7aa640fcaf40b5c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.730391 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d6499e060ded4ec98aac7fd0f4476b1d" } new_table_name: "default.Table_0764c545c28d4a3c82093556ae3f970b" modify_external_catalogs: true
I20250625 14:01:55.730829 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fde1c3b5b39545068fc40abb87f0c6cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.731200 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fde1c3b5b39545068fc40abb87f0c6cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.731252 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8e7e773b96234beabd12191f60e2c981"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.731570 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e7e773b96234beabd12191f60e2c981 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.732095 11717 leader_election.cc:304] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:55.732489 12172 tablet_bootstrap.cc:492] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.732578 12172 ts_tablet_manager.cc:1397] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:55.732805 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]) successfully deleted
I20250625 14:01:55.733076 12172 raft_consensus.cc:357] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.733201 12172 raft_consensus.cc:383] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.733237 12172 raft_consensus.cc:738] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.733354 12172 consensus_queue.cc:260] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.733639 12172 ts_tablet_manager.cc:1428] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.733821 12172 tablet_bootstrap.cc:492] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.733948 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 6a483b01a74c424db2a10c3215783411 (DEFAULT_TABLE table=default.Table_71763ac380284b57b2934b0ef542d711 [id=73b6c64b51d344b89b94deab58c14218]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.734252 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a483b01a74c424db2a10c3215783411. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.734848 12172 tablet_bootstrap.cc:654] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.734871 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c474af1901c74e6895c3a08f1cc7c65c consensus state has no leader
I20250625 14:01:55.736343 12166 tablet_bootstrap.cc:492] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.736428 12166 ts_tablet_manager.cc:1397] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:01:55.736830 12180 raft_consensus.cc:2802] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.736925 12180 raft_consensus.cc:695] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:55.737061 12180 consensus_queue.cc:237] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.737346 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 58eacad688d747118971f4c4ad163871 (DEFAULT_TABLE table=default.Table_ac11fbf6c80047a78d8983642c8746dc [id=96c998c0c13e49aeaa4b3fff136f2e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.737627 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58eacad688d747118971f4c4ad163871. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.737747 12166 raft_consensus.cc:357] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.738158 12166 raft_consensus.cc:383] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.738216 12166 raft_consensus.cc:738] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.738396 12166 consensus_queue.cc:260] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.740759 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 58eacad688d747118971f4c4ad163871 (DEFAULT_TABLE table=default.Table_ac11fbf6c80047a78d8983642c8746dc [id=96c998c0c13e49aeaa4b3fff136f2e27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.740833 12166 ts_tablet_manager.cc:1428] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250625 14:01:55.740849 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_55126bbe64de49bb88e911c8dfa1d9b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.741044 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58eacad688d747118971f4c4ad163871. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.741076 12166 tablet_bootstrap.cc:492] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:55.741253 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55126bbe64de49bb88e911c8dfa1d9b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.742185 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6a195a661111421cb38dde060c6dcd15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.742298 12166 tablet_bootstrap.cc:654] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.742573 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a195a661111421cb38dde060c6dcd15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.743281 12167 tablet_bootstrap.cc:492] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.743362 12167 ts_tablet_manager.cc:1397] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:55.743607 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3d175d63c3ce4d41bb70f00eb7d2cf4d" } new_table_name: "default.Table_5e16a14357604387a772903ca4fa36de" modify_external_catalogs: true
I20250625 14:01:55.743842 12167 raft_consensus.cc:357] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.743952 12167 raft_consensus.cc:383] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.743980 12167 raft_consensus.cc:738] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.744100 12167 consensus_queue.cc:260] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.744364 12167 ts_tablet_manager.cc:1428] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.744554 12167 tablet_bootstrap.cc:492] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.744796 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a0f263c69bb2468ea1f6817dc4f3828e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.745115 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0f263c69bb2468ea1f6817dc4f3828e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.745494 12167 tablet_bootstrap.cc:654] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.746109 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 (DEFAULT_TABLE table=default.Table_ba88e68554e349be85cfbc86283df3e7 [id=86457396dd0e41c59a0e4b3805825778]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.746408 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0752a7f1371e42d68d83afe41d2f1da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.746748 12172 tablet_bootstrap.cc:492] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.746832 12172 ts_tablet_manager.cc:1397] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:01:55.747273 12172 raft_consensus.cc:357] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.747366 12172 raft_consensus.cc:383] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.747395 12172 raft_consensus.cc:738] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.747501 12172 consensus_queue.cc:260] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.747746 12172 ts_tablet_manager.cc:1428] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.747916 12172 tablet_bootstrap.cc:492] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.748849 12172 tablet_bootstrap.cc:654] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.749125 12666 raft_consensus.cc:491] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.749214 12666 raft_consensus.cc:513] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.749635 12666 leader_election.cc:290] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:55.750295 11990 leader_election.cc:343] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: bc92f5f36ae94fe09b6017efc6ebbcaf
I20250625 14:01:55.751564 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 (DEFAULT_TABLE table=default.Table_ba88e68554e349be85cfbc86283df3e7 [id=86457396dd0e41c59a0e4b3805825778]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.752101 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0752a7f1371e42d68d83afe41d2f1da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.754833 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.760876 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b856c2faaa1542d6baf838480fb906c7" } new_table_name: "default.Table_2928b645415547419a21192f44ad81ab" modify_external_catalogs: true
I20250625 14:01:55.761533 12166 tablet_bootstrap.cc:492] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.761617 12166 ts_tablet_manager.cc:1397] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20250625 14:01:55.761871 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_57f7d205bb304fd8982fcd30bb558c54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.762125 12166 raft_consensus.cc:357] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.762243 12166 raft_consensus.cc:383] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.762274 12166 raft_consensus.cc:738] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:55.762300 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57f7d205bb304fd8982fcd30bb558c54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.762428 12166 consensus_queue.cc:260] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.762737 12166 ts_tablet_manager.cc:1428] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.762995 12166 tablet_bootstrap.cc:492] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.763887 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a34ff03966644dd1bae2a02ecffbae31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.764034 12166 tablet_bootstrap.cc:654] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.764293 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a34ff03966644dd1bae2a02ecffbae31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.764465 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f (DEFAULT_TABLE table=default.Table_3d82e197e7174db08e444c89b45c77be [id=1cf0251105444beca355668b5a0da27b]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:55.764793 11993 leader_election.cc:343] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: bc92f5f36ae94fe09b6017efc6ebbcaf
I20250625 14:01:55.764895 11993 leader_election.cc:304] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.765065 12666 raft_consensus.cc:2747] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.765308 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8ac0c0afb60d4d058ddbd40f5227cce0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.765539 12172 tablet_bootstrap.cc:492] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.765625 12172 ts_tablet_manager.cc:1397] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
W20250625 14:01:55.765648 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.765769 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f (DEFAULT_TABLE table=default.Table_3d82e197e7174db08e444c89b45c77be [id=1cf0251105444beca355668b5a0da27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.766191 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78fd0d543449bdb2e95fee6a53e93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.766093 12172 raft_consensus.cc:357] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.766567 12172 raft_consensus.cc:383] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.766610 12172 raft_consensus.cc:738] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.766793 12172 consensus_queue.cc:260] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.767078 12172 ts_tablet_manager.cc:1428] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:55.768500 12172 tablet_bootstrap.cc:492] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.770069 12166 tablet_bootstrap.cc:492] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.770174 12166 ts_tablet_manager.cc:1397] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:55.770607 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78fd0d543449bdb2e95fee6a53e93f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.770678 12166 raft_consensus.cc:357] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.770807 12166 raft_consensus.cc:383] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.770849 12166 raft_consensus.cc:738] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.771023 12166 consensus_queue.cc:260] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.771416 12166 ts_tablet_manager.cc:1428] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:55.771605 12166 tablet_bootstrap.cc:492] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.772356 12172 tablet_bootstrap.cc:654] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.774276 12030 tablet_service.cc:1468] Processing CreateTablet for tablet e9c835f1c3dc47c09fcd413793c7b468 (DEFAULT_TABLE table=default.Table_fe87d71898b848e49fed4a97af4cefa9 [id=b434548c0974419586018378be509878]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.774659 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c835f1c3dc47c09fcd413793c7b468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.775051 12166 tablet_bootstrap.cc:654] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.776389 12265 raft_consensus.cc:491] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.776475 12265 raft_consensus.cc:513] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.776772 12265 leader_election.cc:290] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.777154 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7f797fe89204fa18340bfb43ab36cbf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:55.777539 11858 leader_election.cc:343] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.777837 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7f797fe89204fa18340bfb43ab36cbf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.778076 12265 raft_consensus.cc:491] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.778157 12265 raft_consensus.cc:513] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:55.778210 11855 leader_election.cc:343] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.778290 11855 leader_election.cc:304] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.778530 12600 raft_consensus.cc:2747] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.778568 12265 leader_election.cc:290] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.778848 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbd18834c5594897a2b16c7069a90c18" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.778918 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbd18834c5594897a2b16c7069a90c18" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.779057 11782 raft_consensus.cc:2466] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
W20250625 14:01:55.779309 11855 leader_election.cc:343] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.779455 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.779471 11858 leader_election.cc:304] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.779670 12265 raft_consensus.cc:2802] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.779712 12265 raft_consensus.cc:491] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.779744 12265 raft_consensus.cc:3058] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.779287 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 205f83a0ffbc440492e241a75657f1b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.780339 12175 tablet_replica.cc:331] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.780493 12175 raft_consensus.cc:2241] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.780596 12175 raft_consensus.cc:2270] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.780709 11897 tablet_service.cc:1468] Processing CreateTablet for tablet e9c835f1c3dc47c09fcd413793c7b468 (DEFAULT_TABLE table=default.Table_fe87d71898b848e49fed4a97af4cefa9 [id=b434548c0974419586018378be509878]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.780786 12265 raft_consensus.cc:513] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.780995 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c835f1c3dc47c09fcd413793c7b468. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.781108 12030 tablet_service.cc:1468] Processing CreateTablet for tablet edfce8c80bb341a48fb1b59def057571 (DEFAULT_TABLE table=default.Table_4388cbd6078f4906b12285dbc0e7189a [id=2883f9d8cb1d40b19d6efe5c5f871a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.781172 12265 leader_election.cc:290] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.781370 12666 raft_consensus.cc:491] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.781800 12175 ts_tablet_manager.cc:1905] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.781878 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbd18834c5594897a2b16c7069a90c18" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:55.782004 11782 raft_consensus.cc:3058] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.782963 11782 raft_consensus.cc:2466] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:55.783281 11858 leader_election.cc:304] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:55.783528 12265 raft_consensus.cc:2802] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.783597 12265 raft_consensus.cc:695] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:55.783717 12265 consensus_queue.cc:237] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.784060 12175 ts_tablet_manager.cc:1918] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.784126 12175 log.cc:1199] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/205f83a0ffbc440492e241a75657f1b8
I20250625 14:01:55.784337 12175 ts_tablet_manager.cc:1939] T 205f83a0ffbc440492e241a75657f1b8 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.784703 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbd18834c5594897a2b16c7069a90c18" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:55.781447 12666 raft_consensus.cc:513] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.785370 12666 leader_election.cc:290] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.785658 12166 tablet_bootstrap.cc:492] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.785742 12166 ts_tablet_manager.cc:1397] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:01:55.786202 12166 raft_consensus.cc:357] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.786343 12166 raft_consensus.cc:383] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.786375 12166 raft_consensus.cc:738] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:55.786397 11990 leader_election.cc:343] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 22cfc7f3b1564e4f91114cd5e049da0d
I20250625 14:01:55.786492 12166 consensus_queue.cc:260] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:55.786738 11855 leader_election.cc:343] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.786773 12166 ts_tablet_manager.cc:1428] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.786954 12166 tablet_bootstrap.cc:492] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.786955 12172 tablet_bootstrap.cc:492] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.787050 12172 ts_tablet_manager.cc:1397] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:01:55.781436 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfce8c80bb341a48fb1b59def057571. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.787519 12172 raft_consensus.cc:357] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.787621 12172 raft_consensus.cc:383] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.787652 12172 raft_consensus.cc:738] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.787776 12172 consensus_queue.cc:260] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.787917 12166 tablet_bootstrap.cc:654] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.788143 12172 ts_tablet_manager.cc:1428] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.789742 12057 raft_consensus.cc:3058] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.789762 12666 raft_consensus.cc:491] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.789880 12666 raft_consensus.cc:513] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.790350 12666 leader_election.cc:290] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.790692 12666 raft_consensus.cc:491] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.790768 12666 raft_consensus.cc:513] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.791121 12666 leader_election.cc:290] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.791211 12172 tablet_bootstrap.cc:492] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.791862 12584 tablet.cc:1722] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250625 14:01:55.794500 11990 leader_election.cc:343] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 92975891d7b24729b4b5514d8f8aecd8
W20250625 14:01:55.794641 11990 leader_election.cc:343] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 25160014ecf74c2ab6f1faca42d30c47
I20250625 14:01:55.795377 12172 tablet_bootstrap.cc:654] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.795647 12265 raft_consensus.cc:491] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.795753 12265 raft_consensus.cc:513] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.796118 12265 leader_election.cc:290] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.796821 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a2fd4408e4f4f06b5a1bc686402ee40" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.796948 11782 raft_consensus.cc:2466] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:55.797240 11858 leader_election.cc:304] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:55.797657 12265 raft_consensus.cc:2802] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.797711 12265 raft_consensus.cc:491] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.797746 12265 raft_consensus.cc:3058] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.798574 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a2fd4408e4f4f06b5a1bc686402ee40" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.799012 12265 raft_consensus.cc:513] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.799659 12265 leader_election.cc:290] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.799876 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a2fd4408e4f4f06b5a1bc686402ee40" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:55.800004 11782 raft_consensus.cc:3058] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.800418 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet e307709d217643358c7c3efb3dd73747 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.800465 12167 tablet_bootstrap.cc:492] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.800544 12167 ts_tablet_manager.cc:1397] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.000s
W20250625 14:01:55.800756 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21f88f43067643dd80ec8a2f5fb370c1 consensus state has no leader
I20250625 14:01:55.800941 11782 raft_consensus.cc:2466] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:55.801023 12167 raft_consensus.cc:357] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.801129 12167 raft_consensus.cc:383] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.801159 12167 raft_consensus.cc:738] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.801285 12167 consensus_queue.cc:260] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.801612 12167 ts_tablet_manager.cc:1428] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.801656 11858 leader_election.cc:304] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:55.801834 12167 tablet_bootstrap.cc:492] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:55.802137 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c825977e422407486587f28af36bd68 consensus state has no leader
I20250625 14:01:55.802546 12265 raft_consensus.cc:2802] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.802846 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a2fd4408e4f4f06b5a1bc686402ee40" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:55.802901 12265 raft_consensus.cc:695] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:55.803061 12265 consensus_queue.cc:237] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.803134 12167 tablet_bootstrap.cc:654] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.804651 11993 leader_election.cc:343] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 22cfc7f3b1564e4f91114cd5e049da0d
I20250625 14:01:55.804735 11993 leader_election.cc:304] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.804872 12666 raft_consensus.cc:2747] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:55.805200 11855 leader_election.cc:343] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:55.805404 11855 leader_election.cc:343] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.807055 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e4729036527243a1b64bf5c9b7a4a5e1" } modify_external_catalogs: true
I20250625 14:01:55.807176 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e4729036527243a1b64bf5c9b7a4a5e1" } modify_external_catalogs: true
W20250625 14:01:55.807915 11993 leader_election.cc:343] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 25160014ecf74c2ab6f1faca42d30c47
I20250625 14:01:55.807996 11993 leader_election.cc:304] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:01:55.808269 11993 leader_election.cc:343] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 92975891d7b24729b4b5514d8f8aecd8
I20250625 14:01:55.808321 11993 leader_election.cc:304] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.808434 12668 raft_consensus.cc:2747] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.808523 12668 raft_consensus.cc:2747] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.809451 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_66c17881414348d49722f825bff86a90" } modify_external_catalogs: true
I20250625 14:01:55.809564 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_66c17881414348d49722f825bff86a90" } modify_external_catalogs: true
I20250625 14:01:55.810478 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_96e5e7713c4240a1b08902ceffb2a2e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.810940 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96e5e7713c4240a1b08902ceffb2a2e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.811933 12172 tablet_bootstrap.cc:492] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.812037 12172 ts_tablet_manager.cc:1397] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:01:55.812507 12172 raft_consensus.cc:357] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.812613 12172 raft_consensus.cc:383] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.812642 12172 raft_consensus.cc:738] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.812778 12172 consensus_queue.cc:260] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.813973 12167 tablet_bootstrap.cc:492] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.814083 12167 ts_tablet_manager.cc:1397] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:55.814648 12167 raft_consensus.cc:357] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.814752 12167 raft_consensus.cc:383] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.814785 12167 raft_consensus.cc:738] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.814926 12167 consensus_queue.cc:260] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.815213 12172 ts_tablet_manager.cc:1428] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:55.815249 12167 ts_tablet_manager.cc:1428] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.815415 12172 tablet_bootstrap.cc:492] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.815461 12167 tablet_bootstrap.cc:492] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.816428 12172 tablet_bootstrap.cc:654] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.819999 11894 tablet_service.cc:1468] Processing CreateTablet for tablet edfce8c80bb341a48fb1b59def057571 (DEFAULT_TABLE table=default.Table_4388cbd6078f4906b12285dbc0e7189a [id=2883f9d8cb1d40b19d6efe5c5f871a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.820340 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfce8c80bb341a48fb1b59def057571. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.820819 12167 tablet_bootstrap.cc:654] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.822558 12166 tablet_bootstrap.cc:492] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.822650 12166 ts_tablet_manager.cc:1397] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:01:55.822839 12172 tablet_bootstrap.cc:492] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.822913 12172 ts_tablet_manager.cc:1397] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:55.823168 12166 raft_consensus.cc:357] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.823262 12166 raft_consensus.cc:383] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.823303 12166 raft_consensus.cc:738] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.823369 12172 raft_consensus.cc:357] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.823417 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 32d345da0f674704b8e1f23a74bac3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.823472 12172 raft_consensus.cc:383] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.823511 12172 raft_consensus.cc:738] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.823428 12166 consensus_queue.cc:260] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.823616 12172 consensus_queue.cc:260] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.823670 12175 tablet_replica.cc:331] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.823792 12166 ts_tablet_manager.cc:1428] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.823890 12172 ts_tablet_manager.cc:1428] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.823974 12166 tablet_bootstrap.cc:492] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.824048 12172 tablet_bootstrap.cc:492] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.825104 12166 tablet_bootstrap.cc:654] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.825470 12172 tablet_bootstrap.cc:654] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.826607 12167 tablet_bootstrap.cc:492] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.826705 12167 ts_tablet_manager.cc:1397] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:01:55.827175 12167 raft_consensus.cc:357] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.827312 12167 raft_consensus.cc:383] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.827355 12167 raft_consensus.cc:738] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.827510 12167 consensus_queue.cc:260] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.827803 12167 ts_tablet_manager.cc:1428] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.828008 12167 tablet_bootstrap.cc:492] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.828357 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_aad2dbed98a440f19cf6aa8608d96780" } modify_external_catalogs: true
I20250625 14:01:55.828476 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_aad2dbed98a440f19cf6aa8608d96780" } modify_external_catalogs: true
I20250625 14:01:55.828490 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4388cbd6078f4906b12285dbc0e7189a" } new_table_name: "default.Table_9aa283baefba46e0aba04a8c95c2f3c6" modify_external_catalogs: true
I20250625 14:01:55.828927 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7887db4b4d5c4f2a8770f9f0b73832ec" } modify_external_catalogs: true
I20250625 14:01:55.829088 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7887db4b4d5c4f2a8770f9f0b73832ec" } modify_external_catalogs: true
I20250625 14:01:55.829190 12167 tablet_bootstrap.cc:654] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.829258 11528 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_91d650533d9e4a8a80674057cfcf6964 [id=ccfb2f80b431431db5df92e0b400520c]). Expected version 1 got 0
I20250625 14:01:55.830176 12175 raft_consensus.cc:2241] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.830292 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet da88786d60c34c71b85abd0fca502b8d
I20250625 14:01:55.830334 12175 raft_consensus.cc:2270] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.831851 12172 tablet_bootstrap.cc:492] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.831943 12172 ts_tablet_manager.cc:1397] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:55.832413 12172 raft_consensus.cc:357] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.832515 12172 raft_consensus.cc:383] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.832547 12172 raft_consensus.cc:738] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.832657 12172 consensus_queue.cc:260] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.832932 12172 ts_tablet_manager.cc:1428] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.833104 12172 tablet_bootstrap.cc:492] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.834831 12172 tablet_bootstrap.cc:654] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.836110 12167 tablet_bootstrap.cc:492] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.836206 12167 ts_tablet_manager.cc:1397] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:55.836846 12167 raft_consensus.cc:357] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.836953 12167 raft_consensus.cc:383] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.836987 12167 raft_consensus.cc:738] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.837375 12167 consensus_queue.cc:260] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.837706 12167 ts_tablet_manager.cc:1428] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.837888 12167 tablet_bootstrap.cc:492] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.839555 12167 tablet_bootstrap.cc:654] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.840417 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet da88786d60c34c71b85abd0fca502b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.840641 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 (DEFAULT_TABLE table=default.Table_a3faac0915c648f7add30508a11e4224 [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.840899 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5489ee768c384fc0a1c8b6bed25b3a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.841323 12166 tablet_bootstrap.cc:492] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.841411 12166 ts_tablet_manager.cc:1397] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:55.843225 12177 tablet_replica.cc:331] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.843372 12177 raft_consensus.cc:2241] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.843538 12177 raft_consensus.cc:2270] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.843865 12177 ts_tablet_manager.cc:1905] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.845957 12177 ts_tablet_manager.cc:1918] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.846024 12177 log.cc:1199] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/da88786d60c34c71b85abd0fca502b8d
I20250625 14:01:55.846263 12177 ts_tablet_manager.cc:1939] T da88786d60c34c71b85abd0fca502b8d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.846560 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet cb7bbd1c627f4da6b2e1812eed472c83 with delete_type TABLET_DATA_DELETED (replaced by tablet 94232e8e88e84350b5f150a6eb433c92) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.847427 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.848490 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 (DEFAULT_TABLE table=default.Table_a3faac0915c648f7add30508a11e4224 [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.848682 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet da88786d60c34c71b85abd0fca502b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.848786 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5489ee768c384fc0a1c8b6bed25b3a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.848876 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet cb7bbd1c627f4da6b2e1812eed472c83 with delete_type TABLET_DATA_DELETED (replaced by tablet 94232e8e88e84350b5f150a6eb433c92) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.848886 12173 tablet_replica.cc:331] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.849050 12173 raft_consensus.cc:2241] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.849179 12173 raft_consensus.cc:2270] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.850741 12175 ts_tablet_manager.cc:1905] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.851570 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 205f83a0ffbc440492e241a75657f1b8 (table default.Table_56b605b35a0d4335b2916c5748f8ab38 [id=f7efaf49a2fe422185ac18faf97835b0]) successfully deleted
W20250625 14:01:55.852126 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5872bfb53bd04ac79d02f8d87a4ea090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5872bfb53bd04ac79d02f8d87a4ea090 already in progress: creating tablet
I20250625 14:01:55.852617 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet bc92f5f36ae94fe09b6017efc6ebbcaf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:53 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.852736 12173 ts_tablet_manager.cc:1905] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.853797 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet ab957f1fd4214efbb6233f312617c728 with delete_type TABLET_DATA_DELETED (replaced by tablet ee3cc1074818466a97d04f0136eaea92) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.854144 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 92975891d7b24729b4b5514d8f8aecd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.854550 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet da88786d60c34c71b85abd0fca502b8d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.854718 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 (DEFAULT_TABLE table=default.Table_a3faac0915c648f7add30508a11e4224 [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.854893 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 7302430d7e4a4610bfe271c114718d35 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b78fd0d543449bdb2e95fee6a53e93f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.855007 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5489ee768c384fc0a1c8b6bed25b3a26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.855058 12173 ts_tablet_manager.cc:1918] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.855114 12173 log.cc:1199] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/da88786d60c34c71b85abd0fca502b8d
I20250625 14:01:55.855249 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 25160014ecf74c2ab6f1faca42d30c47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.855368 12173 ts_tablet_manager.cc:1939] T da88786d60c34c71b85abd0fca502b8d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.855594 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.856432 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 144ba67ce1fa419cac46e40ebcc078e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.856755 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet fc2766f8e0b544b0b48a0e7e5952d672 with delete_type TABLET_DATA_DELETED (replaced by tablet 68a0cfeac48042bdaea66c3b0e370480) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.857065 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.857753 12166 raft_consensus.cc:357] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.857878 12166 raft_consensus.cc:383] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.857916 12166 raft_consensus.cc:738] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.858038 12166 consensus_queue.cc:260] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.858119 12173 tablet_replica.cc:331] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.858397 12166 ts_tablet_manager.cc:1428] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:55.858623 12173 raft_consensus.cc:2241] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.858728 12173 raft_consensus.cc:2270] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.859128 12173 ts_tablet_manager.cc:1905] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.859603 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet da88786d60c34c71b85abd0fca502b8d (table default.Table_e4729036527243a1b64bf5c9b7a4a5e1 [id=e67edee2642447d583e7ca5b97ec0213]) successfully deleted
I20250625 14:01:55.859859 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8bbe1212a7438f9a06cc1a18c6e40a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.860176 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet dbdc3547d8de48e8887ffeb5b0f71f82 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.860762 12166 tablet_bootstrap.cc:492] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.860967 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet da88786d60c34c71b85abd0fca502b8d (table default.Table_e4729036527243a1b64bf5c9b7a4a5e1 [id=e67edee2642447d583e7ca5b97ec0213]) successfully deleted
I20250625 14:01:55.862133 12175 ts_tablet_manager.cc:1918] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.862210 12175 log.cc:1199] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/32d345da0f674704b8e1f23a74bac3ce
I20250625 14:01:55.863747 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 4617bb8a015d42188beba9df61df2c9f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.865003 12173 ts_tablet_manager.cc:1918] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.865213 12166 tablet_bootstrap.cc:654] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.866891 12166 tablet_bootstrap.cc:492] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.867043 12166 ts_tablet_manager.cc:1397] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20250625 14:01:55.867153 12175 ts_tablet_manager.cc:1939] T 32d345da0f674704b8e1f23a74bac3ce P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.867923 12166 raft_consensus.cc:357] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.868060 12166 raft_consensus.cc:383] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.868167 12166 raft_consensus.cc:738] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.868280 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 32d345da0f674704b8e1f23a74bac3ce (table default.Table_1aa440e8532d4a51a048ec92c4a363bf [id=f6b6cc48a6f54d6bb64dba30511a4c41]) successfully deleted
I20250625 14:01:55.868153 12173 log.cc:1199] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/cb7bbd1c627f4da6b2e1812eed472c83
I20250625 14:01:55.868408 12166 consensus_queue.cc:260] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.868587 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 22cfc7f3b1564e4f91114cd5e049da0d with delete_type TABLET_DATA_DELETED (replaced by tablet bfdb34255cb147c48a322514b7a7a19d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.868834 12166 ts_tablet_manager.cc:1428] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:55.868742 12173 ts_tablet_manager.cc:1939] T cb7bbd1c627f4da6b2e1812eed472c83 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.870159 12173 tablet_replica.cc:331] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.870393 12173 raft_consensus.cc:2241] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.870537 12173 raft_consensus.cc:2270] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.871172 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]) successfully deleted
I20250625 14:01:55.871693 12173 ts_tablet_manager.cc:1905] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.872654 12175 tablet_replica.cc:331] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.872851 12175 raft_consensus.cc:2241] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.872999 12175 raft_consensus.cc:2270] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.873423 12175 ts_tablet_manager.cc:1905] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.873469 12166 tablet_bootstrap.cc:492] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.874819 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8fee92d68eaa4b22a7f0c122aeb5bc44
I20250625 14:01:55.874912 12166 tablet_bootstrap.cc:654] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.875208 11526 catalog_manager.cc:6652] ReplaceTablet: tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 deleted and replaced by tablet e98a2085fe67479db141b2675f69a2d9
I20250625 14:01:55.875423 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.876252 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bfdb34255cb147c48a322514b7a7a19d
I20250625 14:01:55.876488 11531 catalog_manager.cc:6652] ReplaceTablet: tablet bfdb34255cb147c48a322514b7a7a19d deleted and replaced by tablet cc9e2afd5bc443398293d0ed572f6c05
I20250625 14:01:55.876677 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3d82e197e7174db08e444c89b45c77be" } modify_external_catalogs: true
I20250625 14:01:55.876782 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3d82e197e7174db08e444c89b45c77be" } modify_external_catalogs: true
I20250625 14:01:55.877646 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e307709d217643358c7c3efb3dd73747
I20250625 14:01:55.877903 11524 catalog_manager.cc:6652] ReplaceTablet: tablet e307709d217643358c7c3efb3dd73747 deleted and replaced by tablet 1dc5b8ea4f3b47f19c603c235fa79007
I20250625 14:01:55.878341 12173 ts_tablet_manager.cc:1918] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.878419 12173 log.cc:1199] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/bc92f5f36ae94fe09b6017efc6ebbcaf
I20250625 14:01:55.878640 12173 ts_tablet_manager.cc:1939] T bc92f5f36ae94fe09b6017efc6ebbcaf P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.878927 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_91d650533d9e4a8a80674057cfcf6964 [id=ccfb2f80b431431db5df92e0b400520c]). Expected version 1 got 0
I20250625 14:01:55.879056 11532 catalog_manager.cc:5582] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:55.879244 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]). Expected version 1 got 0
I20250625 14:01:55.879385 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 3c825977e422407486587f28af36bd68 (table default.Table_2928b645415547419a21192f44ad81ab [id=c7bfff2cc8b84a5d83719cd96bc5af9c]). Expected version 2 got 0
I20250625 14:01:55.879532 12173 tablet_replica.cc:331] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.879493 11532 catalog_manager.cc:5582] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:55.879663 12173 raft_consensus.cc:2241] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.879763 12173 raft_consensus.cc:2270] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.880120 12175 ts_tablet_manager.cc:1918] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.880193 12175 log.cc:1199] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/cb7bbd1c627f4da6b2e1812eed472c83
I20250625 14:01:55.880456 12175 ts_tablet_manager.cc:1939] T cb7bbd1c627f4da6b2e1812eed472c83 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.880577 12173 ts_tablet_manager.cc:1905] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.880998 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet bfdb34255cb147c48a322514b7a7a19d with delete_type TABLET_DATA_DELETED (replaced by tablet cc9e2afd5bc443398293d0ed572f6c05) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.881170 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet e307709d217643358c7c3efb3dd73747 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc5b8ea4f3b47f19c603c235fa79007) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.881254 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet bc92f5f36ae94fe09b6017efc6ebbcaf (table default.Table_dbd3da73c8ac4e928ab517816c17a64a [id=0fe6e6250ec246e792b2b5a7e6adf26b]) successfully deleted
I20250625 14:01:55.881714 12430 tablet.cc:1722] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.881790 12175 tablet_replica.cc:331] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.881904 12175 raft_consensus.cc:2241] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.882011 12175 raft_consensus.cc:2270] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.882483 12175 ts_tablet_manager.cc:1905] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.882905 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dc38af2e12bd48faa284df718dff16f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.883205 12173 ts_tablet_manager.cc:1918] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.883286 12173 log.cc:1199] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/ab957f1fd4214efbb6233f312617c728
W20250625 14:01:55.883440 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc38af2e12bd48faa284df718dff16f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.883492 12173 ts_tablet_manager.cc:1939] T ab957f1fd4214efbb6233f312617c728 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.884410 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet ab957f1fd4214efbb6233f312617c728 (table default.Table_950ea773e03943f79810fce3d2b243da [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
I20250625 14:01:55.884784 12208 raft_consensus.cc:491] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.884815 12175 ts_tablet_manager.cc:1918] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:55.884891 12175 log.cc:1199] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/da88786d60c34c71b85abd0fca502b8d
I20250625 14:01:55.884904 12208 raft_consensus.cc:513] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.885151 12175 ts_tablet_manager.cc:1939] T da88786d60c34c71b85abd0fca502b8d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.885402 12208 leader_election.cc:290] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.885636 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet bfdb34255cb147c48a322514b7a7a19d with delete_type TABLET_DATA_DELETED (replaced by tablet cc9e2afd5bc443398293d0ed572f6c05) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:55.885668 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet edfce8c80bb341a48fb1b59def057571 consensus state has no leader
I20250625 14:01:55.885787 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet e307709d217643358c7c3efb3dd73747 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc5b8ea4f3b47f19c603c235fa79007) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.885636 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 with delete_type TABLET_DATA_DELETED (replaced by tablet e98a2085fe67479db141b2675f69a2d9) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:55.885939 11717 leader_election.cc:343] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: d4a1580aeb4a4c1787c32b4d23e0fcaa
I20250625 14:01:55.885946 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet cb7bbd1c627f4da6b2e1812eed472c83 (table default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]) successfully deleted
W20250625 14:01:55.886140 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 5872bfb53bd04ac79d02f8d87a4ea090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5872bfb53bd04ac79d02f8d87a4ea090 already in progress: creating tablet
I20250625 14:01:55.886354 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 with delete_type TABLET_DATA_DELETED (replaced by tablet e98a2085fe67479db141b2675f69a2d9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.886853 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d4a1580aeb4a4c1787c32b4d23e0fcaa" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.887005 12057 raft_consensus.cc:2466] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:55.887207 12584 tablet.cc:1722] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.887341 11717 leader_election.cc:304] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:01:55.888082 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 with delete_type TABLET_DATA_DELETED (replaced by tablet e98a2085fe67479db141b2675f69a2d9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.888846 12167 tablet_bootstrap.cc:492] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.888924 12167 ts_tablet_manager.cc:1397] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.000s
I20250625 14:01:55.889406 12167 raft_consensus.cc:357] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.889503 12167 raft_consensus.cc:383] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.889529 12167 raft_consensus.cc:738] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.889652 12167 consensus_queue.cc:260] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.889910 12167 ts_tablet_manager.cc:1428] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.890028 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet bfdb34255cb147c48a322514b7a7a19d with delete_type TABLET_DATA_DELETED (replaced by tablet cc9e2afd5bc443398293d0ed572f6c05) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.890261 12208 raft_consensus.cc:2802] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.890362 12208 raft_consensus.cc:491] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.890408 12208 raft_consensus.cc:3058] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.890497 12167 tablet_bootstrap.cc:492] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.891430 12208 raft_consensus.cc:513] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.891588 12167 tablet_bootstrap.cc:654] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.891808 12208 leader_election.cc:290] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.892719 12172 tablet_bootstrap.cc:492] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
W20250625 14:01:55.892693 11717 leader_election.cc:343] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: d4a1580aeb4a4c1787c32b4d23e0fcaa
I20250625 14:01:55.892808 12172 ts_tablet_manager.cc:1397] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.000s
I20250625 14:01:55.893342 12172 raft_consensus.cc:357] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.893440 12172 raft_consensus.cc:383] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.893471 12172 raft_consensus.cc:738] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.893586 12172 consensus_queue.cc:260] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.893864 12172 ts_tablet_manager.cc:1428] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:55.894047 12172 tablet_bootstrap.cc:492] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.895151 12172 tablet_bootstrap.cc:654] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.895618 12173 tablet_replica.cc:331] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.895792 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d4a1580aeb4a4c1787c32b4d23e0fcaa" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:55.895826 12173 raft_consensus.cc:2241] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.895936 12057 raft_consensus.cc:3058] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.896939 12173 raft_consensus.cc:2270] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.897008 12057 raft_consensus.cc:2466] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:55.897310 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet e307709d217643358c7c3efb3dd73747 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc5b8ea4f3b47f19c603c235fa79007) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.897375 11717 leader_election.cc:304] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:01:55.897544 12238 raft_consensus.cc:2802] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.897626 12238 raft_consensus.cc:695] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
W20250625 14:01:55.897773 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 already in progress: creating tablet
I20250625 14:01:55.897794 12238 consensus_queue.cc:237] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:55.897943 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet bfdb34255cb147c48a322514b7a7a19d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfdb34255cb147c48a322514b7a7a19d already in progress: creating tablet
W20250625 14:01:55.898090 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet e307709d217643358c7c3efb3dd73747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e307709d217643358c7c3efb3dd73747 already in progress: creating tablet
I20250625 14:01:55.899235 12173 ts_tablet_manager.cc:1905] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.900993 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet da88786d60c34c71b85abd0fca502b8d (table default.Table_e4729036527243a1b64bf5c9b7a4a5e1 [id=e67edee2642447d583e7ca5b97ec0213]) successfully deleted
I20250625 14:01:55.902060 12173 ts_tablet_manager.cc:1918] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.902201 12173 log.cc:1199] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/92975891d7b24729b4b5514d8f8aecd8
I20250625 14:01:55.902581 12173 ts_tablet_manager.cc:1939] T 92975891d7b24729b4b5514d8f8aecd8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:55.905859 12175 tablet_replica.cc:331] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.905972 12173 tablet_replica.cc:331] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:55.906090 12175 raft_consensus.cc:2241] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.906239 12175 raft_consensus.cc:2270] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.906246 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 92975891d7b24729b4b5514d8f8aecd8 (table default.Table_e4a50929a7434ef0bd4f961f077f4ff8 [id=cd58fd19f8994edf8a5854d80684e399]) successfully deleted
I20250625 14:01:55.906441 12173 raft_consensus.cc:2241] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.906605 12173 raft_consensus.cc:2270] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.907137 12173 ts_tablet_manager.cc:1905] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.908885 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 599bd5368dfc4ea0bd23ea4f18fe3c60
I20250625 14:01:55.909215 11526 catalog_manager.cc:6652] ReplaceTablet: tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 deleted and replaced by tablet c1c05e534c804eb69e0c249a03418941
I20250625 14:01:55.910017 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 with delete_type TABLET_DATA_DELETED (replaced by tablet c1c05e534c804eb69e0c249a03418941) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.910292 11529 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_0764c545c28d4a3c82093556ae3f970b [id=5f1140a89f654aa0874f801a35ffa3e8] alter complete (version 1)
I20250625 14:01:55.910656 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 3c825977e422407486587f28af36bd68 (table default.Table_2928b645415547419a21192f44ad81ab [id=c7bfff2cc8b84a5d83719cd96bc5af9c]). Expected version 2 got 0
I20250625 14:01:55.910738 12175 ts_tablet_manager.cc:1905] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.910903 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_91d650533d9e4a8a80674057cfcf6964 [id=ccfb2f80b431431db5df92e0b400520c]). Expected version 1 got 0
I20250625 14:01:55.911017 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]). Expected version 1 got 0
I20250625 14:01:55.911115 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 with delete_type TABLET_DATA_DELETED (replaced by tablet c1c05e534c804eb69e0c249a03418941) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.911310 12177 tablet_replica.cc:331] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.911442 12177 raft_consensus.cc:2241] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.911516 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 with delete_type TABLET_DATA_DELETED (replaced by tablet c1c05e534c804eb69e0c249a03418941) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.911554 12177 raft_consensus.cc:2270] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.911823 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 39ff4b0e7ac74ec294550775aaa44468
I20250625 14:01:55.912119 12177 ts_tablet_manager.cc:1905] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.912212 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7b78fd0d543449bdb2e95fee6a53e93f
I20250625 14:01:55.912580 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9077aa58d4d5488d812e71da4407d87b
I20250625 14:01:55.913576 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 39ff4b0e7ac74ec294550775aaa44468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.913781 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 9077aa58d4d5488d812e71da4407d87b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.914022 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 39ff4b0e7ac74ec294550775aaa44468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.914187 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.914393 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.914497 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.914561 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 9077aa58d4d5488d812e71da4407d87b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.915069 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 9077aa58d4d5488d812e71da4407d87b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.915110 12177 ts_tablet_manager.cc:1918] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.915164 12177 log.cc:1199] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/599bd5368dfc4ea0bd23ea4f18fe3c60
I20250625 14:01:55.915412 12177 ts_tablet_manager.cc:1939] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:55.916360 12175 ts_tablet_manager.cc:1918] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.916428 12175 log.cc:1199] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7302430d7e4a4610bfe271c114718d35
I20250625 14:01:55.916625 12175 ts_tablet_manager.cc:1939] T 7302430d7e4a4610bfe271c114718d35 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.917551 12233 tablet.cc:1722] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:55.918951 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e7260f6c81d64415ae2469f87fe46c55
I20250625 14:01:55.919309 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 39ff4b0e7ac74ec294550775aaa44468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.919473 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet e7260f6c81d64415ae2469f87fe46c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:55.919606 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet bfdb34255cb147c48a322514b7a7a19d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfdb34255cb147c48a322514b7a7a19d already in progress: creating tablet
I20250625 14:01:55.923435 12208 raft_consensus.cc:491] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.923564 12208 raft_consensus.cc:513] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.924000 12208 leader_election.cc:290] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.924603 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aac4b7bbfad9493598b31a86e2c045c0" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.924752 12057 raft_consensus.cc:2466] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:55.924824 11717 leader_election.cc:343] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: aac4b7bbfad9493598b31a86e2c045c0
I20250625 14:01:55.925136 11717 leader_election.cc:304] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
W20250625 14:01:55.925212 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet e307709d217643358c7c3efb3dd73747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e307709d217643358c7c3efb3dd73747 already in progress: creating tablet
I20250625 14:01:55.925434 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e with delete_type TABLET_DATA_DELETED (replaced by tablet 54f0be19f9134fa3a88ae867b108c7e8) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:55.925678 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 already in progress: creating tablet
I20250625 14:01:55.925884 12175 tablet_replica.cc:331] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.926054 12175 raft_consensus.cc:2241] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.926117 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b82e99ecc994068b7823ef75d5b233f with delete_type TABLET_DATA_DELETED (replaced by tablet 4b76d36bac354543b8f7cef071aaa661) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.926363 12175 raft_consensus.cc:2270] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.926997 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet e7260f6c81d64415ae2469f87fe46c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.927616 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet e7260f6c81d64415ae2469f87fe46c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.927773 12175 ts_tablet_manager.cc:1905] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.927867 12208 raft_consensus.cc:2802] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:55.927929 12166 tablet_bootstrap.cc:492] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:55.927946 12208 raft_consensus.cc:491] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:55.927987 12208 raft_consensus.cc:3058] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:55.928030 12166 ts_tablet_manager.cc:1397] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.000s
I20250625 14:01:55.928525 12166 raft_consensus.cc:357] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.928630 12166 raft_consensus.cc:383] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.928659 12166 raft_consensus.cc:738] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.928786 12166 consensus_queue.cc:260] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.929103 12166 ts_tablet_manager.cc:1428] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.929085 12208 raft_consensus.cc:513] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.929311 12166 tablet_bootstrap.cc:492] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:55.929488 12208 leader_election.cc:290] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.930425 12175 ts_tablet_manager.cc:1918] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.930656 12175 log.cc:1199] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/599bd5368dfc4ea0bd23ea4f18fe3c60
I20250625 14:01:55.931994 12600 raft_consensus.cc:491] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.932078 12600 raft_consensus.cc:513] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.932448 12600 leader_election.cc:290] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.933113 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "aac4b7bbfad9493598b31a86e2c045c0" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:55.933250 12057 raft_consensus.cc:3058] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:55.933621 11717 leader_election.cc:343] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: aac4b7bbfad9493598b31a86e2c045c0
I20250625 14:01:55.934120 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c940a9f7ada54b48940e90c822c84735" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.934254 12057 raft_consensus.cc:2466] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:55.934361 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c940a9f7ada54b48940e90c822c84735" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:55.934496 11858 leader_election.cc:343] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:55.934752 11855 leader_election.cc:343] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.934823 11855 leader_election.cc:304] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.935030 12265 raft_consensus.cc:2747] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.935294 12177 tablet_replica.cc:331] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:55.936326 12177 raft_consensus.cc:2241] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:55.936581 12177 pending_rounds.cc:70] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:55.936667 12177 pending_rounds.cc:77] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523034060464128 op_type: NO_OP noop_request { }
I20250625 14:01:55.936920 12177 raft_consensus.cc:2887] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:55.937242 12177 raft_consensus.cc:2270] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.937896 12166 tablet_bootstrap.cc:654] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.938536 12175 ts_tablet_manager.cc:1939] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.938632 12265 raft_consensus.cc:491] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.938724 12265 raft_consensus.cc:513] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.939117 12265 leader_election.cc:290] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:55.935294 11717 leader_election.cc:304] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:01:55.939296 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 (table default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]) successfully deleted
I20250625 14:01:55.939465 12208 raft_consensus.cc:2802] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:55.939559 12208 raft_consensus.cc:695] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:55.939694 12208 consensus_queue.cc:237] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.939924 12175 tablet_replica.cc:331] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.940049 12175 raft_consensus.cc:2241] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.940138 12175 raft_consensus.cc:2270] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:55.940169 12600 raft_consensus.cc:491] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.940253 12600 raft_consensus.cc:513] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.940500 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6bcdf4d901e34ab5ba2c36fe53456f0e" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.940582 12600 leader_election.cc:290] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:55.940604 12175 ts_tablet_manager.cc:1905] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:55.940860 11855 leader_election.cc:343] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.940990 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b82e99ecc994068b7823ef75d5b233f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:55.941043 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7b78fd0d543449bdb2e95fee6a53e93f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b78fd0d543449bdb2e95fee6a53e93f already in progress: creating tablet
W20250625 14:01:55.941293 11855 leader_election.cc:343] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.942082 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6bcdf4d901e34ab5ba2c36fe53456f0e" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.942219 12177 ts_tablet_manager.cc:1905] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:55.942811 11858 leader_election.cc:343] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.942895 11858 leader_election.cc:304] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.943262 12265 consensus_queue.cc:1035] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:55.943517 12265 raft_consensus.cc:2747] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.942742 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b82e99ecc994068b7823ef75d5b233f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:55.943508 12175 ts_tablet_manager.cc:1918] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.946426 12175 log.cc:1199] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9077aa58d4d5488d812e71da4407d87b
W20250625 14:01:55.946612 11858 leader_election.cc:343] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.946631 11533 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]). Expected version 1 got 0
I20250625 14:01:55.946673 12175 ts_tablet_manager.cc:1939] T 9077aa58d4d5488d812e71da4407d87b P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:55.946692 11858 leader_election.cc:304] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:55.946906 12265 raft_consensus.cc:2747] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.947396 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9077aa58d4d5488d812e71da4407d87b (table default.Table_aad2dbed98a440f19cf6aa8608d96780 [id=c485676a21514b95bab0990f6807c5c7]) successfully deleted
I20250625 14:01:55.947835 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 with delete_type TABLET_DATA_DELETED (replaced by tablet fc948c61d54a4618856b64a12a32b2c4) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.948067 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 205f83a0ffbc440492e241a75657f1b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.948350 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 with delete_type TABLET_DATA_DELETED (replaced by tablet e3af8a01ca1f49afb8aa1834807abf7e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.948540 12175 tablet_replica.cc:331] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:55.948711 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 32d345da0f674704b8e1f23a74bac3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.948873 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet aac4b7bbfad9493598b31a86e2c045c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.949070 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 92984f3be8454a969b7c39af97a11479 with delete_type TABLET_DATA_DELETED (replaced by tablet 5227c93e932a4ed4b3d03990d7ed7b69) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.949255 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 7302430d7e4a4610bfe271c114718d35 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b78fd0d543449bdb2e95fee6a53e93f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.949465 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet d4a1580aeb4a4c1787c32b4d23e0fcaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.949702 12238 raft_consensus.cc:491] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.949815 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:55.949801 12238 raft_consensus.cc:513] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.950228 12238 leader_election.cc:290] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.950832 12175 raft_consensus.cc:2241] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:55.950963 12175 raft_consensus.cc:2270] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:55.951139 11717 leader_election.cc:343] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 7302430d7e4a4610bfe271c114718d35
I20250625 14:01:55.951367 12175 ts_tablet_manager.cc:1905] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:55.951524 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8feddd83af08466ea11c4a15a08d3c8b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.951676 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 (table default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]) successfully deleted
I20250625 14:01:55.953752 12666 raft_consensus.cc:491] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.953866 12666 raft_consensus.cc:513] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:55.954285 12666 leader_election.cc:290] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.954485 12167 tablet_bootstrap.cc:492] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.954573 12167 ts_tablet_manager.cc:1397] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.001s
I20250625 14:01:55.954725 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8feddd83af08466ea11c4a15a08d3c8b) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:55.954809 11990 leader_election.cc:343] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 9d8bbe1212a7438f9a06cc1a18c6e40a
I20250625 14:01:55.954982 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7302430d7e4a4610bfe271c114718d35" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:55.955070 12167 raft_consensus.cc:357] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.955160 12167 raft_consensus.cc:383] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.955190 12167 raft_consensus.cc:738] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
W20250625 14:01:55.955292 11717 leader_election.cc:343] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.955303 12167 consensus_queue.cc:260] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.955375 11717 leader_election.cc:304] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:55.955564 12167 ts_tablet_manager.cc:1428] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:55.955575 12238 raft_consensus.cc:2747] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.955639 12668 raft_consensus.cc:491] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.955730 12167 tablet_bootstrap.cc:492] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:55.955709 12668 raft_consensus.cc:513] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.956056 12668 leader_election.cc:290] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:55.956763 12167 tablet_bootstrap.cc:654] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.957062 11990 leader_election.cc:343] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: fc2766f8e0b544b0b48a0e7e5952d672
I20250625 14:01:55.957177 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 1a3907e22505461a8df58ec339c342da from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:55.957571 12175 ts_tablet_manager.cc:1918] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:55.957644 12175 log.cc:1199] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/39ff4b0e7ac74ec294550775aaa44468
I20250625 14:01:55.957857 12175 ts_tablet_manager.cc:1939] T 39ff4b0e7ac74ec294550775aaa44468 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:01:55.958431 11993 leader_election.cc:343] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 9d8bbe1212a7438f9a06cc1a18c6e40a
I20250625 14:01:55.958494 11993 leader_election.cc:304] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.958698 12666 raft_consensus.cc:2747] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.958968 12172 tablet_bootstrap.cc:492] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.959072 12172 ts_tablet_manager.cc:1397] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
W20250625 14:01:55.959074 11993 leader_election.cc:343] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: fc2766f8e0b544b0b48a0e7e5952d672
I20250625 14:01:55.959136 11993 leader_election.cc:304] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:55.959322 12666 raft_consensus.cc:2747] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:55.959539 12172 raft_consensus.cc:357] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.959646 12172 raft_consensus.cc:383] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.959676 12172 raft_consensus.cc:738] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.959795 12172 consensus_queue.cc:260] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.960076 12172 ts_tablet_manager.cc:1428] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:55.960254 12172 tablet_bootstrap.cc:492] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.961282 12172 tablet_bootstrap.cc:654] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.961391 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 92984f3be8454a969b7c39af97a11479 with delete_type TABLET_DATA_DELETED (replaced by tablet 5227c93e932a4ed4b3d03990d7ed7b69) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.962080 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_950ea773e03943f79810fce3d2b243da" } new_table_name: "default.Table_25ca21504a3f4d0ebd04eefc325912f4" modify_external_catalogs: true
I20250625 14:01:55.964391 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dba49d3cdee64ffba6f3959bed8da9ba" } new_table_name: "default.Table_f58eef6273194f588541530127a796c2" modify_external_catalogs: true
I20250625 14:01:55.965231 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1a3907e22505461a8df58ec339c342da
I20250625 14:01:55.965412 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b67c4059a8a6481d9f5d4457639fd851"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:55.965569 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 1a3907e22505461a8df58ec339c342da deleted and replaced by tablet da5ed5d8d3ca4342980c893a8653d4a0
W20250625 14:01:55.965792 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b67c4059a8a6481d9f5d4457639fd851 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.966004 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a3907e22505461a8df58ec339c342da with delete_type TABLET_DATA_DELETED (replaced by tablet da5ed5d8d3ca4342980c893a8653d4a0) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:55.966202 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a3907e22505461a8df58ec339c342da with delete_type TABLET_DATA_DELETED (replaced by tablet da5ed5d8d3ca4342980c893a8653d4a0) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:55.966778 12172 tablet_bootstrap.cc:492] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.966873 12172 ts_tablet_manager.cc:1397] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:01:55.967367 12172 raft_consensus.cc:357] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.968020 12031 tablet_service.cc:1468] Processing CreateTablet for tablet b949191f6218463192890e13ccf6b17e (DEFAULT_TABLE table=default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 [id=492a3d0d7a8e44a9a4e12606ef07a9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.968376 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949191f6218463192890e13ccf6b17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.967975 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a3907e22505461a8df58ec339c342da with delete_type TABLET_DATA_DELETED (replaced by tablet da5ed5d8d3ca4342980c893a8653d4a0) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.967473 12172 raft_consensus.cc:383] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.968967 12172 raft_consensus.cc:738] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.969100 12172 consensus_queue.cc:260] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.969806 11901 tablet_service.cc:1468] Processing CreateTablet for tablet b949191f6218463192890e13ccf6b17e (DEFAULT_TABLE table=default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 [id=492a3d0d7a8e44a9a4e12606ef07a9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.969995 11761 tablet_service.cc:1468] Processing CreateTablet for tablet b949191f6218463192890e13ccf6b17e (DEFAULT_TABLE table=default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 [id=492a3d0d7a8e44a9a4e12606ef07a9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.970124 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949191f6218463192890e13ccf6b17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.970240 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949191f6218463192890e13ccf6b17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.974138 12172 ts_tablet_manager.cc:1428] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:01:55.974673 12172 tablet_bootstrap.cc:492] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:55.975672 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a509f117fbe5458fafb958447f82921d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.975862 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee3cc1074818466a97d04f0136eaea92 consensus state has no leader
I20250625 14:01:55.975965 12172 tablet_bootstrap.cc:654] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:55.976122 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a509f117fbe5458fafb958447f82921d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.976147 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_84c115ad81fd4a09a7d228f765b67688"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:55.976469 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84c115ad81fd4a09a7d228f765b67688 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:55.979717 12177 ts_tablet_manager.cc:1918] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:55.981367 11901 tablet_service.cc:1468] Processing CreateTablet for tablet fbf41efa64294f388894a9a57b45fdc2 (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.981840 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf41efa64294f388894a9a57b45fdc2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:55.984827 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 339813cd0c194f07bfc4edefd6a05ef3 consensus state has no leader
I20250625 14:01:55.985239 12265 raft_consensus.cc:491] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:55.985342 12265 raft_consensus.cc:513] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.985605 12031 tablet_service.cc:1468] Processing CreateTablet for tablet fbf41efa64294f388894a9a57b45fdc2 (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.985762 12265 leader_election.cc:290] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:55.985924 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf41efa64294f388894a9a57b45fdc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.986675 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c825977e422407486587f28af36bd68" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:55.987088 11855 leader_election.cc:343] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:55.990700 11901 tablet_service.cc:1468] Processing CreateTablet for tablet f5e271b27ac349d6bb8cf47aa8b9668a (DEFAULT_TABLE table=default.Table_8e7e773b96234beabd12191f60e2c981 [id=29fdfe34ed7648feb4f21f471fd5e154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.991173 12031 tablet_service.cc:1468] Processing CreateTablet for tablet f5e271b27ac349d6bb8cf47aa8b9668a (DEFAULT_TABLE table=default.Table_8e7e773b96234beabd12191f60e2c981 [id=29fdfe34ed7648feb4f21f471fd5e154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.991578 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5e271b27ac349d6bb8cf47aa8b9668a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.996980 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 562187f6db8a4883a5bb2d939a31b769 (DEFAULT_TABLE table=default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.997304 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562187f6db8a4883a5bb2d939a31b769. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.996918 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 562187f6db8a4883a5bb2d939a31b769 (DEFAULT_TABLE table=default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.997970 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562187f6db8a4883a5bb2d939a31b769. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.998605 12167 tablet_bootstrap.cc:492] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:55.997195 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 34806da4b2ec4c2db13322952bf943c5 (DEFAULT_TABLE table=default.Table_a34ff03966644dd1bae2a02ecffbae31 [id=004a35a086c44e80ba9e1db51f81d375]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.998687 12167 ts_tablet_manager.cc:1397] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.002s
I20250625 14:01:55.999217 12167 raft_consensus.cc:357] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.999320 12167 raft_consensus.cc:383] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:55.999351 12167 raft_consensus.cc:738] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:55.999491 12167 consensus_queue.cc:260] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:55.999815 12167 ts_tablet_manager.cc:1428] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.000030 12167 tablet_bootstrap.cc:492] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.000209 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34806da4b2ec4c2db13322952bf943c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.001015 12167 tablet_bootstrap.cc:654] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.002971 12056 raft_consensus.cc:3058] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.005702 12600 consensus_queue.cc:1035] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.011523 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5e271b27ac349d6bb8cf47aa8b9668a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.014082 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 68a0cfeac48042bdaea66c3b0e370480 with delete_type TABLET_DATA_DELETED (replaced by tablet e3af8a01ca1f49afb8aa1834807abf7e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.014464 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_59df2339a1ce4fcba83a683bad90e026"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.014914 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59df2339a1ce4fcba83a683bad90e026 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.017395 12036 tablet_service.cc:1468] Processing CreateTablet for tablet fe7e0145fb2f48c29259afafcbe29599 (DEFAULT_TABLE table=default.Table_57f7d205bb304fd8982fcd30bb558c54 [id=3d7b081834c54daba8172abc85c60576]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.017706 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7e0145fb2f48c29259afafcbe29599. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.017900 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6d4a606cc39f4c5991ebd75363e1b078"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.018337 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d4a606cc39f4c5991ebd75363e1b078 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.018906 12030 tablet_service.cc:1468] Processing CreateTablet for tablet b07c4c7d9ba54abe9794ab432f55bf62 (DEFAULT_TABLE table=default.Table_6a195a661111421cb38dde060c6dcd15 [id=dea2357ffccc4f74b480841db27be138]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.019171 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07c4c7d9ba54abe9794ab432f55bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.019501 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 31157f3bd20f4db5a0baa05b61d92f87 (DEFAULT_TABLE table=default.Table_96e5e7713c4240a1b08902ceffb2a2e3 [id=03079048fe6d402892c777db10632ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.019711 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31157f3bd20f4db5a0baa05b61d92f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.022818 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 07497399a6cd463f8d20d33d9db1d46b (DEFAULT_TABLE table=default.Table_fde1c3b5b39545068fc40abb87f0c6cb [id=29e750f2b74b4d67bab90a78c61c84b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.023103 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07497399a6cd463f8d20d33d9db1d46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.024426 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_96e5e7713c4240a1b08902ceffb2a2e3" } new_table_name: "default.Table_152685b1e6a74938b9531031675cb9d3" modify_external_catalogs: true
I20250625 14:01:56.025704 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 31157f3bd20f4db5a0baa05b61d92f87 (DEFAULT_TABLE table=default.Table_96e5e7713c4240a1b08902ceffb2a2e3 [id=03079048fe6d402892c777db10632ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.026003 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31157f3bd20f4db5a0baa05b61d92f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.026422 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1809d17fc2ca4fc294f2c0b3cbec2866" } new_table_name: "default.Table_3f92afb1db03462ba4957327934a6f31" modify_external_catalogs: true
I20250625 14:01:56.029310 11897 tablet_service.cc:1468] Processing CreateTablet for tablet b07c4c7d9ba54abe9794ab432f55bf62 (DEFAULT_TABLE table=default.Table_6a195a661111421cb38dde060c6dcd15 [id=dea2357ffccc4f74b480841db27be138]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.029594 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07c4c7d9ba54abe9794ab432f55bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.031051 12167 tablet_bootstrap.cc:492] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.031143 12167 ts_tablet_manager.cc:1397] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.000s
I20250625 14:01:56.031694 12167 raft_consensus.cc:357] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.031811 12167 raft_consensus.cc:383] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.031857 12167 raft_consensus.cc:738] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.031992 12167 consensus_queue.cc:260] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:55.982231 11761 tablet_service.cc:1468] Processing CreateTablet for tablet fbf41efa64294f388894a9a57b45fdc2 (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:55.986258 12172 tablet_bootstrap.cc:492] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:55.986354 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c825977e422407486587f28af36bd68" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.032223 12172 ts_tablet_manager.cc:1397] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.001s
I20250625 14:01:56.032335 12167 ts_tablet_manager.cc:1428] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.032311 11780 raft_consensus.cc:2466] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:55.996764 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b82e99ecc994068b7823ef75d5b233f with delete_type TABLET_DATA_DELETED (replaced by tablet 4b76d36bac354543b8f7cef071aaa661) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.032673 11858 leader_election.cc:304] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.032756 12172 raft_consensus.cc:357] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.032862 12172 raft_consensus.cc:383] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.032898 12172 raft_consensus.cc:738] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.032902 12600 raft_consensus.cc:2802] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.032950 12600 raft_consensus.cc:491] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.032999 12600 raft_consensus.cc:3058] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.033020 12172 consensus_queue.cc:260] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.033324 12172 ts_tablet_manager.cc:1428] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.033512 12172 tablet_bootstrap.cc:492] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:56.033694 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31157f3bd20f4db5a0baa05b61d92f87 consensus state has no leader
I20250625 14:01:56.033931 12600 raft_consensus.cc:513] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.032322 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf41efa64294f388894a9a57b45fdc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:55.997510 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 34806da4b2ec4c2db13322952bf943c5 (DEFAULT_TABLE table=default.Table_a34ff03966644dd1bae2a02ecffbae31 [id=004a35a086c44e80ba9e1db51f81d375]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.034513 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34806da4b2ec4c2db13322952bf943c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.035274 12172 tablet_bootstrap.cc:654] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:55.999511 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e with delete_type TABLET_DATA_DELETED (replaced by tablet 54f0be19f9134fa3a88ae867b108c7e8) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:55.999748 11762 tablet_service.cc:1468] Processing CreateTablet for tablet f5e271b27ac349d6bb8cf47aa8b9668a (DEFAULT_TABLE table=default.Table_8e7e773b96234beabd12191f60e2c981 [id=29fdfe34ed7648feb4f21f471fd5e154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.036144 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5e271b27ac349d6bb8cf47aa8b9668a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.036787 12167 tablet_bootstrap.cc:492] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:56.037392 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc948c61d54a4618856b64a12a32b2c4 consensus state has no leader
I20250625 14:01:56.037887 12167 tablet_bootstrap.cc:654] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.037897 12265 raft_consensus.cc:491] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.004067 12238 raft_consensus.cc:491] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.037993 12265 raft_consensus.cc:513] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.010886 12208 raft_consensus.cc:491] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.028079 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 562187f6db8a4883a5bb2d939a31b769 (DEFAULT_TABLE table=default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.038089 12238 raft_consensus.cc:513] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.038259 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562187f6db8a4883a5bb2d939a31b769. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.038416 12265 leader_election.cc:290] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.038472 12238 leader_election.cc:290] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.029913 11756 tablet_service.cc:1468] Processing CreateTablet for tablet fe7e0145fb2f48c29259afafcbe29599 (DEFAULT_TABLE table=default.Table_57f7d205bb304fd8982fcd30bb558c54 [id=3d7b081834c54daba8172abc85c60576]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.038702 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7e0145fb2f48c29259afafcbe29599. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.038785 12600 leader_election.cc:290] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.039501 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c825977e422407486587f28af36bd68" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.039776 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf7e6d24347a88da2ee8fbd6de1b1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.040027 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7260f6c81d64415ae2469f87fe46c55" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.040076 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7260f6c81d64415ae2469f87fe46c55" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.040151 11920 raft_consensus.cc:2466] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.040298 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf7e6d24347a88da2ee8fbd6de1b1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.040409 11780 raft_consensus.cc:2466] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.030179 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 31157f3bd20f4db5a0baa05b61d92f87 (DEFAULT_TABLE table=default.Table_96e5e7713c4240a1b08902ceffb2a2e3 [id=03079048fe6d402892c777db10632ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.040616 12208 raft_consensus.cc:513] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.029913 11757 tablet_service.cc:1468] Processing CreateTablet for tablet b07c4c7d9ba54abe9794ab432f55bf62 (DEFAULT_TABLE table=default.Table_6a195a661111421cb38dde060c6dcd15 [id=dea2357ffccc4f74b480841db27be138]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.040740 11858 leader_election.cc:304] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.040968 12208 leader_election.cc:290] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.041047 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c825977e422407486587f28af36bd68" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.041146 11782 raft_consensus.cc:3058] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.042022 11782 raft_consensus.cc:2466] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.042343 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31157f3bd20f4db5a0baa05b61d92f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.042375 11858 leader_election.cc:304] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.043082 12177 log.cc:1199] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/39ff4b0e7ac74ec294550775aaa44468
I20250625 14:01:56.043885 12177 ts_tablet_manager.cc:1939] T 39ff4b0e7ac74ec294550775aaa44468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.044013 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07c4c7d9ba54abe9794ab432f55bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.044261 12265 raft_consensus.cc:2802] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.044332 12265 raft_consensus.cc:491] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.044371 12265 raft_consensus.cc:3058] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.044667 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 9da1d3ee457944399e60e0c5bdd8c428 with delete_type TABLET_DATA_DELETED (replaced by tablet fc948c61d54a4618856b64a12a32b2c4) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.045305 12177 tablet_replica.cc:331] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.045390 12265 raft_consensus.cc:513] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.045456 12177 raft_consensus.cc:2241] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.045557 12177 raft_consensus.cc:2270] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.045792 12265 leader_election.cc:290] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.045888 12265 raft_consensus.cc:2802] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.045959 12265 raft_consensus.cc:695] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.046116 12265 consensus_queue.cc:237] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.047822 12173 ts_tablet_manager.cc:1918] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.047933 12173 log.cc:1199] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/25160014ecf74c2ab6f1faca42d30c47
I20250625 14:01:56.048297 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf7e6d24347a88da2ee8fbd6de1b1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.048425 11782 raft_consensus.cc:3058] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.048557 11530 catalog_manager.cc:5582] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:56.048867 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 3c825977e422407486587f28af36bd68 (table default.Table_2928b645415547419a21192f44ad81ab [id=c7bfff2cc8b84a5d83719cd96bc5af9c]). Expected version 2 got 0
I20250625 14:01:56.048934 12173 ts_tablet_manager.cc:1939] T 25160014ecf74c2ab6f1faca42d30c47 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.049392 11782 raft_consensus.cc:2466] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.049794 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 25160014ecf74c2ab6f1faca42d30c47 (table default.Table_1bc57951e55e40f2aa6b5736e5f9b500 [id=c8ce791eeb3845f2ba3e8ad40955506b]) successfully deleted
I20250625 14:01:56.049825 12177 ts_tablet_manager.cc:1905] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.050036 12173 tablet_replica.cc:331] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.050160 12173 raft_consensus.cc:2241] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.050254 12173 raft_consensus.cc:2270] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.051797 12175 tablet_replica.cc:331] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.051949 12175 raft_consensus.cc:2241] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.052055 12175 raft_consensus.cc:2270] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.052105 11858 leader_election.cc:304] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.052345 12177 ts_tablet_manager.cc:1918] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.052421 12177 log.cc:1199] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9077aa58d4d5488d812e71da4407d87b
I20250625 14:01:56.052634 12177 ts_tablet_manager.cc:1939] T 9077aa58d4d5488d812e71da4407d87b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.052937 12600 raft_consensus.cc:2802] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.053042 12600 raft_consensus.cc:695] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.053171 12600 consensus_queue.cc:237] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.053726 12175 ts_tablet_manager.cc:1905] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.055817 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 94232e8e88e84350b5f150a6eb433c92 (DEFAULT_TABLE table=default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.056157 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94232e8e88e84350b5f150a6eb433c92. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.056268 11855 leader_election.cc:343] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:56.056454 11855 leader_election.cc:343] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.057590 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f47cf7e6d24347a88da2ee8fbd6de1b1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.058873 11855 leader_election.cc:343] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.058902 12177 tablet_replica.cc:331] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.059041 12177 raft_consensus.cc:2241] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.059142 12177 raft_consensus.cc:2270] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.059630 12177 ts_tablet_manager.cc:1905] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.059957 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 94232e8e88e84350b5f150a6eb433c92 (DEFAULT_TABLE table=default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.060216 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94232e8e88e84350b5f150a6eb433c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.061825 12177 ts_tablet_manager.cc:1918] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.061890 12177 log.cc:1199] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e7260f6c81d64415ae2469f87fe46c55
I20250625 14:01:56.062644 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9da1d3ee457944399e60e0c5bdd8c428" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.062786 12055 raft_consensus.cc:2466] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.062083 12177 ts_tablet_manager.cc:1939] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.063117 11717 leader_election.cc:304] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:56.063235 11717 raft_consensus.cc:2684] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:56.063297 12177 tablet_replica.cc:331] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:01:56.063356 11717 leader_election.cc:343] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 9da1d3ee457944399e60e0c5bdd8c428
W20250625 14:01:56.063468 11717 leader_election.cc:343] T e7260f6c81d64415ae2469f87fe46c55 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.063580 12177 raft_consensus.cc:2241] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.063547 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 07497399a6cd463f8d20d33d9db1d46b (DEFAULT_TABLE table=default.Table_fde1c3b5b39545068fc40abb87f0c6cb [id=29e750f2b74b4d67bab90a78c61c84b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.063851 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07497399a6cd463f8d20d33d9db1d46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.069247 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 39ff4b0e7ac74ec294550775aaa44468 (table default.Table_7887db4b4d5c4f2a8770f9f0b73832ec [id=12bf9473cabd4d199715d23c94a02005]) successfully deleted
I20250625 14:01:56.069363 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ba5051d3c58145379e1e1753df46232f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.069584 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9f894ff0b3064204a192a649afb51078"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.069824 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba5051d3c58145379e1e1753df46232f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:56.069963 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f894ff0b3064204a192a649afb51078 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.070300 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 34806da4b2ec4c2db13322952bf943c5 (DEFAULT_TABLE table=default.Table_a34ff03966644dd1bae2a02ecffbae31 [id=004a35a086c44e80ba9e1db51f81d375]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.069386 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b0ebdaac5dcb4ca0abae0f22dd521551"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.070874 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_95f72537a1a6427d90687b9ce3844506"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.070976 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34806da4b2ec4c2db13322952bf943c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.070999 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:56.071187 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95f72537a1a6427d90687b9ce3844506 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.071446 12177 raft_consensus.cc:2270] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.071786 11901 tablet_service.cc:1468] Processing CreateTablet for tablet fe7e0145fb2f48c29259afafcbe29599 (DEFAULT_TABLE table=default.Table_57f7d205bb304fd8982fcd30bb558c54 [id=3d7b081834c54daba8172abc85c60576]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.063854 11717 leader_election.cc:304] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:01:56.072139 12177 ts_tablet_manager.cc:1905] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:56.072206 11717 raft_consensus.cc:2684] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:56.072547 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7e0145fb2f48c29259afafcbe29599. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.072875 12666 raft_consensus.cc:491] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.072949 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 07497399a6cd463f8d20d33d9db1d46b (DEFAULT_TABLE table=default.Table_fde1c3b5b39545068fc40abb87f0c6cb [id=29e750f2b74b4d67bab90a78c61c84b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.072969 12666 raft_consensus.cc:513] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.073210 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07497399a6cd463f8d20d33d9db1d46b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.073444 12666 leader_election.cc:290] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.074290 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 39ff4b0e7ac74ec294550775aaa44468 (table default.Table_7887db4b4d5c4f2a8770f9f0b73832ec [id=12bf9473cabd4d199715d23c94a02005]) successfully deleted
I20250625 14:01:56.074460 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0764c545c28d4a3c82093556ae3f970b" } modify_external_catalogs: true
W20250625 14:01:56.074574 11990 leader_election.cc:343] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 92984f3be8454a969b7c39af97a11479
W20250625 14:01:56.074708 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7b78fd0d543449bdb2e95fee6a53e93f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b78fd0d543449bdb2e95fee6a53e93f already in progress: creating tablet
I20250625 14:01:56.075004 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9077aa58d4d5488d812e71da4407d87b (table default.Table_aad2dbed98a440f19cf6aa8608d96780 [id=c485676a21514b95bab0990f6807c5c7]) successfully deleted
I20250625 14:01:56.075150 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e7260f6c81d64415ae2469f87fe46c55 (table default.Table_66c17881414348d49722f825bff86a90 [id=264c5ba782504673b9d5e2caeac31b31]) successfully deleted
I20250625 14:01:56.075588 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 94232e8e88e84350b5f150a6eb433c92 (DEFAULT_TABLE table=default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea [id=9bd1814bba0a43fa8a66a50e91ef165f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.075531 12177 ts_tablet_manager.cc:1918] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.075789 12177 log.cc:1199] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9da1d3ee457944399e60e0c5bdd8c428
I20250625 14:01:56.075845 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94232e8e88e84350b5f150a6eb433c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.076035 12177 ts_tablet_manager.cc:1939] T 9da1d3ee457944399e60e0c5bdd8c428 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.076613 12177 tablet_replica.cc:331] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.076756 12177 raft_consensus.cc:2241] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.076875 12177 raft_consensus.cc:2270] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.077915 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "92984f3be8454a969b7c39af97a11479" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.078061 11782 raft_consensus.cc:2391] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:56.078694 12177 ts_tablet_manager.cc:1905] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.079150 11993 leader_election.cc:304] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.079370 12666 raft_consensus.cc:3058] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.079735 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9da1d3ee457944399e60e0c5bdd8c428 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
I20250625 14:01:56.080421 12666 raft_consensus.cc:2747] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.080571 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0764c545c28d4a3c82093556ae3f970b" } modify_external_catalogs: true
I20250625 14:01:56.081182 12166 tablet_bootstrap.cc:492] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.081290 12166 ts_tablet_manager.cc:1397] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.152s user 0.001s sys 0.002s
I20250625 14:01:56.081763 12177 ts_tablet_manager.cc:1918] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.081826 12177 log.cc:1199] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/205f83a0ffbc440492e241a75657f1b8
I20250625 14:01:56.081777 12166 raft_consensus.cc:357] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.081872 12166 raft_consensus.cc:383] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.081899 12166 raft_consensus.cc:738] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.082024 12177 ts_tablet_manager.cc:1939] T 205f83a0ffbc440492e241a75657f1b8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.082019 12166 consensus_queue.cc:260] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.082342 12166 ts_tablet_manager.cc:1428] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.082572 12166 tablet_bootstrap.cc:492] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.082607 12167 tablet_bootstrap.cc:492] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.082692 12167 ts_tablet_manager.cc:1397] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.000s
I20250625 14:01:56.083158 12167 raft_consensus.cc:357] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.083272 12167 raft_consensus.cc:383] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.083307 12167 raft_consensus.cc:738] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.083417 12167 consensus_queue.cc:260] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.083621 12166 tablet_bootstrap.cc:654] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.083675 12167 ts_tablet_manager.cc:1428] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.083880 12167 tablet_bootstrap.cc:492] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.085049 12167 tablet_bootstrap.cc:654] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.090868 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 339813cd0c194f07bfc4edefd6a05ef3) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.092990 12175 ts_tablet_manager.cc:1918] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.100286 12167 tablet_bootstrap.cc:492] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.100325 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 205f83a0ffbc440492e241a75657f1b8 (table default.Table_56b605b35a0d4335b2916c5748f8ab38 [id=f7efaf49a2fe422185ac18faf97835b0]) successfully deleted
I20250625 14:01:56.100404 12167 ts_tablet_manager.cc:1397] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.002s
I20250625 14:01:56.100576 12177 tablet_replica.cc:331] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.099170 12166 tablet_bootstrap.cc:492] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.100860 12166 ts_tablet_manager.cc:1397] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.002s
I20250625 14:01:56.100910 12167 raft_consensus.cc:357] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.101029 12167 raft_consensus.cc:383] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.101065 12167 raft_consensus.cc:738] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.101217 12167 consensus_queue.cc:260] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.101334 12166 raft_consensus.cc:357] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.101431 12166 raft_consensus.cc:383] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.101459 12166 raft_consensus.cc:738] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.101512 12167 ts_tablet_manager.cc:1428] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.101564 12166 consensus_queue.cc:260] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.101708 12167 tablet_bootstrap.cc:492] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.101799 12166 ts_tablet_manager.cc:1428] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.101990 12166 tablet_bootstrap.cc:492] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.102757 12167 tablet_bootstrap.cc:654] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.103165 12166 tablet_bootstrap.cc:654] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.107807 12175 log.cc:1199] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6bcdf4d901e34ab5ba2c36fe53456f0e
I20250625 14:01:56.108062 12177 raft_consensus.cc:2241] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.108413 12175 ts_tablet_manager.cc:1939] T 6bcdf4d901e34ab5ba2c36fe53456f0e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.108606 12177 raft_consensus.cc:2270] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.106648 12208 raft_consensus.cc:491] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.108805 12208 raft_consensus.cc:513] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.110203 12175 tablet_replica.cc:331] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.110388 12175 raft_consensus.cc:2241] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.110495 12175 raft_consensus.cc:2270] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.111068 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet fbf41efa64294f388894a9a57b45fdc2 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.111673 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet db4a9e4dfdd145bab965004ee5562e2b from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.112156 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6bcdf4d901e34ab5ba2c36fe53456f0e (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:56.112376 12175 ts_tablet_manager.cc:1905] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.112660 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b82e99ecc994068b7823ef75d5b233f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.112963 12208 leader_election.cc:290] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:01:56.113186 11717 leader_election.cc:343] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: Tablet not RUNNING: STOPPED
I20250625 14:01:56.113533 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b82e99ecc994068b7823ef75d5b233f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.114349 12177 ts_tablet_manager.cc:1905] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:56.114449 11717 leader_election.cc:343] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.114522 11717 leader_election.cc:304] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.114750 12238 raft_consensus.cc:2747] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.115715 12265 raft_consensus.cc:491] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.115804 12265 raft_consensus.cc:513] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.116194 12265 leader_election.cc:290] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.116817 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7ede0ddacb74e39b07f175b5ef2a2c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.116955 12167 tablet_bootstrap.cc:492] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.117056 12167 ts_tablet_manager.cc:1397] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
W20250625 14:01:56.117262 11855 leader_election.cc:343] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.117635 12167 raft_consensus.cc:357] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.117741 12167 raft_consensus.cc:383] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.117774 12167 raft_consensus.cc:738] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.117903 12167 consensus_queue.cc:260] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.118227 12167 ts_tablet_manager.cc:1428] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:56.118408 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet a7ede0ddacb74e39b07f175b5ef2a2c5 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.118445 12167 tablet_bootstrap.cc:492] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.119541 12167 tablet_bootstrap.cc:654] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.119735 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e28b81e130be4741a8b96e733248cf1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.120143 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e28b81e130be4741a8b96e733248cf1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.120234 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7ede0ddacb74e39b07f175b5ef2a2c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.120368 11782 raft_consensus.cc:2466] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.121528 11858 leader_election.cc:304] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.121590 12175 ts_tablet_manager.cc:1918] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.121665 12175 log.cc:1199] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8b82e99ecc994068b7823ef75d5b233f
I20250625 14:01:56.121798 12265 raft_consensus.cc:2802] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.121855 12265 raft_consensus.cc:491] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.121896 12265 raft_consensus.cc:3058] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.123308 12265 raft_consensus.cc:513] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.123708 12265 leader_election.cc:290] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.124377 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7ede0ddacb74e39b07f175b5ef2a2c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.124504 11782 raft_consensus.cc:3058] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.124591 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7ede0ddacb74e39b07f175b5ef2a2c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.124972 11855 leader_election.cc:343] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.125244 12172 tablet_bootstrap.cc:492] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.125330 12172 ts_tablet_manager.cc:1397] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.092s user 0.002s sys 0.000s
I20250625 14:01:56.125492 11782 raft_consensus.cc:2466] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.125809 11858 leader_election.cc:304] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.125859 12172 raft_consensus.cc:357] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.125926 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 205f83a0ffbc440492e241a75657f1b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.125980 12172 raft_consensus.cc:383] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.126015 12172 raft_consensus.cc:738] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.126041 12175 ts_tablet_manager.cc:1939] T 8b82e99ecc994068b7823ef75d5b233f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.126154 12172 consensus_queue.cc:260] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.126482 12172 ts_tablet_manager.cc:1428] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.126695 12172 tablet_bootstrap.cc:492] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.126780 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8b82e99ecc994068b7823ef75d5b233f (table default.Table_06a503f6355b478caf948985a84c15f6 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
I20250625 14:01:56.127025 12175 tablet_replica.cc:331] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.127177 12175 raft_consensus.cc:2241] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.127290 12175 raft_consensus.cc:2270] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.127897 12265 raft_consensus.cc:2802] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.127941 12172 tablet_bootstrap.cc:654] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.128002 12265 raft_consensus.cc:695] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.128033 12175 ts_tablet_manager.cc:1905] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.128111 12265 consensus_queue.cc:237] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.130517 12175 ts_tablet_manager.cc:1918] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.130589 12175 log.cc:1199] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e7260f6c81d64415ae2469f87fe46c55
I20250625 14:01:56.130789 12175 ts_tablet_manager.cc:1939] T e7260f6c81d64415ae2469f87fe46c55 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.131393 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e7260f6c81d64415ae2469f87fe46c55 (table default.Table_66c17881414348d49722f825bff86a90 [id=264c5ba782504673b9d5e2caeac31b31]) successfully deleted
I20250625 14:01:56.132573 12172 tablet_bootstrap.cc:492] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.132670 12172 ts_tablet_manager.cc:1397] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:56.133123 12172 raft_consensus.cc:357] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.133253 12172 raft_consensus.cc:383] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.133293 12172 raft_consensus.cc:738] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.133780 12166 tablet_bootstrap.cc:492] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.133872 12166 ts_tablet_manager.cc:1397] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:01:56.133445 12172 consensus_queue.cc:260] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.134150 12172 ts_tablet_manager.cc:1428] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.134352 12172 tablet_bootstrap.cc:492] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.134346 12166 raft_consensus.cc:357] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.134447 12166 raft_consensus.cc:383] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.134480 12166 raft_consensus.cc:738] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.134591 12166 consensus_queue.cc:260] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.134861 12166 ts_tablet_manager.cc:1428] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.135051 12166 tablet_bootstrap.cc:492] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.135681 12172 tablet_bootstrap.cc:654] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.136014 12166 tablet_bootstrap.cc:654] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.136612 12175 tablet_replica.cc:331] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.136735 12175 raft_consensus.cc:2241] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.136884 12175 pending_rounds.cc:70] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:56.136914 12175 pending_rounds.cc:77] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523035355230208 op_type: NO_OP noop_request { }
I20250625 14:01:56.136961 12175 raft_consensus.cc:2887] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.137010 12175 raft_consensus.cc:2270] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.138548 12175 ts_tablet_manager.cc:1905] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.139052 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1e3673ebd97b4210b4ca490b2dd1fb06" } new_table_name: "default.Table_6c025a609dc74d37a082a5050f756463" modify_external_catalogs: true
I20250625 14:01:56.140314 12173 ts_tablet_manager.cc:1905] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.144640 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e97f0540e97b415fa28869e09d50620e" } modify_external_catalogs: true
I20250625 14:01:56.144774 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e97f0540e97b415fa28869e09d50620e" } modify_external_catalogs: true
I20250625 14:01:56.145087 12173 ts_tablet_manager.cc:1918] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.145196 12173 log.cc:1199] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d4a1580aeb4a4c1787c32b4d23e0fcaa
I20250625 14:01:56.147246 12175 ts_tablet_manager.cc:1918] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.147347 12175 log.cc:1199] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f47cf7e6d24347a88da2ee8fbd6de1b1
I20250625 14:01:56.147619 12175 ts_tablet_manager.cc:1939] T f47cf7e6d24347a88da2ee8fbd6de1b1 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.148448 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f47cf7e6d24347a88da2ee8fbd6de1b1 (table default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]) successfully deleted
I20250625 14:01:56.148885 12177 ts_tablet_manager.cc:1918] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.148981 12177 log.cc:1199] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/68a0cfeac48042bdaea66c3b0e370480
I20250625 14:01:56.149238 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d0f93962f9df42408804933938d2595c" } modify_external_catalogs: true
I20250625 14:01:56.149350 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d0f93962f9df42408804933938d2595c" } modify_external_catalogs: true
I20250625 14:01:56.149576 12175 tablet_replica.cc:331] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.149740 12175 raft_consensus.cc:2241] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.149940 12175 raft_consensus.cc:2270] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.150370 12175 ts_tablet_manager.cc:1905] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.152575 11532 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:56.153026 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ba88e68554e349be85cfbc86283df3e7" } modify_external_catalogs: true
I20250625 14:01:56.153126 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ba88e68554e349be85cfbc86283df3e7" } modify_external_catalogs: true
I20250625 14:01:56.154532 12238 raft_consensus.cc:491] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.154748 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 (DEFAULT_TABLE table=default.Table_59df2339a1ce4fcba83a683bad90e026 [id=0719452dd3df4a8bb8668b9b63c62cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.154780 12238 raft_consensus.cc:513] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.155036 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd0fc7e8ef430ea2cef302f67b8b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.155222 12238 leader_election.cc:290] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.155309 12238 raft_consensus.cc:491] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.155369 12238 raft_consensus.cc:513] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.155664 12238 leader_election.cc:290] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.155969 12177 ts_tablet_manager.cc:1939] T 68a0cfeac48042bdaea66c3b0e370480 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.156412 12175 ts_tablet_manager.cc:1918] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.156482 12175 log.cc:1199] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/1a3907e22505461a8df58ec339c342da
I20250625 14:01:56.156790 12175 ts_tablet_manager.cc:1939] T 1a3907e22505461a8df58ec339c342da P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.157171 12166 tablet_bootstrap.cc:492] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.157258 12166 ts_tablet_manager.cc:1397] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:01:56.157792 12166 raft_consensus.cc:357] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.157905 12166 raft_consensus.cc:383] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.157948 12166 raft_consensus.cc:738] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.158082 12166 consensus_queue.cc:260] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.158475 12166 ts_tablet_manager.cc:1428] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.158496 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 1a3907e22505461a8df58ec339c342da (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]) successfully deleted
I20250625 14:01:56.158681 12166 tablet_bootstrap.cc:492] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.158763 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 (DEFAULT_TABLE table=default.Table_dc38af2e12bd48faa284df718dff16f9 [id=e6793d23bb264d259e9d0218259fea14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.159004 11894 tablet_service.cc:1468] Processing CreateTablet for tablet c1c05e534c804eb69e0c249a03418941 (DEFAULT_TABLE table=default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.159053 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c68ae7ecff34d34baaffe47c740bac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.159202 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c05e534c804eb69e0c249a03418941. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.159797 12166 tablet_bootstrap.cc:654] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.159976 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_25ca21504a3f4d0ebd04eefc325912f4 [id=21f01c21cb3f40769f25c95f3f986449]). Expected version 2 got 0
I20250625 14:01:56.160535 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_82021dac408c42e9898349055acf8936" } modify_external_catalogs: true
I20250625 14:01:56.160642 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_82021dac408c42e9898349055acf8936" } modify_external_catalogs: true
I20250625 14:01:56.160673 11893 tablet_service.cc:1468] Processing CreateTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 (DEFAULT_TABLE table=default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.160940 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5ed5d8d3ca4342980c893a8653d4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.161268 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 (DEFAULT_TABLE table=default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.161468 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc5b8ea4f3b47f19c603c235fa79007. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.161866 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 237ca3218ae84a0b8354f328b91dfab4 (DEFAULT_TABLE table=default.Table_6d4a606cc39f4c5991ebd75363e1b078 [id=1e61ba0bd36547af93e0c50f5b069faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.161911 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 68a0cfeac48042bdaea66c3b0e370480 (table default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
I20250625 14:01:56.162074 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237ca3218ae84a0b8354f328b91dfab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.162498 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 3e8c6789c3b14bc88c2538c34d72a3a4 (DEFAULT_TABLE table=default.Table_b67c4059a8a6481d9f5d4457639fd851 [id=0124ee9b76f248ca8689a835beead152]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.162778 11899 tablet_service.cc:1468] Processing CreateTablet for tablet e98a2085fe67479db141b2675f69a2d9 (DEFAULT_TABLE table=default.Table_12a1e16f6b284bbca04f3f1c10950265 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.163067 11895 tablet_service.cc:1468] Processing CreateTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 (DEFAULT_TABLE table=default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.163327 11902 tablet_service.cc:1468] Processing CreateTablet for tablet c2307a7c00204e8fa1a14b5112659d91 (DEFAULT_TABLE table=default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.164103 12238 raft_consensus.cc:491] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.164223 12238 raft_consensus.cc:513] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.164614 12238 leader_election.cc:290] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.156632 12177 tablet_replica.cc:331] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.165964 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet dce48b28d6634330bcfa6e28d9f0c49d
I20250625 14:01:56.166071 12177 raft_consensus.cc:2241] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.166206 12177 raft_consensus.cc:2270] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.146986 12167 tablet_bootstrap.cc:492] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.151402 12666 raft_consensus.cc:491] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.166441 12167 ts_tablet_manager.cc:1397] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20250625 14:01:56.166502 12666 raft_consensus.cc:513] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.166879 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet dce48b28d6634330bcfa6e28d9f0c49d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.166935 12666 leader_election.cc:290] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.167001 12666 raft_consensus.cc:491] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.167057 12666 raft_consensus.cc:513] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:56.167071 12167 raft_consensus.cc:357] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.167188 12167 raft_consensus.cc:383] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.167224 12167 raft_consensus.cc:738] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.167330 12167 consensus_queue.cc:260] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.167398 12666 leader_election.cc:290] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.167636 12167 ts_tablet_manager.cc:1428] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.167842 12167 tablet_bootstrap.cc:492] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.168799 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2307a7c00204e8fa1a14b5112659d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.168886 12167 tablet_bootstrap.cc:654] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.169175 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98a2085fe67479db141b2675f69a2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.169462 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9e2afd5bc443398293d0ed572f6c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.169571 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet dce48b28d6634330bcfa6e28d9f0c49d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.169724 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8c6789c3b14bc88c2538c34d72a3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.157970 12668 raft_consensus.cc:491] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.169898 12173 ts_tablet_manager.cc:1939] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.169956 12668 raft_consensus.cc:513] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:56.170364 12668 leader_election.cc:290] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.170576 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d4a1580aeb4a4c1787c32b4d23e0fcaa (table default.Table_6e0ca353af7d4a4aa7179de57cc9c962 [id=a4aac54fe4334c33b6fdbb81c472f827]) successfully deleted
I20250625 14:01:56.158798 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8363c9c6dab64a30b08ab92a152a3ee5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.170892 11919 raft_consensus.cc:2466] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.171046 12177 ts_tablet_manager.cc:1905] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.162943 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6bcdf4d901e34ab5ba2c36fe53456f0e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.163094 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8363c9c6dab64a30b08ab92a152a3ee5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.163173 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 (DEFAULT_TABLE table=default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.173195 12173 tablet_replica.cc:331] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.173257 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc5b8ea4f3b47f19c603c235fa79007. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.173341 12173 raft_consensus.cc:2241] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.173467 12173 raft_consensus.cc:2270] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.174243 12172 tablet_bootstrap.cc:492] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.174376 12172 ts_tablet_manager.cc:1397] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250625 14:01:56.174825 12172 raft_consensus.cc:357] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.174937 12172 raft_consensus.cc:383] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.174971 12172 raft_consensus.cc:738] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.175100 12172 consensus_queue.cc:260] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.175408 12172 ts_tablet_manager.cc:1428] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:56.175607 12172 tablet_bootstrap.cc:492] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.176620 12172 tablet_bootstrap.cc:654] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.163319 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 (DEFAULT_TABLE table=default.Table_59df2339a1ce4fcba83a683bad90e026 [id=0719452dd3df4a8bb8668b9b63c62cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.177124 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd0fc7e8ef430ea2cef302f67b8b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.163378 12035 tablet_service.cc:1468] Processing CreateTablet for tablet e98a2085fe67479db141b2675f69a2d9 (DEFAULT_TABLE table=default.Table_12a1e16f6b284bbca04f3f1c10950265 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.163614 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 (DEFAULT_TABLE table=default.Table_dc38af2e12bd48faa284df718dff16f9 [id=e6793d23bb264d259e9d0218259fea14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.179524 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98a2085fe67479db141b2675f69a2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.163709 12033 tablet_service.cc:1468] Processing CreateTablet for tablet d3693e166c2c4af0b7a8f7994507de2c (DEFAULT_TABLE table=default.Table_a509f117fbe5458fafb958447f82921d [id=41869cf657a84d8481d779530f631972]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.179708 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3693e166c2c4af0b7a8f7994507de2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.181151 11717 leader_election.cc:343] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.163805 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 3e8c6789c3b14bc88c2538c34d72a3a4 (DEFAULT_TABLE table=default.Table_b67c4059a8a6481d9f5d4457639fd851 [id=0124ee9b76f248ca8689a835beead152]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:56.181303 11717 leader_election.cc:343] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:56.181401 11717 leader_election.cc:343] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 6bcdf4d901e34ab5ba2c36fe53456f0e
I20250625 14:01:56.163875 12032 tablet_service.cc:1468] Processing CreateTablet for tablet c1c05e534c804eb69e0c249a03418941 (DEFAULT_TABLE table=default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.181452 11717 leader_election.cc:304] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.164053 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 237ca3218ae84a0b8354f328b91dfab4 (DEFAULT_TABLE table=default.Table_6d4a606cc39f4c5991ebd75363e1b078 [id=1e61ba0bd36547af93e0c50f5b069faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.164053 12028 tablet_service.cc:1468] Processing CreateTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 (DEFAULT_TABLE table=default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.181689 11717 leader_election.cc:304] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.164297 12037 tablet_service.cc:1468] Processing CreateTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 (DEFAULT_TABLE table=default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.164502 12027 tablet_service.cc:1468] Processing CreateTablet for tablet c2307a7c00204e8fa1a14b5112659d91 (DEFAULT_TABLE table=default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.181905 12166 tablet_bootstrap.cc:492] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.181995 12166 ts_tablet_manager.cc:1397] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:56.181875 12208 raft_consensus.cc:2747] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.182363 12208 raft_consensus.cc:2802] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.182427 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c05e534c804eb69e0c249a03418941. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.182593 12166 raft_consensus.cc:357] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.182706 12166 raft_consensus.cc:383] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.182637 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 (DEFAULT_TABLE table=default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.182737 12166 raft_consensus.cc:738] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.182847 12166 consensus_queue.cc:260] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.182910 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dc5b8ea4f3b47f19c603c235fa79007. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.183127 12166 ts_tablet_manager.cc:1428] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.183331 12166 tablet_bootstrap.cc:492] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.183466 11761 tablet_service.cc:1468] Processing CreateTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 (DEFAULT_TABLE table=default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.183735 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5ed5d8d3ca4342980c893a8653d4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.183923 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 237ca3218ae84a0b8354f328b91dfab4 (DEFAULT_TABLE table=default.Table_6d4a606cc39f4c5991ebd75363e1b078 [id=1e61ba0bd36547af93e0c50f5b069faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.184137 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237ca3218ae84a0b8354f328b91dfab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.184499 12166 tablet_bootstrap.cc:654] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.185253 11754 tablet_service.cc:1468] Processing CreateTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 (DEFAULT_TABLE table=default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.185299 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 (DEFAULT_TABLE table=default.Table_59df2339a1ce4fcba83a683bad90e026 [id=0719452dd3df4a8bb8668b9b63c62cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.185451 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet dce48b28d6634330bcfa6e28d9f0c49d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.185489 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bd0fc7e8ef430ea2cef302f67b8b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.185828 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9e2afd5bc443398293d0ed572f6c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.186069 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7f797fe89204fa18340bfb43ab36cbf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.186136 11759 tablet_service.cc:1468] Processing CreateTablet for tablet e98a2085fe67479db141b2675f69a2d9 (DEFAULT_TABLE table=default.Table_12a1e16f6b284bbca04f3f1c10950265 [id=f25d25a79da644d082f3ae135c27f354]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.186398 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98a2085fe67479db141b2675f69a2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.187505 11757 tablet_service.cc:1468] Processing CreateTablet for tablet d3693e166c2c4af0b7a8f7994507de2c (DEFAULT_TABLE table=default.Table_a509f117fbe5458fafb958447f82921d [id=41869cf657a84d8481d779530f631972]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.187723 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3693e166c2c4af0b7a8f7994507de2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.188856 11993 leader_election.cc:343] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 4617bb8a015d42188beba9df61df2c9f
I20250625 14:01:56.188906 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237ca3218ae84a0b8354f328b91dfab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.182415 12208 raft_consensus.cc:491] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.188987 12208 raft_consensus.cc:3058] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.188985 11993 leader_election.cc:343] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: dbdc3547d8de48e8887ffeb5b0f71f82
I20250625 14:01:56.189843 12208 raft_consensus.cc:513] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.189951 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 (DEFAULT_TABLE table=default.Table_dc38af2e12bd48faa284df718dff16f9 [id=e6793d23bb264d259e9d0218259fea14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.190164 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c68ae7ecff34d34baaffe47c740bac6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.190162 11990 leader_election.cc:343] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 4617bb8a015d42188beba9df61df2c9f
I20250625 14:01:56.190224 11990 leader_election.cc:304] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.190228 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8c6789c3b14bc88c2538c34d72a3a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.190493 11990 leader_election.cc:343] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 68a0cfeac48042bdaea66c3b0e370480
W20250625 14:01:56.190583 11990 leader_election.cc:343] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: dbdc3547d8de48e8887ffeb5b0f71f82
I20250625 14:01:56.190546 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7f797fe89204fa18340bfb43ab36cbf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.190620 11990 leader_election.cc:304] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.190676 11921 raft_consensus.cc:2466] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.190956 12208 leader_election.cc:290] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.191059 12668 raft_consensus.cc:2747] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.191169 12668 raft_consensus.cc:2747] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.191639 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c68ae7ecff34d34baaffe47c740bac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.192158 11762 tablet_service.cc:1468] Processing CreateTablet for tablet c1c05e534c804eb69e0c249a03418941 (DEFAULT_TABLE table=default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.192353 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c05e534c804eb69e0c249a03418941. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.192768 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5ed5d8d3ca4342980c893a8653d4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.193897 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2307a7c00204e8fa1a14b5112659d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.194459 11760 tablet_service.cc:1468] Processing CreateTablet for tablet c2307a7c00204e8fa1a14b5112659d91 (DEFAULT_TABLE table=default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.194687 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2307a7c00204e8fa1a14b5112659d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.195389 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc9e2afd5bc443398293d0ed572f6c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.196902 11717 leader_election.cc:304] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:56.197103 11717 leader_election.cc:343] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.197383 12238 raft_consensus.cc:2802] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.197438 12238 raft_consensus.cc:491] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.197474 12238 raft_consensus.cc:3058] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.197512 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8363c9c6dab64a30b08ab92a152a3ee5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.197774 11993 leader_election.cc:343] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 68a0cfeac48042bdaea66c3b0e370480
I20250625 14:01:56.197839 11993 leader_election.cc:304] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.198400 12666 raft_consensus.cc:2747] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.198446 12238 raft_consensus.cc:513] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.198777 12238 leader_election.cc:290] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.199013 11782 raft_consensus.cc:1273] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:56.199182 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 3e8c6789c3b14bc88c2538c34d72a3a4 (DEFAULT_TABLE table=default.Table_b67c4059a8a6481d9f5d4457639fd851 [id=0124ee9b76f248ca8689a835beead152]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.199425 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8c6789c3b14bc88c2538c34d72a3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.200491 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8363c9c6dab64a30b08ab92a152a3ee5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.200625 11919 raft_consensus.cc:3058] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.201675 11919 raft_consensus.cc:2466] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.202258 12175 tablet_replica.cc:331] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.202194 12558 consensus_queue.cc:1035] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.202440 12175 raft_consensus.cc:2241] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.202549 12175 raft_consensus.cc:2270] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.203101 12175 ts_tablet_manager.cc:1905] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:56.203711 11855 consensus_peers.cc:487] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:56.205505 12166 tablet_bootstrap.cc:492] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.205610 12166 ts_tablet_manager.cc:1397] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:01:56.206017 12208 raft_consensus.cc:491] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.206148 12208 raft_consensus.cc:513] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.206544 12208 leader_election.cc:290] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.206562 12166 raft_consensus.cc:357] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.206676 12166 raft_consensus.cc:383] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.206727 12166 raft_consensus.cc:738] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.206902 12177 ts_tablet_manager.cc:1918] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.206868 12166 consensus_queue.cc:260] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.207211 12166 ts_tablet_manager.cc:1428] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.207329 11901 tablet_service.cc:1468] Processing CreateTablet for tablet d3693e166c2c4af0b7a8f7994507de2c (DEFAULT_TABLE table=default.Table_a509f117fbe5458fafb958447f82921d [id=41869cf657a84d8481d779530f631972]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.207415 12166 tablet_bootstrap.cc:492] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.208576 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3693e166c2c4af0b7a8f7994507de2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.210007 11717 leader_election.cc:304] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:56.210201 11717 leader_election.cc:343] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.210791 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c940a9f7ada54b48940e90c822c84735" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.210943 12208 raft_consensus.cc:2802] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.211236 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7f797fe89204fa18340bfb43ab36cbf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.211302 12208 raft_consensus.cc:695] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.211462 12208 consensus_queue.cc:237] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.211957 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c940a9f7ada54b48940e90c822c84735" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.212073 11921 raft_consensus.cc:2466] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.212354 12177 log.cc:1199] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/32d345da0f674704b8e1f23a74bac3ce
I20250625 14:01:56.212355 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a7f797fe89204fa18340bfb43ab36cbf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.212447 11919 raft_consensus.cc:3058] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.212718 12177 ts_tablet_manager.cc:1939] T 32d345da0f674704b8e1f23a74bac3ce P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.213471 11919 raft_consensus.cc:2466] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.213830 12166 tablet_bootstrap.cc:654] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.215425 12167 tablet_bootstrap.cc:492] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.215539 12167 ts_tablet_manager.cc:1397] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20250625 14:01:56.216089 12172 tablet_bootstrap.cc:492] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.216090 12167 raft_consensus.cc:357] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.216190 12172 ts_tablet_manager.cc:1397] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20250625 14:01:56.216207 12167 raft_consensus.cc:383] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.216248 12167 raft_consensus.cc:738] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.216209 11717 leader_election.cc:304] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.216387 12167 consensus_queue.cc:260] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.216420 11717 leader_election.cc:304] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.216535 12238 raft_consensus.cc:2802] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 14:01:56.216570 11717 leader_election.cc:343] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.216629 12238 raft_consensus.cc:695] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.216706 12167 ts_tablet_manager.cc:1428] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.216658 12172 raft_consensus.cc:357] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.216761 12172 raft_consensus.cc:383] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.216791 12172 raft_consensus.cc:738] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.216835 12238 consensus_queue.cc:237] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.216910 12167 tablet_bootstrap.cc:492] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.216890 12172 consensus_queue.cc:260] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.217146 12172 ts_tablet_manager.cc:1428] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.217314 12172 tablet_bootstrap.cc:492] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.217991 12167 tablet_bootstrap.cc:654] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.218259 12172 tablet_bootstrap.cc:654] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.216496 12208 raft_consensus.cc:2802] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.218556 12208 raft_consensus.cc:491] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.218621 12208 raft_consensus.cc:3058] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.219589 12430 tablet.cc:1722] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:56.220625 12233 tablet.cc:1722] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:56.221733 12208 raft_consensus.cc:513] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.222047 12175 ts_tablet_manager.cc:1918] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.222131 12175 log.cc:1199] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8363c9c6dab64a30b08ab92a152a3ee5
I20250625 14:01:56.222375 12175 ts_tablet_manager.cc:1939] T 8363c9c6dab64a30b08ab92a152a3ee5 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.223131 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8363c9c6dab64a30b08ab92a152a3ee5 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]) successfully deleted
I20250625 14:01:56.224964 12175 tablet_replica.cc:331] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.225127 12175 raft_consensus.cc:2241] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.225339 12175 raft_consensus.cc:2270] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.226871 12175 ts_tablet_manager.cc:1905] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:56.227381 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96ec205b0f31484a91054fedf619b9ab consensus state has no leader
I20250625 14:01:56.227862 12208 leader_election.cc:290] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.228236 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a7ede0ddacb74e39b07f175b5ef2a2c5
I20250625 14:01:56.228446 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:56.228494 11524 catalog_manager.cc:6652] ReplaceTablet: tablet a7ede0ddacb74e39b07f175b5ef2a2c5 deleted and replaced by tablet a4199634a8be4e359cc9707d4754cac9
I20250625 14:01:56.229063 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 68a0cfeac48042bdaea66c3b0e370480 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.229110 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_25ca21504a3f4d0ebd04eefc325912f4" } new_table_name: "default.Table_0d17996fd693448e97e67565ee825f38" modify_external_catalogs: true
I20250625 14:01:56.229390 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_91d650533d9e4a8a80674057cfcf6964" } new_table_name: "default.Table_06caae8b35634d028c7368ee9936151a" modify_external_catalogs: true
I20250625 14:01:56.229638 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dc9dee22497a48a2b7705efdac6aae7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.224713 12177 tablet_replica.cc:331] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:01:56.225577 11717 leader_election.cc:343] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.230001 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet cbd18834c5594897a2b16c7069a90c18
W20250625 14:01:56.230023 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc9dee22497a48a2b7705efdac6aae7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.230438 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet db4a9e4dfdd145bab965004ee5562e2b
I20250625 14:01:56.230688 11525 catalog_manager.cc:6652] ReplaceTablet: tablet db4a9e4dfdd145bab965004ee5562e2b deleted and replaced by tablet 140c1810e98741479c3754729409b46c
I20250625 14:01:56.230800 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 7541b0989fe04486be69997611bb8ca1 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.231426 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet a7ede0ddacb74e39b07f175b5ef2a2c5 with delete_type TABLET_DATA_DELETED (replaced by tablet a4199634a8be4e359cc9707d4754cac9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.231496 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0752a7f1371e42d68d83afe41d2f1da9
I20250625 14:01:56.231580 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 7302430d7e4a4610bfe271c114718d35 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b78fd0d543449bdb2e95fee6a53e93f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.231814 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet cbd18834c5594897a2b16c7069a90c18 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.231884 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fd48790fd8f847dba7cbe4437a3eb495"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.231967 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet cbd18834c5594897a2b16c7069a90c18 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.232227 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet a7ede0ddacb74e39b07f175b5ef2a2c5 with delete_type TABLET_DATA_DELETED (replaced by tablet a4199634a8be4e359cc9707d4754cac9) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:56.232252 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd48790fd8f847dba7cbe4437a3eb495 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.232509 12177 raft_consensus.cc:2241] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.232731 12177 pending_rounds.cc:70] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:56.232770 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.232765 12177 pending_rounds.cc:77] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523034890457088 op_type: NO_OP noop_request { }
I20250625 14:01:56.232836 12177 raft_consensus.cc:2887] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.232897 12177 raft_consensus.cc:2270] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.232899 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet db4a9e4dfdd145bab965004ee5562e2b with delete_type TABLET_DATA_DELETED (replaced by tablet 140c1810e98741479c3754729409b46c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.233186 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet db4a9e4dfdd145bab965004ee5562e2b with delete_type TABLET_DATA_DELETED (replaced by tablet 140c1810e98741479c3754729409b46c) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.233220 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.233798 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_25ca21504a3f4d0ebd04eefc325912f4 [id=21f01c21cb3f40769f25c95f3f986449]). Expected version 2 got 0
I20250625 14:01:56.235441 12172 tablet_bootstrap.cc:492] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.235549 12172 ts_tablet_manager.cc:1397] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.002s
I20250625 14:01:56.235666 12167 tablet_bootstrap.cc:492] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.235761 12167 ts_tablet_manager.cc:1397] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.001s
I20250625 14:01:56.236054 12172 raft_consensus.cc:357] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.236182 12172 raft_consensus.cc:383] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.236228 12172 raft_consensus.cc:738] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.236210 12167 raft_consensus.cc:357] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.236320 12167 raft_consensus.cc:383] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.236359 12167 raft_consensus.cc:738] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.236363 12172 consensus_queue.cc:260] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.236486 12167 consensus_queue.cc:260] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.236662 12172 ts_tablet_manager.cc:1428] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250625 14:01:56.236760 12167 ts_tablet_manager.cc:1428] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.236853 12172 tablet_bootstrap.cc:492] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.236966 12167 tablet_bootstrap.cc:492] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.237740 12177 ts_tablet_manager.cc:1905] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.237931 12172 tablet_bootstrap.cc:654] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.238066 12167 tablet_bootstrap.cc:654] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.238168 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_25ca21504a3f4d0ebd04eefc325912f4 [id=21f01c21cb3f40769f25c95f3f986449]). Expected version 2 got 0
I20250625 14:01:56.239699 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c940a9f7ada54b48940e90c822c84735" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.240182 11717 leader_election.cc:343] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.240263 12166 tablet_bootstrap.cc:492] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.240350 12166 ts_tablet_manager.cc:1397] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20250625 14:01:56.240512 11531 catalog_manager.cc:5582] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:56.240731 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_91d650533d9e4a8a80674057cfcf6964 [id=ccfb2f80b431431db5df92e0b400520c]). Expected version 1 got 0
I20250625 14:01:56.240813 12166 raft_consensus.cc:357] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.240921 12166 raft_consensus.cc:383] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.240947 12166 raft_consensus.cc:738] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.241104 12166 consensus_queue.cc:260] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.241494 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c940a9f7ada54b48940e90c822c84735" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.241607 11921 raft_consensus.cc:3058] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.242110 12166 ts_tablet_manager.cc:1428] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.242323 12166 tablet_bootstrap.cc:492] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.242627 11921 raft_consensus.cc:2466] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.242789 12172 tablet_bootstrap.cc:492] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.242885 12172 ts_tablet_manager.cc:1397] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:56.242930 12175 ts_tablet_manager.cc:1918] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.243002 12175 log.cc:1199] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/dce48b28d6634330bcfa6e28d9f0c49d
I20250625 14:01:56.243249 12175 ts_tablet_manager.cc:1939] T dce48b28d6634330bcfa6e28d9f0c49d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.243427 12166 tablet_bootstrap.cc:654] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.243371 12172 raft_consensus.cc:357] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.243476 12172 raft_consensus.cc:383] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.243508 12172 raft_consensus.cc:738] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.243644 12172 consensus_queue.cc:260] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.243939 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet dce48b28d6634330bcfa6e28d9f0c49d (table default.Table_0764c545c28d4a3c82093556ae3f970b [id=5f1140a89f654aa0874f801a35ffa3e8]) successfully deleted
I20250625 14:01:56.244221 11717 leader_election.cc:304] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.244362 12180 raft_consensus.cc:2802] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.244433 12180 raft_consensus.cc:695] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.244551 12180 consensus_queue.cc:237] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.245496 12172 ts_tablet_manager.cc:1428] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:56.246053 12172 tablet_bootstrap.cc:492] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.247714 12172 tablet_bootstrap.cc:654] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.248315 12167 tablet_bootstrap.cc:492] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.248410 12167 ts_tablet_manager.cc:1397] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20250625 14:01:56.248901 12167 raft_consensus.cc:357] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.249032 12167 raft_consensus.cc:383] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.249075 12167 raft_consensus.cc:738] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.249218 12167 consensus_queue.cc:260] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.249509 12167 ts_tablet_manager.cc:1428] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.249698 12167 tablet_bootstrap.cc:492] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.250945 12167 tablet_bootstrap.cc:654] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.252086 12175 tablet_replica.cc:331] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.252256 12175 raft_consensus.cc:2241] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.252434 12175 pending_rounds.cc:70] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:56.252468 12175 pending_rounds.cc:77] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523034251390976 op_type: NO_OP noop_request { }
I20250625 14:01:56.252535 12175 raft_consensus.cc:2887] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.252650 12175 raft_consensus.cc:2270] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.253674 12172 tablet_bootstrap.cc:492] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.253762 12172 ts_tablet_manager.cc:1397] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:56.253806 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 32d345da0f674704b8e1f23a74bac3ce (table default.Table_1aa440e8532d4a51a048ec92c4a363bf [id=f6b6cc48a6f54d6bb64dba30511a4c41]) successfully deleted
I20250625 14:01:56.251557 12177 ts_tablet_manager.cc:1918] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.253950 12177 log.cc:1199] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/aac4b7bbfad9493598b31a86e2c045c0
I20250625 14:01:56.254221 12177 ts_tablet_manager.cc:1939] T aac4b7bbfad9493598b31a86e2c045c0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.254357 12172 raft_consensus.cc:357] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.254458 12172 raft_consensus.cc:383] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.254489 12172 raft_consensus.cc:738] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.254616 12172 consensus_queue.cc:260] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.254853 12177 tablet_replica.cc:331] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.254894 12172 ts_tablet_manager.cc:1428] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.254980 12177 raft_consensus.cc:2241] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.255050 12172 tablet_bootstrap.cc:492] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.255775 12167 tablet_bootstrap.cc:492] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.255856 12167 ts_tablet_manager.cc:1397] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:56.256134 12172 tablet_bootstrap.cc:654] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.256381 12167 raft_consensus.cc:357] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.256493 12167 raft_consensus.cc:383] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.256528 12167 raft_consensus.cc:738] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.255064 12177 raft_consensus.cc:2270] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.256666 12167 consensus_queue.cc:260] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.253788 12175 ts_tablet_manager.cc:1905] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.256912 12666 raft_consensus.cc:491] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.256991 12666 raft_consensus.cc:513] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.257038 12177 ts_tablet_manager.cc:1905] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.257159 12167 ts_tablet_manager.cc:1428] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.257350 12167 tablet_bootstrap.cc:492] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.257865 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a2fd4408e4f4f06b5a1bc686402ee40" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.258344 12167 tablet_bootstrap.cc:654] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.257364 12666 leader_election.cc:290] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.259354 12175 ts_tablet_manager.cc:1918] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.259433 12175 log.cc:1199] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/cbd18834c5594897a2b16c7069a90c18
I20250625 14:01:56.259680 12175 ts_tablet_manager.cc:1939] T cbd18834c5594897a2b16c7069a90c18 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.259660 12177 ts_tablet_manager.cc:1918] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.259725 12177 log.cc:1199] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/92984f3be8454a969b7c39af97a11479
I20250625 14:01:56.259944 12177 ts_tablet_manager.cc:1939] T 92984f3be8454a969b7c39af97a11479 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.259979 12167 tablet_bootstrap.cc:492] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.260056 12167 ts_tablet_manager.cc:1397] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:01:56.260381 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet cbd18834c5594897a2b16c7069a90c18 (table default.Table_d0f93962f9df42408804933938d2595c [id=2b85fd3adb7f4584887aa464e3ba929f]) successfully deleted
I20250625 14:01:56.260571 12177 tablet_replica.cc:331] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.260524 12167 raft_consensus.cc:357] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.260625 12167 raft_consensus.cc:383] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.260654 12167 raft_consensus.cc:738] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.260699 12177 raft_consensus.cc:2241] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.260787 12177 raft_consensus.cc:2270] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.260776 12167 consensus_queue.cc:260] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.261089 12166 tablet_bootstrap.cc:492] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.261161 12177 ts_tablet_manager.cc:1905] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.261183 12166 ts_tablet_manager.cc:1397] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:01:56.261309 12167 ts_tablet_manager.cc:1428] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.261703 12166 raft_consensus.cc:357] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.261745 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2a2fd4408e4f4f06b5a1bc686402ee40" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.261813 12166 raft_consensus.cc:383] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.261850 12166 raft_consensus.cc:738] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.261874 11782 raft_consensus.cc:2391] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:56.261991 12166 consensus_queue.cc:260] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.262048 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet a7ede0ddacb74e39b07f175b5ef2a2c5 with delete_type TABLET_DATA_DELETED (replaced by tablet a4199634a8be4e359cc9707d4754cac9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.262169 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 339813cd0c194f07bfc4edefd6a05ef3) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.262184 11993 leader_election.cc:304] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.262251 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet cbd18834c5594897a2b16c7069a90c18 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.262369 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet db4a9e4dfdd145bab965004ee5562e2b with delete_type TABLET_DATA_DELETED (replaced by tablet 140c1810e98741479c3754729409b46c) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.262451 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.262550 12666 raft_consensus.cc:3058] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.263561 12666 raft_consensus.cc:2747] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.264425 12166 ts_tablet_manager.cc:1428] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:56.264619 12166 tablet_bootstrap.cc:492] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.265517 12167 tablet_bootstrap.cc:492] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.266347 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet aac4b7bbfad9493598b31a86e2c045c0 (table default.Table_eb9b89668d974648ad501f6f3863cd81 [id=fe0b85589c3e4db4b88979ef94ffec30]) successfully deleted
I20250625 14:01:56.266535 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 92984f3be8454a969b7c39af97a11479 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]) successfully deleted
I20250625 14:01:56.266813 12177 ts_tablet_manager.cc:1918] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.266909 12177 log.cc:1199] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7302430d7e4a4610bfe271c114718d35
I20250625 14:01:56.267016 12167 tablet_bootstrap.cc:654] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.267135 12177 ts_tablet_manager.cc:1939] T 7302430d7e4a4610bfe271c114718d35 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.268215 12166 tablet_bootstrap.cc:654] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.269181 12172 tablet_bootstrap.cc:492] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.269271 12172 ts_tablet_manager.cc:1397] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:01:56.269306 12167 tablet_bootstrap.cc:492] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.269376 12167 ts_tablet_manager.cc:1397] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20250625 14:01:56.269817 12167 raft_consensus.cc:357] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.269917 12167 raft_consensus.cc:383] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.269948 12167 raft_consensus.cc:738] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.270080 12167 consensus_queue.cc:260] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.270423 12167 ts_tablet_manager.cc:1428] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.270560 12175 tablet_replica.cc:331] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.270610 12167 tablet_bootstrap.cc:492] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.270563 12172 raft_consensus.cc:357] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.270661 12172 raft_consensus.cc:383] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.270692 12172 raft_consensus.cc:738] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.270691 12175 raft_consensus.cc:2241] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.270844 12175 pending_rounds.cc:70] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:56.270815 12172 consensus_queue.cc:260] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.270872 12175 pending_rounds.cc:77] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523035661967360 op_type: NO_OP noop_request { }
I20250625 14:01:56.270926 12175 raft_consensus.cc:2887] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.270988 12175 raft_consensus.cc:2270] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.271147 12172 ts_tablet_manager.cc:1428] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.271355 12172 tablet_bootstrap.cc:492] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.271654 12167 tablet_bootstrap.cc:654] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.272403 12172 tablet_bootstrap.cc:654] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.276767 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7302430d7e4a4610bfe271c114718d35 (table default.Table_3d82e197e7174db08e444c89b45c77be [id=1cf0251105444beca355668b5a0da27b]) successfully deleted
I20250625 14:01:56.276837 12177 tablet_replica.cc:331] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.276988 12177 raft_consensus.cc:2241] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.277149 12177 pending_rounds.cc:70] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:56.277190 12177 pending_rounds.cc:77] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523034719141888 op_type: NO_OP noop_request { }
I20250625 14:01:56.277247 12177 raft_consensus.cc:2887] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.277305 12177 raft_consensus.cc:2270] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.278146 12172 tablet_bootstrap.cc:492] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.278254 12172 ts_tablet_manager.cc:1397] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:56.279049 12166 tablet_bootstrap.cc:492] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.279105 12172 raft_consensus.cc:357] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.279177 12166 ts_tablet_manager.cc:1397] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:56.279203 12172 raft_consensus.cc:383] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.279235 12172 raft_consensus.cc:738] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.279664 12166 raft_consensus.cc:357] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.279762 12166 raft_consensus.cc:383] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.279793 12166 raft_consensus.cc:738] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.279925 12166 consensus_queue.cc:260] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.280231 12166 ts_tablet_manager.cc:1428] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.280263 12172 consensus_queue.cc:260] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.280439 12166 tablet_bootstrap.cc:492] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.281538 12166 tablet_bootstrap.cc:654] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.281673 12175 ts_tablet_manager.cc:1905] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.282441 12172 ts_tablet_manager.cc:1428] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:56.283998 12167 tablet_bootstrap.cc:492] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.284108 12167 ts_tablet_manager.cc:1397] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:01:56.284631 12167 raft_consensus.cc:357] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.284734 12167 raft_consensus.cc:383] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.284762 12167 raft_consensus.cc:738] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.284885 12167 consensus_queue.cc:260] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.285168 12172 tablet_bootstrap.cc:492] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.285207 12167 ts_tablet_manager.cc:1428] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.285236 12173 ts_tablet_manager.cc:1905] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.285392 12167 tablet_bootstrap.cc:492] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.286325 12172 tablet_bootstrap.cc:654] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.287412 12167 tablet_bootstrap.cc:654] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.289181 12238 raft_consensus.cc:491] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.289275 12238 raft_consensus.cc:513] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.289666 12177 ts_tablet_manager.cc:1905] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.289647 12238 leader_election.cc:290] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.290030 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c474af1901c74e6895c3a08f1cc7c65c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.290390 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c474af1901c74e6895c3a08f1cc7c65c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:01:56.290448 11717 leader_election.cc:343] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.290531 11919 raft_consensus.cc:2466] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.290930 11717 leader_election.cc:304] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.291121 12238 raft_consensus.cc:2802] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.291181 12238 raft_consensus.cc:491] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.291218 12238 raft_consensus.cc:3058] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.292212 12238 raft_consensus.cc:513] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.292564 12238 leader_election.cc:290] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.292920 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c474af1901c74e6895c3a08f1cc7c65c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.292994 12177 ts_tablet_manager.cc:1918] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.293064 12177 log.cc:1199] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d4a1580aeb4a4c1787c32b4d23e0fcaa
W20250625 14:01:56.293254 11717 leader_election.cc:343] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.293263 12666 raft_consensus.cc:491] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.293349 12177 ts_tablet_manager.cc:1939] T d4a1580aeb4a4c1787c32b4d23e0fcaa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.293347 12666 raft_consensus.cc:513] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.293712 12666 leader_election.cc:290] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.293982 12177 tablet_replica.cc:331] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.294005 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c474af1901c74e6895c3a08f1cc7c65c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.294111 11919 raft_consensus.cc:3058] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.294140 12177 raft_consensus.cc:2241] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.294274 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbd18834c5594897a2b16c7069a90c18" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.294351 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d4a1580aeb4a4c1787c32b4d23e0fcaa (table default.Table_6e0ca353af7d4a4aa7179de57cc9c962 [id=a4aac54fe4334c33b6fdbb81c472f827]) successfully deleted
I20250625 14:01:56.294435 11782 raft_consensus.cc:2391] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:56.294602 12177 raft_consensus.cc:2270] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:56.294943 11990 leader_election.cc:343] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: cbd18834c5594897a2b16c7069a90c18
I20250625 14:01:56.295013 11990 leader_election.cc:304] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.295125 12177 ts_tablet_manager.cc:1905] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.295151 12666 raft_consensus.cc:3058] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.296034 12666 raft_consensus.cc:2747] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.296394 11919 raft_consensus.cc:2466] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.296711 11717 leader_election.cc:304] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.296912 12177 ts_tablet_manager.cc:1918] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.296980 12177 log.cc:1199] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f47cf7e6d24347a88da2ee8fbd6de1b1
I20250625 14:01:56.297006 12238 raft_consensus.cc:2802] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.297086 12238 raft_consensus.cc:695] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.297212 12177 ts_tablet_manager.cc:1939] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.297231 12238 consensus_queue.cc:237] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.297744 12177 tablet_replica.cc:331] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.297878 12177 raft_consensus.cc:2241] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.297943 12167 tablet_bootstrap.cc:492] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.297991 12177 raft_consensus.cc:2270] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.298032 12167 ts_tablet_manager.cc:1397] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:01:56.298385 12177 ts_tablet_manager.cc:1905] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.298578 12167 raft_consensus.cc:357] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.298682 12167 raft_consensus.cc:383] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.298714 12167 raft_consensus.cc:738] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.298836 12167 consensus_queue.cc:260] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.299163 12167 ts_tablet_manager.cc:1428] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.299330 12167 tablet_bootstrap.cc:492] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.300315 12167 tablet_bootstrap.cc:654] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.300429 12177 ts_tablet_manager.cc:1918] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.300498 12177 log.cc:1199] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/1a3907e22505461a8df58ec339c342da
I20250625 14:01:56.300753 12177 ts_tablet_manager.cc:1939] T 1a3907e22505461a8df58ec339c342da P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.301307 12177 tablet_replica.cc:331] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.301432 12177 raft_consensus.cc:2241] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.301518 12177 raft_consensus.cc:2270] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.301963 12177 ts_tablet_manager.cc:1905] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.302901 12600 raft_consensus.cc:491] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.302994 12600 raft_consensus.cc:513] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.303087 12175 ts_tablet_manager.cc:1918] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.303140 12175 log.cc:1199] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/a7ede0ddacb74e39b07f175b5ef2a2c5
I20250625 14:01:56.303411 12175 ts_tablet_manager.cc:1939] T a7ede0ddacb74e39b07f175b5ef2a2c5 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.303448 12600 leader_election.cc:290] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.303568 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f47cf7e6d24347a88da2ee8fbd6de1b1 (table default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]) successfully deleted
I20250625 14:01:56.303745 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 1a3907e22505461a8df58ec339c342da (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]) successfully deleted
I20250625 14:01:56.303882 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "704ecf1ea8dd423ead2a0d1be113c03d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.304126 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet a7ede0ddacb74e39b07f175b5ef2a2c5 (table default.Table_4024f05f2d0245da8ef8d15052d80282 [id=f5c7890a67b34de29d7bb56262c9e0c3]) successfully deleted
W20250625 14:01:56.304248 11858 leader_election.cc:343] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.304366 12177 ts_tablet_manager.cc:1918] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.304435 12177 log.cc:1199] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8b82e99ecc994068b7823ef75d5b233f
I20250625 14:01:56.304634 12177 ts_tablet_manager.cc:1939] T 8b82e99ecc994068b7823ef75d5b233f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:56.304692 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet db4a9e4dfdd145bab965004ee5562e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db4a9e4dfdd145bab965004ee5562e2b already in progress: creating tablet
I20250625 14:01:56.304809 12172 tablet_bootstrap.cc:492] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.304891 12172 ts_tablet_manager.cc:1397] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
W20250625 14:01:56.305248 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 0752a7f1371e42d68d83afe41d2f1da9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0752a7f1371e42d68d83afe41d2f1da9 already in progress: creating tablet
I20250625 14:01:56.305419 12172 raft_consensus.cc:357] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.305539 12172 raft_consensus.cc:383] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.305572 12172 raft_consensus.cc:738] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.305693 12172 consensus_queue.cc:260] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.305958 12172 ts_tablet_manager.cc:1428] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:56.306979 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "704ecf1ea8dd423ead2a0d1be113c03d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:56.308043 11855 leader_election.cc:343] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.308117 11855 leader_election.cc:304] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.308324 12600 raft_consensus.cc:2747] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.308704 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet fbf41efa64294f388894a9a57b45fdc2
I20250625 14:01:56.309012 11526 catalog_manager.cc:6652] ReplaceTablet: tablet fbf41efa64294f388894a9a57b45fdc2 deleted and replaced by tablet 21908df7bb384e9782b97abe6f06b0f5
I20250625 14:01:56.309713 12172 tablet_bootstrap.cc:492] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.310599 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6e519c7cc312409181ac8bca5e400b80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.310889 12172 tablet_bootstrap.cc:654] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:56.311038 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e519c7cc312409181ac8bca5e400b80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.312621 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet fbf41efa64294f388894a9a57b45fdc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21908df7bb384e9782b97abe6f06b0f5) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.312754 12177 tablet_replica.cc:331] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.312891 12177 raft_consensus.cc:2241] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.312966 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet fbf41efa64294f388894a9a57b45fdc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21908df7bb384e9782b97abe6f06b0f5) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.312999 12177 raft_consensus.cc:2270] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.313104 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 32d345da0f674704b8e1f23a74bac3ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.313477 12177 ts_tablet_manager.cc:1905] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.314741 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet fbf41efa64294f388894a9a57b45fdc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21908df7bb384e9782b97abe6f06b0f5) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.314901 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8b82e99ecc994068b7823ef75d5b233f (table default.Table_06a503f6355b478caf948985a84c15f6 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
I20250625 14:01:56.315264 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet deee7c3fb5204c63a6618f628848bc81
I20250625 14:01:56.316340 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet deee7c3fb5204c63a6618f628848bc81 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.316654 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 44d41513c1d444cba5288a05f2c4652c
I20250625 14:01:56.317082 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_11c5f28c7d9c4da59371b1ef5a1d0031"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.317502 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11c5f28c7d9c4da59371b1ef5a1d0031 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.318655 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 44d41513c1d444cba5288a05f2c4652c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.318710 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet deee7c3fb5204c63a6618f628848bc81 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.318819 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 44d41513c1d444cba5288a05f2c4652c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.320909 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7541b0989fe04486be69997611bb8ca1
W20250625 14:01:56.321012 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee3cc1074818466a97d04f0136eaea92 consensus state has no leader
I20250625 14:01:56.321172 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 7541b0989fe04486be69997611bb8ca1 deleted and replaced by tablet 93d666f4b403435287f4157bda971193
I20250625 14:01:56.321272 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3d9670070fc6432ea2da685667349385"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.321334 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_91566225a46e41818d4bda31310c44f1" } new_table_name: "default.Table_7e1ecfc40f504452a262b91cfdf23a1b" modify_external_catalogs: true
W20250625 14:01:56.321691 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d9670070fc6432ea2da685667349385 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.321775 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 7541b0989fe04486be69997611bb8ca1 with delete_type TABLET_DATA_DELETED (replaced by tablet 93d666f4b403435287f4157bda971193) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.322705 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f1b487c26148480799a5c15d9605202f" } new_table_name: "default.Table_eaf70884d45f4eb6b1fc06888fdcd505" modify_external_catalogs: true
I20250625 14:01:56.323359 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_677ffd0785754cb59fc1473d4fe7be22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.323679 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_677ffd0785754cb59fc1473d4fe7be22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.324226 12172 tablet_bootstrap.cc:492] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.324317 12180 raft_consensus.cc:491] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.324404 12180 raft_consensus.cc:513] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.324329 12172 ts_tablet_manager.cc:1397] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20250625 14:01:56.324800 12180 leader_election.cc:290] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.325176 12172 raft_consensus.cc:357] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.325273 12172 raft_consensus.cc:383] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.325302 12172 raft_consensus.cc:738] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.325405 12172 consensus_queue.cc:260] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.325686 12172 ts_tablet_manager.cc:1428] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.325875 12172 tablet_bootstrap.cc:492] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.326818 12166 tablet_bootstrap.cc:492] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.326923 12166 ts_tablet_manager.cc:1397] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.000s
I20250625 14:01:56.327036 12172 tablet_bootstrap.cc:654] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.327400 12166 raft_consensus.cc:357] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.327502 12166 raft_consensus.cc:383] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.327530 12166 raft_consensus.cc:738] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.327641 12166 consensus_queue.cc:260] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.327934 12166 ts_tablet_manager.cc:1428] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.328140 12166 tablet_bootstrap.cc:492] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.329252 12166 tablet_bootstrap.cc:654] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.329586 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet deee7c3fb5204c63a6618f628848bc81 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.329747 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 44d41513c1d444cba5288a05f2c4652c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.330194 12666 raft_consensus.cc:491] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.330281 12666 raft_consensus.cc:513] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.330658 12666 leader_election.cc:290] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.330798 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee3cc1074818466a97d04f0136eaea92" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:56.331323 11990 leader_election.cc:343] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 32d345da0f674704b8e1f23a74bac3ce
W20250625 14:01:56.331501 11993 leader_election.cc:343] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 32d345da0f674704b8e1f23a74bac3ce
W20250625 14:01:56.331532 11717 leader_election.cc:343] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.331558 11993 leader_election.cc:304] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.331979 12666 raft_consensus.cc:2747] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.332487 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee3cc1074818466a97d04f0136eaea92" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.332737 11919 raft_consensus.cc:2466] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.334820 11717 leader_election.cc:304] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.335197 12180 raft_consensus.cc:2802] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.335263 12180 raft_consensus.cc:491] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.335310 12180 raft_consensus.cc:3058] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.336634 12180 raft_consensus.cc:513] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.337103 12180 leader_election.cc:290] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.337694 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet a7ede0ddacb74e39b07f175b5ef2a2c5 with delete_type TABLET_DATA_DELETED (replaced by tablet a4199634a8be4e359cc9707d4754cac9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.337806 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 7541b0989fe04486be69997611bb8ca1 with delete_type TABLET_DATA_DELETED (replaced by tablet 93d666f4b403435287f4157bda971193) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.337864 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 61acdd21d02e4576adba8f2ff24a154a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.338435 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee3cc1074818466a97d04f0136eaea92" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.338497 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 7541b0989fe04486be69997611bb8ca1 with delete_type TABLET_DATA_DELETED (replaced by tablet 93d666f4b403435287f4157bda971193) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.339322 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee3cc1074818466a97d04f0136eaea92" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.339432 11919 raft_consensus.cc:3058] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.339785 11717 leader_election.cc:343] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.340596 11919 raft_consensus.cc:2466] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.341917 11717 leader_election.cc:304] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.342350 12180 raft_consensus.cc:2802] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.342453 12180 raft_consensus.cc:695] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.342486 12173 ts_tablet_manager.cc:1918] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.342597 12180 consensus_queue.cc:237] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.342746 12173 log.cc:1199] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/144ba67ce1fa419cac46e40ebcc078e6
I20250625 14:01:56.343088 12173 ts_tablet_manager.cc:1939] T 144ba67ce1fa419cac46e40ebcc078e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.344669 12666 raft_consensus.cc:491] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.344766 12666 raft_consensus.cc:513] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.345177 12666 leader_election.cc:290] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.346228 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c940a9f7ada54b48940e90c822c84735" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.346271 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c940a9f7ada54b48940e90c822c84735" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.346436 11919 raft_consensus.cc:2391] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:56.346982 11990 leader_election.cc:304] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.347218 12173 tablet_replica.cc:331] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.347318 12666 raft_consensus.cc:3058] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.347558 12177 ts_tablet_manager.cc:1918] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.347623 12177 log.cc:1199] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6bcdf4d901e34ab5ba2c36fe53456f0e
I20250625 14:01:56.347836 12177 ts_tablet_manager.cc:1939] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.348433 12666 raft_consensus.cc:2747] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.348798 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 144ba67ce1fa419cac46e40ebcc078e6 (table default.Table_04bedd118b064b669bbd67a9e6017fba [id=1513365deec7433d8564e56a0dca7154]) successfully deleted
I20250625 14:01:56.348971 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6bcdf4d901e34ab5ba2c36fe53456f0e (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:56.349256 11422 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu with pid 12298
I20250625 14:01:56.349817 12172 tablet_bootstrap.cc:492] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.349917 12172 ts_tablet_manager.cc:1397] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.002s
I20250625 14:01:56.350036 12600 raft_consensus.cc:491] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.350278 12600 raft_consensus.cc:513] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.347357 12173 raft_consensus.cc:2241] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.350600 12172 raft_consensus.cc:357] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.350699 12172 raft_consensus.cc:383] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.350734 12172 raft_consensus.cc:738] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.350862 12600 leader_election.cc:290] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.350883 12173 raft_consensus.cc:2270] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.350858 12172 consensus_queue.cc:260] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.351184 12172 ts_tablet_manager.cc:1428] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.351368 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e307709d217643358c7c3efb3dd73747" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.351596 12172 tablet_bootstrap.cc:492] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:56.351879 11855 leader_election.cc:343] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.352231 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e307709d217643358c7c3efb3dd73747" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.352344 11782 raft_consensus.cc:2466] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.352481 12173 ts_tablet_manager.cc:1905] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.352634 11858 leader_election.cc:304] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.352918 12600 raft_consensus.cc:2802] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.352977 12600 raft_consensus.cc:491] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.353024 12172 tablet_bootstrap.cc:654] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.353024 12600 raft_consensus.cc:3058] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.353636 12177 tablet_replica.cc:331] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.353793 12177 raft_consensus.cc:2241] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.353911 12177 raft_consensus.cc:2270] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.354051 12238 raft_consensus.cc:491] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.354120 12238 raft_consensus.cc:513] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.354228 12600 raft_consensus.cc:513] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.354511 12238 leader_election.cc:290] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.354703 12600 leader_election.cc:290] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.354985 12177 ts_tablet_manager.cc:1905] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.355047 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61acdd21d02e4576adba8f2ff24a154a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.355700 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e307709d217643358c7c3efb3dd73747" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.355902 11717 leader_election.cc:343] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.355931 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e307709d217643358c7c3efb3dd73747" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.356060 11782 raft_consensus.cc:3058] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.356057 11855 leader_election.cc:343] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.356132 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61acdd21d02e4576adba8f2ff24a154a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.356256 11919 raft_consensus.cc:2466] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.355688 12173 ts_tablet_manager.cc:1918] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.356554 11717 leader_election.cc:304] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.356756 12238 raft_consensus.cc:2802] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.356812 12238 raft_consensus.cc:491] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.356853 12238 raft_consensus.cc:3058] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.357105 11782 raft_consensus.cc:2466] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.357414 11858 leader_election.cc:304] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.357678 12600 raft_consensus.cc:2802] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.357761 12600 raft_consensus.cc:695] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.357838 12238 raft_consensus.cc:513] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.357930 12600 consensus_queue.cc:237] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.358220 12238 leader_election.cc:290] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.359222 12177 ts_tablet_manager.cc:1918] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.359290 12177 log.cc:1199] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/dce48b28d6634330bcfa6e28d9f0c49d
I20250625 14:01:56.359248 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61acdd21d02e4576adba8f2ff24a154a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.359542 12177 ts_tablet_manager.cc:1939] T dce48b28d6634330bcfa6e28d9f0c49d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:56.359966 11717 leader_election.cc:343] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.360153 12177 tablet_replica.cc:331] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.360293 12177 raft_consensus.cc:2241] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.360324 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet dce48b28d6634330bcfa6e28d9f0c49d (table default.Table_0764c545c28d4a3c82093556ae3f970b [id=5f1140a89f654aa0874f801a35ffa3e8]) successfully deleted
I20250625 14:01:56.360389 12177 raft_consensus.cc:2270] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.360674 12173 log.cc:1199] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/fc2766f8e0b544b0b48a0e7e5952d672
I20250625 14:01:56.360976 12173 ts_tablet_manager.cc:1939] T fc2766f8e0b544b0b48a0e7e5952d672 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.361078 12177 ts_tablet_manager.cc:1905] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.361914 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet fc2766f8e0b544b0b48a0e7e5952d672 (table default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
I20250625 14:01:56.362258 12173 tablet_replica.cc:331] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.362459 12173 raft_consensus.cc:2241] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.362582 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61acdd21d02e4576adba8f2ff24a154a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.362643 12173 raft_consensus.cc:2270] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.362711 11919 raft_consensus.cc:3058] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.363199 12173 ts_tablet_manager.cc:1905] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.363334 12172 tablet_bootstrap.cc:492] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.363426 12172 ts_tablet_manager.cc:1397] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250625 14:01:56.363688 11919 raft_consensus.cc:2466] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.363957 12172 raft_consensus.cc:357] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.364018 11717 leader_election.cc:304] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.364064 12172 raft_consensus.cc:383] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.364095 12172 raft_consensus.cc:738] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.364221 12172 consensus_queue.cc:260] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.364271 12238 raft_consensus.cc:2802] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 14:01:56.364411 11517 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 39ff4b0e7ac74ec294550775aaa44468 (table default.Table_7887db4b4d5c4f2a8770f9f0b73832ec [id=12bf9473cabd4d199715d23c94a02005], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 39ff4b0e7ac74ec294550775aaa44468 consensus state has no leader
I20250625 14:01:56.364530 12172 ts_tablet_manager.cc:1428] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.364621 12238 raft_consensus.cc:695] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.364710 12172 tablet_bootstrap.cc:492] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.364745 12238 consensus_queue.cc:237] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.365785 12172 tablet_bootstrap.cc:654] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.367341 12177 ts_tablet_manager.cc:1918] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.367419 12177 log.cc:1199] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a7ede0ddacb74e39b07f175b5ef2a2c5
I20250625 14:01:56.367632 12177 ts_tablet_manager.cc:1939] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.368232 12177 tablet_replica.cc:331] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.368358 12177 raft_consensus.cc:2241] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.368490 12177 pending_rounds.cc:70] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:56.368517 12177 pending_rounds.cc:77] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523036007100416 op_type: NO_OP noop_request { }
I20250625 14:01:56.368566 12177 raft_consensus.cc:2887] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.368620 12177 raft_consensus.cc:2270] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.369262 12177 ts_tablet_manager.cc:1905] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.369398 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a7ede0ddacb74e39b07f175b5ef2a2c5 (table default.Table_4024f05f2d0245da8ef8d15052d80282 [id=f5c7890a67b34de29d7bb56262c9e0c3]) successfully deleted
W20250625 14:01:56.369583 11517 connection.cc:537] client connection to 127.11.39.188:43359 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250625 14:01:56.369648 11517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 6 similar messages]
W20250625 14:01:56.370121 11855 connection.cc:537] client connection to 127.11.39.188:43359 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250625 14:01:56.370746 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet fbf41efa64294f388894a9a57b45fdc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf41efa64294f388894a9a57b45fdc2 already in progress: creating tablet
W20250625 14:01:56.371239 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet deee7c3fb5204c63a6618f628848bc81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet deee7c3fb5204c63a6618f628848bc81 already in progress: creating tablet
I20250625 14:01:56.371440 12175 tablet_replica.cc:331] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.371557 12175 raft_consensus.cc:2241] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.371728 12175 raft_consensus.cc:2270] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.371835 12177 ts_tablet_manager.cc:1918] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.371922 12177 log.cc:1199] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8363c9c6dab64a30b08ab92a152a3ee5
I20250625 14:01:56.372184 12177 ts_tablet_manager.cc:1939] T 8363c9c6dab64a30b08ab92a152a3ee5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.372229 12175 ts_tablet_manager.cc:1905] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.372823 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8363c9c6dab64a30b08ab92a152a3ee5 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]) successfully deleted
I20250625 14:01:56.372867 12177 tablet_replica.cc:331] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.373009 12177 raft_consensus.cc:2241] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.373117 12177 raft_consensus.cc:2270] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.373435 12177 ts_tablet_manager.cc:1905] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.374071 12173 ts_tablet_manager.cc:1918] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.374217 12173 log.cc:1199] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/aac4b7bbfad9493598b31a86e2c045c0
I20250625 14:01:56.374262 12175 ts_tablet_manager.cc:1918] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.374568 12173 ts_tablet_manager.cc:1939] T aac4b7bbfad9493598b31a86e2c045c0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.375245 12173 tablet_replica.cc:331] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.375495 12177 ts_tablet_manager.cc:1918] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.375571 12177 log.cc:1199] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/cbd18834c5594897a2b16c7069a90c18
I20250625 14:01:56.375643 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet aac4b7bbfad9493598b31a86e2c045c0 (table default.Table_eb9b89668d974648ad501f6f3863cd81 [id=fe0b85589c3e4db4b88979ef94ffec30]) successfully deleted
I20250625 14:01:56.375778 12177 ts_tablet_manager.cc:1939] T cbd18834c5594897a2b16c7069a90c18 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.376104 12173 raft_consensus.cc:2241] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.376240 12173 raft_consensus.cc:2270] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.376397 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet cbd18834c5594897a2b16c7069a90c18 (table default.Table_d0f93962f9df42408804933938d2595c [id=2b85fd3adb7f4584887aa464e3ba929f]) successfully deleted
W20250625 14:01:56.377820 12836 negotiation.cc:337] Failed RPC negotiation. Trace:
0625 14:01:56.370703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.39.188:43359 (local address 127.11.39.129:55301)
0625 14:01:56.377103 (+ 6400us) negotiation.cc:107] Waiting for socket to connect
0625 14:01:56.377184 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":6308,"thread_start_us":58,"threads_started":1}
I20250625 14:01:56.378562 12177 tablet_replica.cc:331] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.378693 12167 tablet_bootstrap.cc:492] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.378705 12177 raft_consensus.cc:2241] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.378791 12167 ts_tablet_manager.cc:1397] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.000s
I20250625 14:01:56.378818 12177 raft_consensus.cc:2270] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:56.378858 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet db4a9e4dfdd145bab965004ee5562e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db4a9e4dfdd145bab965004ee5562e2b already in progress: creating tablet
W20250625 14:01:56.379005 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 0752a7f1371e42d68d83afe41d2f1da9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0752a7f1371e42d68d83afe41d2f1da9 already in progress: creating tablet
W20250625 14:01:56.379097 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet fbf41efa64294f388894a9a57b45fdc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf41efa64294f388894a9a57b45fdc2 already in progress: creating tablet
W20250625 14:01:56.379235 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet deee7c3fb5204c63a6618f628848bc81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet deee7c3fb5204c63a6618f628848bc81 already in progress: creating tablet
I20250625 14:01:56.379348 12167 raft_consensus.cc:357] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.379477 12167 raft_consensus.cc:383] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.379515 12167 raft_consensus.cc:738] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.379638 12167 consensus_queue.cc:260] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.379662 12172 tablet_bootstrap.cc:492] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.379743 12172 ts_tablet_manager.cc:1397] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20250625 14:01:56.379899 12167 ts_tablet_manager.cc:1428] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:56.380116 12167 tablet_bootstrap.cc:492] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.380232 12172 raft_consensus.cc:357] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.380331 12172 raft_consensus.cc:383] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.380364 12172 raft_consensus.cc:738] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.380478 12172 consensus_queue.cc:260] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.380748 12172 ts_tablet_manager.cc:1428] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.380934 12172 tablet_bootstrap.cc:492] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.381150 12167 tablet_bootstrap.cc:654] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.381945 12172 tablet_bootstrap.cc:654] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.383683 12177 ts_tablet_manager.cc:1905] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.382728 12166 tablet_bootstrap.cc:492] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.385723 12166 ts_tablet_manager.cc:1397] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.000s
I20250625 14:01:56.386232 12166 raft_consensus.cc:357] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.386385 12166 raft_consensus.cc:383] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.386430 12166 raft_consensus.cc:738] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.383708 12600 raft_consensus.cc:491] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.386575 12166 consensus_queue.cc:260] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.386659 12600 raft_consensus.cc:513] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.386859 12166 ts_tablet_manager.cc:1428] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.387073 12166 tablet_bootstrap.cc:492] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.387316 12175 log.cc:1199] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/44d41513c1d444cba5288a05f2c4652c
I20250625 14:01:56.387370 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.387712 12175 ts_tablet_manager.cc:1939] T 44d41513c1d444cba5288a05f2c4652c P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.387792 12177 ts_tablet_manager.cc:1918] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20250625 14:01:56.387821 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.387868 12177 log.cc:1199] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/44d41513c1d444cba5288a05f2c4652c
I20250625 14:01:56.388170 12166 tablet_bootstrap.cc:654] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.388172 12177 ts_tablet_manager.cc:1939] T 44d41513c1d444cba5288a05f2c4652c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.388582 12175 tablet_replica.cc:331] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.388880 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2fcd7c144c704f17884e81b9884d604f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.389272 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fcd7c144c704f17884e81b9884d604f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.389433 12175 raft_consensus.cc:2241] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.389554 12175 raft_consensus.cc:2270] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:56.390293 11517 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 -> Peer 4ac8e2e2cf5c4faea7755bbad7d23d99 (127.11.39.188:43359): Couldn't send request to peer 4ac8e2e2cf5c4faea7755bbad7d23d99. Status: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:56.390487 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 44d41513c1d444cba5288a05f2c4652c (table default.Table_82021dac408c42e9898349055acf8936 [id=8cc7744ad13545cba212ea3affd17d9d]) successfully deleted
I20250625 14:01:56.390547 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e62aba799c354c178db2d8c31ce7e969" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:56.390630 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a7ede0ddacb74e39b07f175b5ef2a2c5 because the tablet was not found. No further retry: Not found: Tablet not found: a7ede0ddacb74e39b07f175b5ef2a2c5
W20250625 14:01:56.390738 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7541b0989fe04486be69997611bb8ca1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7541b0989fe04486be69997611bb8ca1 already in progress: creating tablet
I20250625 14:01:56.390822 12175 ts_tablet_manager.cc:1905] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.390993 12666 raft_consensus.cc:491] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.391077 12666 raft_consensus.cc:513] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.391487 12666 leader_election.cc:290] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:56.391919 11855 leader_election.cc:343] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.392467 12167 tablet_bootstrap.cc:492] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
W20250625 14:01:56.392542 11993 leader_election.cc:343] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 205f83a0ffbc440492e241a75657f1b8
I20250625 14:01:56.392557 12167 ts_tablet_manager.cc:1397] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:56.392665 12172 tablet_bootstrap.cc:492] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.387055 12600 leader_election.cc:290] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.392757 12172 ts_tablet_manager.cc:1397] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
W20250625 14:01:56.392788 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8615e96c59474da5ae6214402aba4a46 consensus state has no leader
I20250625 14:01:56.393044 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7f32473eae534d38a3e455dcc176d972"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.393182 12167 raft_consensus.cc:357] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.393271 12167 raft_consensus.cc:383] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.393301 12167 raft_consensus.cc:738] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.393267 12172 raft_consensus.cc:357] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.393381 12172 raft_consensus.cc:383] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.393426 12172 raft_consensus.cc:738] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.393417 12167 consensus_queue.cc:260] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:56.393455 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f32473eae534d38a3e455dcc176d972 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.393564 12172 consensus_queue.cc:260] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.393745 12167 ts_tablet_manager.cc:1428] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.393879 12172 ts_tablet_manager.cc:1428] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:56.394028 11990 leader_election.cc:343] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 205f83a0ffbc440492e241a75657f1b8
I20250625 14:01:56.394085 12172 tablet_bootstrap.cc:492] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.394091 11990 leader_election.cc:304] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.394227 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e62aba799c354c178db2d8c31ce7e969" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.394362 11782 raft_consensus.cc:2466] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.394416 12800 raft_consensus.cc:2747] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.394758 11858 leader_election.cc:304] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.395228 12172 tablet_bootstrap.cc:654] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.395248 12600 raft_consensus.cc:2802] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.395298 12600 raft_consensus.cc:491] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.395336 12600 raft_consensus.cc:3058] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.396397 12600 raft_consensus.cc:513] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.396631 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 44d41513c1d444cba5288a05f2c4652c (table default.Table_82021dac408c42e9898349055acf8936 [id=8cc7744ad13545cba212ea3affd17d9d]) successfully deleted
W20250625 14:01:56.396834 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7541b0989fe04486be69997611bb8ca1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7541b0989fe04486be69997611bb8ca1 already in progress: creating tablet
I20250625 14:01:56.397171 12265 consensus_queue.cc:1035] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.397508 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_209865c613024f86a2947aa757e43d68" } modify_external_catalogs: true
I20250625 14:01:56.397614 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_209865c613024f86a2947aa757e43d68" } modify_external_catalogs: true
I20250625 14:01:56.398185 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e62aba799c354c178db2d8c31ce7e969" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.398677 11855 leader_election.cc:343] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.398936 12173 ts_tablet_manager.cc:1905] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.399142 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e62aba799c354c178db2d8c31ce7e969" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.399253 11782 raft_consensus.cc:3058] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.399444 12600 leader_election.cc:290] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.399533 12167 tablet_bootstrap.cc:492] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.399658 12666 raft_consensus.cc:491] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.399740 12666 raft_consensus.cc:513] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.400055 12666 leader_election.cc:290] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.400303 11782 raft_consensus.cc:2466] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
W20250625 14:01:56.400681 11990 leader_election.cc:343] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 8363c9c6dab64a30b08ab92a152a3ee5
I20250625 14:01:56.400748 12167 tablet_bootstrap.cc:654] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.400919 11858 leader_election.cc:304] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.401134 12600 raft_consensus.cc:2802] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.401547 12600 raft_consensus.cc:695] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.401686 12600 consensus_queue.cc:237] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.403692 12175 ts_tablet_manager.cc:1918] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.403761 12175 log.cc:1199] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/61acdd21d02e4576adba8f2ff24a154a
I20250625 14:01:56.403976 12175 ts_tablet_manager.cc:1939] T 61acdd21d02e4576adba8f2ff24a154a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.404260 12173 ts_tablet_manager.cc:1918] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.404328 12173 log.cc:1199] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9d8bbe1212a7438f9a06cc1a18c6e40a
I20250625 14:01:56.404533 12173 ts_tablet_manager.cc:1939] T 9d8bbe1212a7438f9a06cc1a18c6e40a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:56.404558 11993 leader_election.cc:343] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 8363c9c6dab64a30b08ab92a152a3ee5
I20250625 14:01:56.404619 11993 leader_election.cc:304] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.404830 12666 raft_consensus.cc:2747] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.405412 12166 tablet_bootstrap.cc:492] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.405499 12166 ts_tablet_manager.cc:1397] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:01:56.405963 12166 raft_consensus.cc:357] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.406077 12166 raft_consensus.cc:383] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.406113 12166 raft_consensus.cc:738] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.406231 12166 consensus_queue.cc:260] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.406529 12166 ts_tablet_manager.cc:1428] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.406728 12166 tablet_bootstrap.cc:492] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.407591 12166 tablet_bootstrap.cc:654] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.408592 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 61acdd21d02e4576adba8f2ff24a154a (table default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9 [id=75fe7cfcdb0c446f9af9708ba107c0b7]) successfully deleted
I20250625 14:01:56.409281 12173 tablet_replica.cc:331] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.409415 12173 raft_consensus.cc:2241] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.409523 12173 raft_consensus.cc:2270] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.409869 12173 ts_tablet_manager.cc:1905] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.410930 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9d8bbe1212a7438f9a06cc1a18c6e40a (table default.Table_4f90b19d20404564bb50d83322939821 [id=74f13a50680d4455a4fddc3eb7a3b3bd]) successfully deleted
I20250625 14:01:56.411902 12265 consensus_queue.cc:1035] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.412283 12173 ts_tablet_manager.cc:1918] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.412351 12173 log.cc:1199] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/dbdc3547d8de48e8887ffeb5b0f71f82
I20250625 14:01:56.412566 12173 ts_tablet_manager.cc:1939] T dbdc3547d8de48e8887ffeb5b0f71f82 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:56.412940 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d74f27d998b14ee890272812b718e468 consensus state has no leader
I20250625 14:01:56.415213 12265 raft_consensus.cc:491] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.415338 12265 raft_consensus.cc:513] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.415676 12265 leader_election.cc:290] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.416085 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5d1979e44eab46c7a54a204603963839" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.416234 11784 raft_consensus.cc:2466] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.416100 12172 tablet_bootstrap.cc:492] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.416708 12172 ts_tablet_manager.cc:1397] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:56.417109 11858 leader_election.cc:304] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.417373 12172 raft_consensus.cc:357] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.417424 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_91d650533d9e4a8a80674057cfcf6964 [id=ccfb2f80b431431db5df92e0b400520c]). Expected version 1 got 0
I20250625 14:01:56.417518 12172 raft_consensus.cc:383] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.417557 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 3c825977e422407486587f28af36bd68 (table default.Table_2928b645415547419a21192f44ad81ab [id=c7bfff2cc8b84a5d83719cd96bc5af9c]). Expected version 2 got 0
I20250625 14:01:56.417578 12172 raft_consensus.cc:738] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.417636 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:56.417637 12265 raft_consensus.cc:2802] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.417690 12265 raft_consensus.cc:491] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.417706 12167 tablet_bootstrap.cc:492] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.417726 12265 raft_consensus.cc:3058] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.417788 12167 ts_tablet_manager.cc:1397] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:01:56.417737 12172 consensus_queue.cc:260] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.418356 12167 raft_consensus.cc:357] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.418489 12167 raft_consensus.cc:383] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.418529 12167 raft_consensus.cc:738] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.418663 12167 consensus_queue.cc:260] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.418730 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:56.418762 12265 raft_consensus.cc:513] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.418819 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.418962 12167 ts_tablet_manager.cc:1428] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.419049 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_2928b645415547419a21192f44ad81ab [id=c7bfff2cc8b84a5d83719cd96bc5af9c] alter complete (version 2)
I20250625 14:01:56.419116 12265 leader_election.cc:290] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.419152 12172 ts_tablet_manager.cc:1428] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.419169 12167 tablet_bootstrap.cc:492] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.419345 12172 tablet_bootstrap.cc:492] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.419777 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5d1979e44eab46c7a54a204603963839" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.419880 11784 raft_consensus.cc:3058] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.419929 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5d1979e44eab46c7a54a204603963839" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.420266 11855 leader_election.cc:343] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.420423 12167 tablet_bootstrap.cc:654] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.420873 11784 raft_consensus.cc:2466] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.421177 11858 leader_election.cc:304] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.421427 12600 raft_consensus.cc:2802] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.421501 12600 raft_consensus.cc:695] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.421624 12600 consensus_queue.cc:237] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.421746 12172 tablet_bootstrap.cc:654] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.423067 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5d1979e44eab46c7a54a204603963839" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:56.423569 11855 leader_election.cc:343] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.425830 11501 master_runner.cc:186] Error getting master registration for 127.11.39.188:43359: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111),
I20250625 14:01:56.425967 11501 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250625 14:01:56.426657 11894 tablet_service.cc:1468] Processing CreateTablet for tablet db5d2263ab724491a7049fb91b0d10fb (DEFAULT_TABLE table=default.Table_95f72537a1a6427d90687b9ce3844506 [id=54f14ba68b6e47c29e5e7e4d7a0675c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.426931 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 4de2eeaf84084fbda097aa8c0eef2341 (DEFAULT_TABLE table=default.Table_ba5051d3c58145379e1e1753df46232f [id=d2947519f01c450e9935578f87977369]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.427150 12027 tablet_service.cc:1468] Processing CreateTablet for tablet db5d2263ab724491a7049fb91b0d10fb (DEFAULT_TABLE table=default.Table_95f72537a1a6427d90687b9ce3844506 [id=54f14ba68b6e47c29e5e7e4d7a0675c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.427426 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5d2263ab724491a7049fb91b0d10fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.429600 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]). Expected version 3 got 0
I20250625 14:01:56.429744 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]). Expected version 1 got 0
I20250625 14:01:56.430006 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a (DEFAULT_TABLE table=default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.430473 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 4de2eeaf84084fbda097aa8c0eef2341 (DEFAULT_TABLE table=default.Table_ba5051d3c58145379e1e1753df46232f [id=d2947519f01c450e9935578f87977369]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.430713 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de2eeaf84084fbda097aa8c0eef2341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.431386 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 33790cc725df482e91daceca29c820eb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.431605 11757 tablet_service.cc:1468] Processing CreateTablet for tablet db5d2263ab724491a7049fb91b0d10fb (DEFAULT_TABLE table=default.Table_95f72537a1a6427d90687b9ce3844506 [id=54f14ba68b6e47c29e5e7e4d7a0675c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.431846 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5d2263ab724491a7049fb91b0d10fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.433094 12173 tablet_replica.cc:331] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.433068 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a (DEFAULT_TABLE table=default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.433225 12173 raft_consensus.cc:2241] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.433307 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d41c8cea082478d9cc16c143b3a3f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.433347 12173 raft_consensus.cc:2270] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.433728 12173 ts_tablet_manager.cc:1905] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.434229 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 4de2eeaf84084fbda097aa8c0eef2341 (DEFAULT_TABLE table=default.Table_ba5051d3c58145379e1e1753df46232f [id=d2947519f01c450e9935578f87977369]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.434496 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de2eeaf84084fbda097aa8c0eef2341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.435616 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 432e55208a0f48b594a2fe564132cbf0 (DEFAULT_TABLE table=default.Table_9f894ff0b3064204a192a649afb51078 [id=c1f855079b614aa8b55e8ee6a87570e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.436049 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 432e55208a0f48b594a2fe564132cbf0 (DEFAULT_TABLE table=default.Table_9f894ff0b3064204a192a649afb51078 [id=c1f855079b614aa8b55e8ee6a87570e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.436301 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432e55208a0f48b594a2fe564132cbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.436408 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet dbdc3547d8de48e8887ffeb5b0f71f82 (table default.Table_768e989533ee4c5a8ad6f761a51c058d [id=1e3e09853928482bae0b4b3d489dea3c]) successfully deleted
I20250625 14:01:56.436731 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a (DEFAULT_TABLE table=default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.436980 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d41c8cea082478d9cc16c143b3a3f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.438401 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet e307709d217643358c7c3efb3dd73747 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc5b8ea4f3b47f19c603c235fa79007) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.438585 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 6bcdf4d901e34ab5ba2c36fe53456f0e with delete_type TABLET_DATA_DELETED (replaced by tablet 54f0be19f9134fa3a88ae867b108c7e8) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.438613 12166 tablet_bootstrap.cc:492] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.438710 12166 ts_tablet_manager.cc:1397] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:01:56.438743 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 33790cc725df482e91daceca29c820eb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.438874 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f47cf7e6d24347a88da2ee8fbd6de1b1 with delete_type TABLET_DATA_DELETED (replaced by tablet 8feddd83af08466ea11c4a15a08d3c8b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.439002 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.439285 12166 raft_consensus.cc:357] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.439410 12166 raft_consensus.cc:383] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.439447 12166 raft_consensus.cc:738] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.439392 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 432e55208a0f48b594a2fe564132cbf0 (DEFAULT_TABLE table=default.Table_9f894ff0b3064204a192a649afb51078 [id=c1f855079b614aa8b55e8ee6a87570e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.439564 12166 consensus_queue.cc:260] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.439847 12166 ts_tablet_manager.cc:1428] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.440073 12166 tablet_bootstrap.cc:492] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.440214 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 339813cd0c194f07bfc4edefd6a05ef3) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.441972 12177 tablet_replica.cc:331] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.442013 12055 raft_consensus.cc:3058] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.441992 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432e55208a0f48b594a2fe564132cbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.442131 12177 raft_consensus.cc:2241] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.442170 11921 raft_consensus.cc:1273] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:56.442239 12177 raft_consensus.cc:2270] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.443209 12055 raft_consensus.cc:1273] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:56.443944 12177 ts_tablet_manager.cc:1905] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.444415 12180 consensus_queue.cc:1035] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.444684 12180 consensus_queue.cc:1035] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.426949 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db5d2263ab724491a7049fb91b0d10fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.445307 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d8e509824fc94993b1676f5b68515002
I20250625 14:01:56.445863 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4de2eeaf84084fbda097aa8c0eef2341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.446121 12166 tablet_bootstrap.cc:654] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.446244 12177 ts_tablet_manager.cc:1918] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.446620 12177 log.cc:1199] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/33790cc725df482e91daceca29c820eb
I20250625 14:01:56.446861 12177 ts_tablet_manager.cc:1939] T 33790cc725df482e91daceca29c820eb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.447324 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d41c8cea082478d9cc16c143b3a3f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.449376 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet d8e509824fc94993b1676f5b68515002 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.449570 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432e55208a0f48b594a2fe564132cbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.451819 12175 tablet_replica.cc:331] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.451982 12175 raft_consensus.cc:2241] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.452054 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_06caae8b35634d028c7368ee9936151a [id=ccfb2f80b431431db5df92e0b400520c]). Expected version 2 got 0
I20250625 14:01:56.452126 12175 pending_rounds.cc:70] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:56.452164 12175 pending_rounds.cc:77] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523036605976576 op_type: NO_OP noop_request { }
I20250625 14:01:56.452220 12175 raft_consensus.cc:2887] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.452270 12175 raft_consensus.cc:2270] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.452711 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b82e99ecc994068b7823ef75d5b233f with delete_type TABLET_DATA_DELETED (replaced by tablet 4b76d36bac354543b8f7cef071aaa661) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.453243 12175 ts_tablet_manager.cc:1905] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.453953 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 8363c9c6dab64a30b08ab92a152a3ee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 339813cd0c194f07bfc4edefd6a05ef3) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.454200 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet d8e509824fc94993b1676f5b68515002 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.454388 12177 tablet_replica.cc:331] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.454546 12177 raft_consensus.cc:2241] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.454674 12177 raft_consensus.cc:2270] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.455072 12177 ts_tablet_manager.cc:1905] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.455942 12666 raft_consensus.cc:491] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.456043 12666 raft_consensus.cc:513] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.456429 12666 leader_election.cc:290] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:56.457253 11990 leader_election.cc:343] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: e7260f6c81d64415ae2469f87fe46c55
I20250625 14:01:56.457548 12177 ts_tablet_manager.cc:1918] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.457643 12177 log.cc:1199] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d8e509824fc94993b1676f5b68515002
I20250625 14:01:56.457695 12173 ts_tablet_manager.cc:1918] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.457775 12173 log.cc:1199] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/4617bb8a015d42188beba9df61df2c9f
I20250625 14:01:56.457935 12177 ts_tablet_manager.cc:1939] T d8e509824fc94993b1676f5b68515002 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.458037 12173 ts_tablet_manager.cc:1939] T 4617bb8a015d42188beba9df61df2c9f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.458755 12173 tablet_replica.cc:331] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.458901 12173 raft_consensus.cc:2241] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.459019 12173 raft_consensus.cc:2270] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.459380 12173 ts_tablet_manager.cc:1905] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.460664 12172 tablet_bootstrap.cc:492] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.460774 12172 ts_tablet_manager.cc:1397] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.000s
I20250625 14:01:56.461334 12172 raft_consensus.cc:357] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.461460 12172 raft_consensus.cc:383] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.461498 12172 raft_consensus.cc:738] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.461617 12172 consensus_queue.cc:260] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.461971 12172 ts_tablet_manager.cc:1428] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.462203 12172 tablet_bootstrap.cc:492] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.462939 12166 tablet_bootstrap.cc:492] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.463023 12166 ts_tablet_manager.cc:1397] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:56.463320 12172 tablet_bootstrap.cc:654] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.463604 12166 raft_consensus.cc:357] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.463692 12175 ts_tablet_manager.cc:1918] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.463717 12166 raft_consensus.cc:383] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.463759 12175 log.cc:1199] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e307709d217643358c7c3efb3dd73747
I20250625 14:01:56.463749 12166 raft_consensus.cc:738] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.463891 12166 consensus_queue.cc:260] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.464025 12175 ts_tablet_manager.cc:1939] T e307709d217643358c7c3efb3dd73747 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.464442 11430 master_runner.cc:186] Error getting master registration for 127.11.39.188:43359: Network error: Client connection negotiation failed: client connection to 127.11.39.188:43359: connect: Connection refused (error 111),
I20250625 14:01:56.466106 11430 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250625 14:01:56.468667 12233 tablet.cc:1722] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:56.469144 12166 ts_tablet_manager.cc:1428] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250625 14:01:56.469575 12166 tablet_bootstrap.cc:492] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.470505 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 4617bb8a015d42188beba9df61df2c9f (table default.Table_4c4a6ce84e424391a7e70a54a79913eb [id=d167abcc5579450c8d1850d50b1cf640]) successfully deleted
I20250625 14:01:56.471593 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet d8e509824fc94993b1676f5b68515002 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.472486 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 33790cc725df482e91daceca29c820eb (table default.Table_046e760e5933440995f2198870cdbc31 [id=6ef064ea2c9d4934903469536450aad7]) successfully deleted
W20250625 14:01:56.472630 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8363c9c6dab64a30b08ab92a152a3ee5 because the tablet was not found. No further retry: Not found: Tablet not found: 8363c9c6dab64a30b08ab92a152a3ee5
I20250625 14:01:56.472713 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d8e509824fc94993b1676f5b68515002 (table default.Table_209865c613024f86a2947aa757e43d68 [id=250ef151258b4c7da08be26888e9ecf0]) successfully deleted
I20250625 14:01:56.473719 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_469eddba721c44d599a1894bf7a95c2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.474156 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_469eddba721c44d599a1894bf7a95c2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.475064 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7854449269c249a3bce7ffeebec57005" } modify_external_catalogs: true
I20250625 14:01:56.475102 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_06caae8b35634d028c7368ee9936151a" } modify_external_catalogs: true
I20250625 14:01:56.475201 12166 tablet_bootstrap.cc:654] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.475199 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_06caae8b35634d028c7368ee9936151a" } modify_external_catalogs: true
I20250625 14:01:56.475199 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7854449269c249a3bce7ffeebec57005" } modify_external_catalogs: true
I20250625 14:01:56.476714 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet a7e0385d1c584c2d9560cbe138686565 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.476855 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 6d41c8cea082478d9cc16c143b3a3f7a from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.476871 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 562187f6db8a4883a5bb2d939a31b769 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.478024 12173 ts_tablet_manager.cc:1918] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.477253 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fde1c3b5b39545068fc40abb87f0c6cb" } new_table_name: "default.Table_91d863c5798a413a87bfb07793e23653" modify_external_catalogs: true
I20250625 14:01:56.478165 12173 log.cc:1199] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/22cfc7f3b1564e4f91114cd5e049da0d
I20250625 14:01:56.478521 12173 ts_tablet_manager.cc:1939] T 22cfc7f3b1564e4f91114cd5e049da0d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.478822 12666 raft_consensus.cc:491] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.478914 12666 raft_consensus.cc:513] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.479254 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 22cfc7f3b1564e4f91114cd5e049da0d (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:56.479319 12666 leader_election.cc:290] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:56.479557 11993 leader_election.cc:343] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: e7260f6c81d64415ae2469f87fe46c55
I20250625 14:01:56.479621 11993 leader_election.cc:304] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.479974 12430 tablet.cc:1722] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:56.480360 12666 raft_consensus.cc:2747] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.480372 12172 tablet_bootstrap.cc:492] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.480465 12172 ts_tablet_manager.cc:1397] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:01:56.481642 12166 tablet_bootstrap.cc:492] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.481727 12166 ts_tablet_manager.cc:1397] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20250625 14:01:56.481729 12172 raft_consensus.cc:357] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.481845 12172 raft_consensus.cc:383] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.481880 12172 raft_consensus.cc:738] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.482023 12172 consensus_queue.cc:260] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.482470 12172 ts_tablet_manager.cc:1428] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.482671 12172 tablet_bootstrap.cc:492] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.483261 12166 raft_consensus.cc:357] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.483384 12166 raft_consensus.cc:383] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.483425 12166 raft_consensus.cc:738] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.483569 12166 consensus_queue.cc:260] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.483712 12172 tablet_bootstrap.cc:654] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.483866 12166 ts_tablet_manager.cc:1428] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.484051 12166 tablet_bootstrap.cc:492] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:56.484735 11990 leader_election.cc:343] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 9077aa58d4d5488d812e71da4407d87b
W20250625 14:01:56.485926 11993 leader_election.cc:343] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 9077aa58d4d5488d812e71da4407d87b
I20250625 14:01:56.486001 11993 leader_election.cc:304] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.486245 12666 raft_consensus.cc:2747] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.486289 12166 tablet_bootstrap.cc:654] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.486406 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a7f797fe89204fa18340bfb43ab36cbf
I20250625 14:01:56.488646 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet a7f797fe89204fa18340bfb43ab36cbf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.488895 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet a7f797fe89204fa18340bfb43ab36cbf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.491644 11530 catalog_manager.cc:5582] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:56.491866 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:56.491993 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]). Expected version 2 got 0
I20250625 14:01:56.492098 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]). Expected version 1 got 0
I20250625 14:01:56.492208 11530 catalog_manager.cc:5582] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:56.493341 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 51440ec50d1c4dc89644b0be321d6f73 (DEFAULT_TABLE table=default.Table_7f32473eae534d38a3e455dcc176d972 [id=754d4fbc3d2b46288bf352ff3a4c7010]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.493680 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51440ec50d1c4dc89644b0be321d6f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.494673 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 9bd4226d952d4dc394c33acae7372347 (DEFAULT_TABLE table=default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.494930 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd4226d952d4dc394c33acae7372347. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.495947 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 93d666f4b403435287f4157bda971193 (DEFAULT_TABLE table=default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.496240 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d666f4b403435287f4157bda971193. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.496300 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 (DEFAULT_TABLE table=default.Table_6e519c7cc312409181ac8bca5e400b80 [id=5ead0c4cbc05488789ec165f1dd645fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.496580 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df220bf9c8447c5ac4ad35a145a8796. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.496737 12032 tablet_service.cc:1468] Processing CreateTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d (DEFAULT_TABLE table=default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.496970 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cf1f09ba14436cbdce5a58da0f202d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.498759 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 51440ec50d1c4dc89644b0be321d6f73 (DEFAULT_TABLE table=default.Table_7f32473eae534d38a3e455dcc176d972 [id=754d4fbc3d2b46288bf352ff3a4c7010]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.498976 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51440ec50d1c4dc89644b0be321d6f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.498988 12600 raft_consensus.cc:491] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.499064 12600 raft_consensus.cc:513] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.499428 12600 leader_election.cc:290] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.500010 11755 tablet_service.cc:1468] Processing CreateTablet for tablet be4378f7781541d7866e6d5c440b13e6 (DEFAULT_TABLE table=default.Table_2fcd7c144c704f17884e81b9884d604f [id=033b59dd293a483e9ecda65417ceecf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.500196 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7300adf77db4dafa942e06f07e635a9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.500284 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4378f7781541d7866e6d5c440b13e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.500550 11855 leader_election.cc:343] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.500839 12666 raft_consensus.cc:491] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.500924 12666 raft_consensus.cc:513] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.501116 11896 tablet_service.cc:1468] Processing CreateTablet for tablet be4378f7781541d7866e6d5c440b13e6 (DEFAULT_TABLE table=default.Table_2fcd7c144c704f17884e81b9884d604f [id=033b59dd293a483e9ecda65417ceecf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.501266 12666 leader_election.cc:290] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.501379 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4378f7781541d7866e6d5c440b13e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.501765 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee3cc1074818466a97d04f0136eaea92" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.501900 11921 raft_consensus.cc:2391] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:56.502645 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 9bd4226d952d4dc394c33acae7372347 (DEFAULT_TABLE table=default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.502875 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd4226d952d4dc394c33acae7372347. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.503175 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet bfdb34255cb147c48a322514b7a7a19d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfdb34255cb147c48a322514b7a7a19d already in progress: creating tablet
W20250625 14:01:56.503712 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet e307709d217643358c7c3efb3dd73747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e307709d217643358c7c3efb3dd73747 already in progress: creating tablet
I20250625 14:01:56.503803 12028 tablet_service.cc:1468] Processing CreateTablet for tablet be4378f7781541d7866e6d5c440b13e6 (DEFAULT_TABLE table=default.Table_2fcd7c144c704f17884e81b9884d604f [id=033b59dd293a483e9ecda65417ceecf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.504074 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4378f7781541d7866e6d5c440b13e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.504676 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 already in progress: creating tablet
I20250625 14:01:56.504879 12173 tablet_replica.cc:331] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.505007 12173 raft_consensus.cc:2241] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.505124 12173 raft_consensus.cc:2270] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.505949 12172 tablet_bootstrap.cc:492] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.506039 12172 ts_tablet_manager.cc:1397] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:56.506268 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 9bd4226d952d4dc394c33acae7372347 (DEFAULT_TABLE table=default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.506553 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd4226d952d4dc394c33acae7372347. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.506529 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7300adf77db4dafa942e06f07e635a9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.506655 11784 raft_consensus.cc:2466] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.506788 12172 raft_consensus.cc:357] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.506892 12172 raft_consensus.cc:383] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.506938 12172 raft_consensus.cc:738] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.506968 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 51440ec50d1c4dc89644b0be321d6f73 (DEFAULT_TABLE table=default.Table_7f32473eae534d38a3e455dcc176d972 [id=754d4fbc3d2b46288bf352ff3a4c7010]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.507040 12172 consensus_queue.cc:260] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.507189 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51440ec50d1c4dc89644b0be321d6f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.507303 12172 ts_tablet_manager.cc:1428] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.507488 12172 tablet_bootstrap.cc:492] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.508509 12172 tablet_bootstrap.cc:654] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.508553 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6d41c8cea082478d9cc16c143b3a3f7a
I20250625 14:01:56.508867 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 6d41c8cea082478d9cc16c143b3a3f7a deleted and replaced by tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b
I20250625 14:01:56.509121 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 562187f6db8a4883a5bb2d939a31b769
W20250625 14:01:56.509215 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07497399a6cd463f8d20d33d9db1d46b consensus state has no leader
I20250625 14:01:56.509267 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet a7f797fe89204fa18340bfb43ab36cbf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.509351 11526 catalog_manager.cc:6652] ReplaceTablet: tablet 562187f6db8a4883a5bb2d939a31b769 deleted and replaced by tablet fce93c919a3446bb9999be958e08b500
I20250625 14:01:56.509549 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a7e0385d1c584c2d9560cbe138686565
I20250625 14:01:56.509702 11895 tablet_service.cc:1468] Processing CreateTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d (DEFAULT_TABLE table=default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.509783 11533 catalog_manager.cc:6652] ReplaceTablet: tablet a7e0385d1c584c2d9560cbe138686565 deleted and replaced by tablet a4ca3d5203a64d99912765b83af97c09
I20250625 14:01:56.509791 12175 tablet_replica.cc:331] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.509941 12175 raft_consensus.cc:2241] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.509985 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cf1f09ba14436cbdce5a58da0f202d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.509999 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1dc443822d504733b5d67e212020df0e
I20250625 14:01:56.510053 12175 raft_consensus.cc:2270] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.510394 12177 tablet_replica.cc:331] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.510526 12177 raft_consensus.cc:2241] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.510637 12175 ts_tablet_manager.cc:1905] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.510649 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 (DEFAULT_TABLE table=default.Table_6e519c7cc312409181ac8bca5e400b80 [id=5ead0c4cbc05488789ec165f1dd645fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.510712 12177 raft_consensus.cc:2270] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.510871 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df220bf9c8447c5ac4ad35a145a8796. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.511581 12177 ts_tablet_manager.cc:1905] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.512423 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 (DEFAULT_TABLE table=default.Table_6e519c7cc312409181ac8bca5e400b80 [id=5ead0c4cbc05488789ec165f1dd645fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.512691 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df220bf9c8447c5ac4ad35a145a8796. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.512940 12175 ts_tablet_manager.cc:1918] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.513007 12175 log.cc:1199] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/33790cc725df482e91daceca29c820eb
I20250625 14:01:56.513221 12175 ts_tablet_manager.cc:1939] T 33790cc725df482e91daceca29c820eb P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.513741 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 140c1810e98741479c3754729409b46c (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.513835 12177 ts_tablet_manager.cc:1918] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.513914 12177 log.cc:1199] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a7f797fe89204fa18340bfb43ab36cbf
I20250625 14:01:56.513979 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140c1810e98741479c3754729409b46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.514180 12177 ts_tablet_manager.cc:1939] T a7f797fe89204fa18340bfb43ab36cbf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.514338 12175 tablet_replica.cc:331] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.514473 12175 raft_consensus.cc:2241] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.514497 11755 tablet_service.cc:1468] Processing CreateTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d (DEFAULT_TABLE table=default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.514567 12175 raft_consensus.cc:2270] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.514698 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cf1f09ba14436cbdce5a58da0f202d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.515017 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 93d666f4b403435287f4157bda971193 (DEFAULT_TABLE table=default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.515239 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d666f4b403435287f4157bda971193. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.515789 12175 ts_tablet_manager.cc:1905] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.517447 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 5fb1f0297ff443818507584b4ab00ddf (DEFAULT_TABLE table=default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.517652 12167 tablet_bootstrap.cc:492] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.517736 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb1f0297ff443818507584b4ab00ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.517987 12175 ts_tablet_manager.cc:1918] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.517975 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 5fb1f0297ff443818507584b4ab00ddf (DEFAULT_TABLE table=default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.518074 12175 log.cc:1199] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/704ecf1ea8dd423ead2a0d1be113c03d
I20250625 14:01:56.518217 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb1f0297ff443818507584b4ab00ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.518383 12175 ts_tablet_manager.cc:1939] T 704ecf1ea8dd423ead2a0d1be113c03d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.519169 12175 tablet_replica.cc:331] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.519307 12175 raft_consensus.cc:2241] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.519840 12175 raft_consensus.cc:2270] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.520129 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet a7e0385d1c584c2d9560cbe138686565 with delete_type TABLET_DATA_DELETED (replaced by tablet a4ca3d5203a64d99912765b83af97c09) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.520093 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 562187f6db8a4883a5bb2d939a31b769 with delete_type TABLET_DATA_DELETED (replaced by tablet fce93c919a3446bb9999be958e08b500) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.520093 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc443822d504733b5d67e212020df0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.517740 12167 ts_tablet_manager.cc:1397] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.000s
I20250625 14:01:56.520634 11858 leader_election.cc:304] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.520776 12175 ts_tablet_manager.cc:1905] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.520843 12167 raft_consensus.cc:357] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.520968 12167 raft_consensus.cc:383] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.521009 12167 raft_consensus.cc:738] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.520982 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_06caae8b35634d028c7368ee9936151a [id=ccfb2f80b431431db5df92e0b400520c]) successfully deleted
I20250625 14:01:56.521149 12600 raft_consensus.cc:491] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 14:01:56.521186 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a7e0385d1c584c2d9560cbe138686565 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7e0385d1c584c2d9560cbe138686565 already in progress: creating tablet
I20250625 14:01:56.521174 12167 consensus_queue.cc:260] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.521220 12600 raft_consensus.cc:513] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:56.521311 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1dc443822d504733b5d67e212020df0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dc443822d504733b5d67e212020df0e already in progress: creating tablet
W20250625 14:01:56.521435 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 562187f6db8a4883a5bb2d939a31b769 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 562187f6db8a4883a5bb2d939a31b769 already in progress: creating tablet
I20250625 14:01:56.521576 12600 leader_election.cc:290] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.521669 12600 raft_consensus.cc:2802] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.521706 12600 raft_consensus.cc:491] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.521741 12600 raft_consensus.cc:3058] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.521867 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96984bb93836413a85f112f7d162598f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:56.522212 11855 leader_election.cc:343] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.522591 12167 ts_tablet_manager.cc:1428] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.522711 12600 raft_consensus.cc:513] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.522779 12167 tablet_bootstrap.cc:492] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.523085 12600 leader_election.cc:290] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.523260 12666 raft_consensus.cc:491] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.523331 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7300adf77db4dafa942e06f07e635a9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.523708 11855 leader_election.cc:343] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.523337 12666 raft_consensus.cc:513] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.524118 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 5fb1f0297ff443818507584b4ab00ddf (DEFAULT_TABLE table=default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.524175 12666 leader_election.cc:290] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.524400 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fb1f0297ff443818507584b4ab00ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.524588 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "61acdd21d02e4576adba8f2ff24a154a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.525842 12175 ts_tablet_manager.cc:1918] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.525904 12175 log.cc:1199] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d8e509824fc94993b1676f5b68515002
I20250625 14:01:56.526136 12666 raft_consensus.cc:491] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.526217 12666 raft_consensus.cc:513] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.526602 12666 leader_election.cc:290] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.527276 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:56.527392 11527 catalog_manager.cc:5582] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:56.527568 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
W20250625 14:01:56.527678 11993 leader_election.cc:343] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 7302430d7e4a4610bfe271c114718d35
I20250625 14:01:56.527711 11527 catalog_manager.cc:5582] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:56.527925 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]). Expected version 3 got 0
I20250625 14:01:56.527993 12175 ts_tablet_manager.cc:1939] T d8e509824fc94993b1676f5b68515002 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.528033 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]). Expected version 1 got 0
I20250625 14:01:56.528218 11527 catalog_manager.cc:5582] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:56.528364 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.528491 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]). Expected version 2 got 0
I20250625 14:01:56.528554 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]). Expected version 1 got 0
I20250625 14:01:56.528878 12175 tablet_replica.cc:331] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.529040 12175 raft_consensus.cc:2241] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.529172 12175 raft_consensus.cc:2270] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.530061 12175 ts_tablet_manager.cc:1905] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.530745 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96984bb93836413a85f112f7d162598f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.530860 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e7300adf77db4dafa942e06f07e635a9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.528936 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ee3cc1074818466a97d04f0136eaea92" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.530951 11780 raft_consensus.cc:3058] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.531162 11990 leader_election.cc:343] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 61acdd21d02e4576adba8f2ff24a154a
I20250625 14:01:56.531227 11993 leader_election.cc:304] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.531342 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.531435 12666 raft_consensus.cc:3058] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.531927 11780 raft_consensus.cc:2466] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.532277 11858 leader_election.cc:304] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.532419 12666 raft_consensus.cc:2747] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.532516 12265 raft_consensus.cc:2802] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.531230 11990 leader_election.cc:304] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.532610 12265 raft_consensus.cc:695] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
W20250625 14:01:56.532738 11990 leader_election.cc:343] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 7302430d7e4a4610bfe271c114718d35
I20250625 14:01:56.532768 12167 tablet_bootstrap.cc:654] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.532791 11990 leader_election.cc:304] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.532742 12265 consensus_queue.cc:237] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.530870 11782 raft_consensus.cc:2466] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.532984 12800 raft_consensus.cc:2747] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.533087 12800 raft_consensus.cc:2747] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.535017 11858 leader_election.cc:304] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.536454 12265 raft_consensus.cc:2802] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.536525 12265 raft_consensus.cc:491] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.536576 12265 raft_consensus.cc:3058] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.536811 12175 ts_tablet_manager.cc:1918] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.536877 12175 log.cc:1199] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/a7f797fe89204fa18340bfb43ab36cbf
W20250625 14:01:56.537045 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6d41c8cea082478d9cc16c143b3a3f7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d41c8cea082478d9cc16c143b3a3f7a already in progress: creating tablet
I20250625 14:01:56.537128 12175 ts_tablet_manager.cc:1939] T a7f797fe89204fa18340bfb43ab36cbf P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.537482 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_608373c028f24b7583710ee5df593160"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.537590 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_55bf09a13eda41eeacbb9ef4a8473575" } modify_external_catalogs: true
I20250625 14:01:56.537616 12265 raft_consensus.cc:513] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.537670 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_55bf09a13eda41eeacbb9ef4a8473575" } modify_external_catalogs: true
W20250625 14:01:56.537969 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_608373c028f24b7583710ee5df593160 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.538026 12265 leader_election.cc:290] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.538663 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96984bb93836413a85f112f7d162598f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.538786 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96984bb93836413a85f112f7d162598f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.538908 11782 raft_consensus.cc:3058] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.539032 11855 leader_election.cc:343] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.539616 12172 tablet_bootstrap.cc:492] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.539723 12172 ts_tablet_manager.cc:1397] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:01:56.539924 11782 raft_consensus.cc:2466] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.540236 11858 leader_election.cc:304] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.540196 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1992a377fa074076a3e2b67ad1cb336d" } modify_external_catalogs: true
I20250625 14:01:56.540330 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1992a377fa074076a3e2b67ad1cb336d" } modify_external_catalogs: true
I20250625 14:01:56.540388 12265 raft_consensus.cc:2802] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.540472 12265 raft_consensus.cc:695] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.540599 12265 consensus_queue.cc:237] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.540649 12172 raft_consensus.cc:357] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.540747 12172 raft_consensus.cc:383] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.540778 12172 raft_consensus.cc:738] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.540724 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b8bd92761b75460a9dbcf41b3a2a9a4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.540906 12172 consensus_queue.cc:260] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:56.541150 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8bd92761b75460a9dbcf41b3a2a9a4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.541298 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 93d666f4b403435287f4157bda971193 (DEFAULT_TABLE table=default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.541965 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7b8124c1ff214ffaa4645d62d65091ff" } new_table_name: "default.Table_892620871def4b818f36f2c0b4f1cbed" modify_external_catalogs: true
I20250625 14:01:56.542527 12172 ts_tablet_manager.cc:1428] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:56.543120 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d666f4b403435287f4157bda971193. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.543241 12167 tablet_bootstrap.cc:492] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.543352 12167 ts_tablet_manager.cc:1397] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:01:56.544000 12167 raft_consensus.cc:357] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.544118 12167 raft_consensus.cc:383] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.544153 12167 raft_consensus.cc:738] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.546342 12172 tablet_bootstrap.cc:492] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.546664 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.547187 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.547474 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 562187f6db8a4883a5bb2d939a31b769 with delete_type TABLET_DATA_DELETED (replaced by tablet fce93c919a3446bb9999be958e08b500) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.547703 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 562187f6db8a4883a5bb2d939a31b769 with delete_type TABLET_DATA_DELETED (replaced by tablet fce93c919a3446bb9999be958e08b500) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.547801 12172 tablet_bootstrap.cc:654] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.547920 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet a7e0385d1c584c2d9560cbe138686565 with delete_type TABLET_DATA_DELETED (replaced by tablet a4ca3d5203a64d99912765b83af97c09) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.548126 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet a7e0385d1c584c2d9560cbe138686565 with delete_type TABLET_DATA_DELETED (replaced by tablet a4ca3d5203a64d99912765b83af97c09) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.548230 12265 raft_consensus.cc:491] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.548309 12265 raft_consensus.cc:513] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.548630 12265 leader_election.cc:290] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.549026 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5bba2990cca6441fb954b2f30f561708" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.549149 11782 raft_consensus.cc:2466] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.549171 12172 tablet_bootstrap.cc:492] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.549256 12172 ts_tablet_manager.cc:1397] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:56.549801 12172 raft_consensus.cc:357] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.549906 12172 raft_consensus.cc:383] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.549865 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5bba2990cca6441fb954b2f30f561708" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.549938 12172 raft_consensus.cc:738] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.550081 12172 consensus_queue.cc:260] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.550235 11858 leader_election.cc:304] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.550424 12265 raft_consensus.cc:2802] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.550472 12265 raft_consensus.cc:491] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.550514 12265 raft_consensus.cc:3058] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.551187 12172 ts_tablet_manager.cc:1428] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.551272 12167 consensus_queue.cc:260] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.551656 12265 raft_consensus.cc:513] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.551718 12167 ts_tablet_manager.cc:1428] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20250625 14:01:56.551937 12167 tablet_bootstrap.cc:492] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.551913 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 140c1810e98741479c3754729409b46c from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.552021 12265 leader_election.cc:290] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.552933 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5bba2990cca6441fb954b2f30f561708" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.553025 11782 raft_consensus.cc:3058] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.553040 11855 leader_election.cc:343] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.553361 12666 raft_consensus.cc:491] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.553398 12167 tablet_bootstrap.cc:654] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.553447 12172 tablet_bootstrap.cc:492] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.553438 12666 raft_consensus.cc:513] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.553761 12666 leader_election.cc:290] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.554028 11782 raft_consensus.cc:2466] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.554054 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5bba2990cca6441fb954b2f30f561708" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.554490 11993 leader_election.cc:343] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: a7ede0ddacb74e39b07f175b5ef2a2c5
I20250625 14:01:56.554541 11858 leader_election.cc:304] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.554726 12172 tablet_bootstrap.cc:654] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:56.554736 11855 leader_election.cc:343] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.554865 12173 ts_tablet_manager.cc:1905] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:56.555414 11990 leader_election.cc:343] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: a7ede0ddacb74e39b07f175b5ef2a2c5
I20250625 14:01:56.555490 11990 leader_election.cc:304] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.555719 12600 raft_consensus.cc:2802] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.555792 12600 raft_consensus.cc:695] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.555851 12172 tablet_bootstrap.cc:492] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.555917 12600 consensus_queue.cc:237] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.556022 12666 raft_consensus.cc:2747] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.556151 12172 ts_tablet_manager.cc:1397] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:56.556619 12172 raft_consensus.cc:357] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.556708 12172 raft_consensus.cc:383] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.556737 12172 raft_consensus.cc:738] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.556857 12172 consensus_queue.cc:260] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.557458 12172 ts_tablet_manager.cc:1428] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.558251 12173 ts_tablet_manager.cc:1918] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.558342 12173 log.cc:1199] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/599bd5368dfc4ea0bd23ea4f18fe3c60
I20250625 14:01:56.558591 12173 ts_tablet_manager.cc:1939] T 599bd5368dfc4ea0bd23ea4f18fe3c60 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.559561 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc443822d504733b5d67e212020df0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.560993 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]). Expected version 1 got 0
I20250625 14:01:56.561070 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 96984bb93836413a85f112f7d162598f with delete_type TABLET_DATA_DELETED (replaced by tablet a25ceea16cbb4e339c2ebcc580c47270) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.561121 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697]). Expected version 1 got 0
I20250625 14:01:56.561232 12175 tablet_replica.cc:331] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.561347 12175 raft_consensus.cc:2241] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.561448 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 599bd5368dfc4ea0bd23ea4f18fe3c60 (table default.Table_7b4c7577bd6b43bca23e1ed2d10fb086 [id=c6ffe56453b143ad961d9061478fccba]) successfully deleted
I20250625 14:01:56.561482 12175 pending_rounds.cc:70] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:56.561511 12175 pending_rounds.cc:77] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523037353267200 op_type: NO_OP noop_request { }
I20250625 14:01:56.561558 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e307709d217643358c7c3efb3dd73747 (table default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]) successfully deleted
I20250625 14:01:56.561565 12175 raft_consensus.cc:2887] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.561617 12175 raft_consensus.cc:2270] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.562209 12175 ts_tablet_manager.cc:1905] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.563604 11759 tablet_service.cc:1468] Processing CreateTablet for tablet a4199634a8be4e359cc9707d4754cac9 (DEFAULT_TABLE table=default.Table_4024f05f2d0245da8ef8d15052d80282 [id=f5c7890a67b34de29d7bb56262c9e0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.563970 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 2e5c492cb21c45f391aa20780f680d5f (DEFAULT_TABLE table=default.Table_e28b81e130be4741a8b96e733248cf1a [id=e7b04afa1b174d9ebd5d9a72d25605df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.564379 12175 ts_tablet_manager.cc:1918] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.565052 12175 log.cc:1199] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/96984bb93836413a85f112f7d162598f
I20250625 14:01:56.565364 12175 ts_tablet_manager.cc:1939] T 96984bb93836413a85f112f7d162598f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.566462 12172 tablet_bootstrap.cc:492] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.566521 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.566700 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4199634a8be4e359cc9707d4754cac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.567167 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21908df7bb384e9782b97abe6f06b0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.567584 12172 tablet_bootstrap.cc:654] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.568678 12172 tablet_bootstrap.cc:492] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.568773 12172 ts_tablet_manager.cc:1397] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
W20250625 14:01:56.566092 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56250a60d7104f22bd4b2206f3a5df14 consensus state has no leader
I20250625 14:01:56.561694 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 33790cc725df482e91daceca29c820eb (table default.Table_046e760e5933440995f2198870cdbc31 [id=6ef064ea2c9d4934903469536450aad7]) successfully deleted
I20250625 14:01:56.567224 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a8d6c5552b204ec1b2f5e4bf9eba5640
I20250625 14:01:56.569587 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5c492cb21c45f391aa20780f680d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.569607 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 704ecf1ea8dd423ead2a0d1be113c03d (table default.Table_009dda51059342099345e5463b33f6f5 [id=5344fd676e7a42d8b33297cda611d5bc]) successfully deleted
I20250625 14:01:56.569643 12172 raft_consensus.cc:357] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.569736 12172 raft_consensus.cc:383] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.569734 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d8e509824fc94993b1676f5b68515002 (table default.Table_209865c613024f86a2947aa757e43d68 [id=250ef151258b4c7da08be26888e9ecf0]) successfully deleted
I20250625 14:01:56.569768 12172 raft_consensus.cc:738] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.569818 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_06caae8b35634d028c7368ee9936151a [id=ccfb2f80b431431db5df92e0b400520c]) successfully deleted
W20250625 14:01:56.561713 11530 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_02bf78c154554f73967743f837e7114e [id=f8968164e2534f03a9b0562f6c565697], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e3af8a01ca1f49afb8aa1834807abf7e consensus state has no leader
I20250625 14:01:56.569902 12172 consensus_queue.cc:260] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:56.570015 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6d41c8cea082478d9cc16c143b3a3f7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d41c8cea082478d9cc16c143b3a3f7a already in progress: creating tablet
W20250625 14:01:56.570133 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 562187f6db8a4883a5bb2d939a31b769 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 562187f6db8a4883a5bb2d939a31b769 already in progress: creating tablet
I20250625 14:01:56.570190 12172 ts_tablet_manager.cc:1428] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20250625 14:01:56.570245 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a7e0385d1c584c2d9560cbe138686565 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7e0385d1c584c2d9560cbe138686565 already in progress: creating tablet
W20250625 14:01:56.570385 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1dc443822d504733b5d67e212020df0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dc443822d504733b5d67e212020df0e already in progress: creating tablet
I20250625 14:01:56.570823 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 96984bb93836413a85f112f7d162598f (table default.Table_4d04289158c94a1a95157a785c3d5829 [id=ffe2f2ab5919440396e245783c966fd3]) successfully deleted
I20250625 14:01:56.571545 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 140c1810e98741479c3754729409b46c (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.571609 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 5bba2990cca6441fb954b2f30f561708 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.571831 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140c1810e98741479c3754729409b46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.572476 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.573014 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 34bdfb2527c14c7985bc790dcb4d0657 (DEFAULT_TABLE table=default.Table_fd48790fd8f847dba7cbe4437a3eb495 [id=7efc206af13f4104ac48319db0200d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.573590 11530 catalog_manager.cc:5582] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:56.573915 12175 tablet_replica.cc:331] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.574071 12175 raft_consensus.cc:2241] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.574251 12175 pending_rounds.cc:70] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:56.574292 12175 pending_rounds.cc:77] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523037414301696 op_type: NO_OP noop_request { }
I20250625 14:01:56.574375 12175 raft_consensus.cc:2887] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.574430 12175 raft_consensus.cc:2270] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.574553 12172 tablet_bootstrap.cc:492] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.575166 11756 tablet_service.cc:1468] Processing CreateTablet for tablet c751d05cac1d4d65965e0aca2a94c14a (DEFAULT_TABLE table=default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.575165 11894 tablet_service.cc:1468] Processing CreateTablet for tablet a4199634a8be4e359cc9707d4754cac9 (DEFAULT_TABLE table=default.Table_4024f05f2d0245da8ef8d15052d80282 [id=f5c7890a67b34de29d7bb56262c9e0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.575436 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4199634a8be4e359cc9707d4754cac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.575435 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 0542b05b9bd5489995ff972289d4b9c5 (DEFAULT_TABLE table=default.Table_11c5f28c7d9c4da59371b1ef5a1d0031 [id=ca9692e6bb984585b43995ad4eceda1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.575686 12172 tablet_bootstrap.cc:654] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.575726 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c751d05cac1d4d65965e0aca2a94c14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.575992 12175 ts_tablet_manager.cc:1905] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.576960 12172 tablet_bootstrap.cc:492] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.577052 12172 ts_tablet_manager.cc:1397] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:56.577514 12172 raft_consensus.cc:357] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.577631 12172 raft_consensus.cc:383] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.577682 12172 raft_consensus.cc:738] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.577797 12172 consensus_queue.cc:260] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.578073 12172 ts_tablet_manager.cc:1428] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.578248 12172 tablet_bootstrap.cc:492] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.578480 12175 ts_tablet_manager.cc:1918] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.578552 12175 log.cc:1199] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/5bba2990cca6441fb954b2f30f561708
I20250625 14:01:56.578809 12175 ts_tablet_manager.cc:1939] T 5bba2990cca6441fb954b2f30f561708 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.579113 12177 tablet_replica.cc:331] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.579277 12177 raft_consensus.cc:2241] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.579308 12172 tablet_bootstrap.cc:654] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.579471 12177 raft_consensus.cc:2270] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.579851 12177 ts_tablet_manager.cc:1905] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.580652 12172 tablet_bootstrap.cc:492] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.580731 12172 ts_tablet_manager.cc:1397] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:56.581225 12172 raft_consensus.cc:357] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.581344 12172 raft_consensus.cc:383] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.581383 12172 raft_consensus.cc:738] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.581507 12172 consensus_queue.cc:260] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.581773 12172 ts_tablet_manager.cc:1428] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.581964 12172 tablet_bootstrap.cc:492] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.582161 12177 ts_tablet_manager.cc:1918] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.582231 12177 log.cc:1199] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a8d6c5552b204ec1b2f5e4bf9eba5640
I20250625 14:01:56.582460 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0542b05b9bd5489995ff972289d4b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.583357 12172 tablet_bootstrap.cc:654] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.584549 12172 tablet_bootstrap.cc:492] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.584631 12172 ts_tablet_manager.cc:1397] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:56.584851 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bdfb2527c14c7985bc790dcb4d0657. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.585237 12172 raft_consensus.cc:357] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.585325 12172 raft_consensus.cc:383] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.585352 12172 raft_consensus.cc:738] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.585466 12172 consensus_queue.cc:260] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.585667 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.585755 12172 ts_tablet_manager.cc:1428] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:56.585932 12172 tablet_bootstrap.cc:492] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.585948 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21908df7bb384e9782b97abe6f06b0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.586923 12172 tablet_bootstrap.cc:654] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.587539 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 2e5c492cb21c45f391aa20780f680d5f (DEFAULT_TABLE table=default.Table_e28b81e130be4741a8b96e733248cf1a [id=e7b04afa1b174d9ebd5d9a72d25605df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.587600 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.587796 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5c492cb21c45f391aa20780f680d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.588250 12172 tablet_bootstrap.cc:492] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.588332 12172 ts_tablet_manager.cc:1397] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:01:56.588431 12177 ts_tablet_manager.cc:1939] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.588807 12172 raft_consensus.cc:357] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.588924 12172 raft_consensus.cc:383] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.588963 12172 raft_consensus.cc:738] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.589016 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]) successfully deleted
I20250625 14:01:56.589092 12172 consensus_queue.cc:260] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.589401 12172 ts_tablet_manager.cc:1428] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.589568 12172 tablet_bootstrap.cc:492] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.589850 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 34bdfb2527c14c7985bc790dcb4d0657 (DEFAULT_TABLE table=default.Table_fd48790fd8f847dba7cbe4437a3eb495 [id=7efc206af13f4104ac48319db0200d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.590113 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bdfb2527c14c7985bc790dcb4d0657. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.559238 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc443822d504733b5d67e212020df0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.559281 12666 raft_consensus.cc:491] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.584482 12028 tablet_service.cc:1468] Processing CreateTablet for tablet a4199634a8be4e359cc9707d4754cac9 (DEFAULT_TABLE table=default.Table_4024f05f2d0245da8ef8d15052d80282 [id=f5c7890a67b34de29d7bb56262c9e0c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.593142 12666 raft_consensus.cc:513] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.584558 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 61acdd21d02e4576adba8f2ff24a154a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.586902 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.593389 12238 raft_consensus.cc:491] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.589967 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet a8d6c5552b204ec1b2f5e4bf9eba5640 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.593470 12238 raft_consensus.cc:513] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.593555 12666 leader_election.cc:290] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.593588 12175 tablet_replica.cc:331] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.571545 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 140c1810e98741479c3754729409b46c (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.590732 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 2e5c492cb21c45f391aa20780f680d5f (DEFAULT_TABLE table=default.Table_e28b81e130be4741a8b96e733248cf1a [id=e7b04afa1b174d9ebd5d9a72d25605df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.593732 12175 raft_consensus.cc:2241] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.593765 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet fbf41efa64294f388894a9a57b45fdc2 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.593856 12175 raft_consensus.cc:2270] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.593847 12238 leader_election.cc:290] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.594058 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c825977e422407486587f28af36bd68" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.594278 12175 ts_tablet_manager.cc:1905] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.595050 11902 tablet_service.cc:1468] Processing CreateTablet for tablet c751d05cac1d4d65965e0aca2a94c14a (DEFAULT_TABLE table=default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.595619 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 140c1810e98741479c3754729409b46c
I20250625 14:01:56.595917 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 140c1810e98741479c3754729409b46c deleted and replaced by tablet 3e56586f5cd745a397bf6ed1a63d070e
I20250625 14:01:56.595959 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fc948c61d54a4618856b64a12a32b2c4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.596077 11919 raft_consensus.cc:2466] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.596704 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fc948c61d54a4618856b64a12a32b2c4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.596781 11717 leader_election.cc:304] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.596908 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3c825977e422407486587f28af36bd68" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:56.597038 11717 leader_election.cc:343] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.597174 12238 raft_consensus.cc:2802] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.597224 12238 raft_consensus.cc:491] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.597259 12238 raft_consensus.cc:3058] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.597518 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 0542b05b9bd5489995ff972289d4b9c5 (DEFAULT_TABLE table=default.Table_11c5f28c7d9c4da59371b1ef5a1d0031 [id=ca9692e6bb984585b43995ad4eceda1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.597750 12055 raft_consensus.cc:3058] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.559154 12173 tablet_replica.cc:331] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.598055 12173 raft_consensus.cc:2241] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.598294 12238 raft_consensus.cc:513] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.598183 12173 raft_consensus.cc:2270] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.598691 12238 leader_election.cc:290] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.598937 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fc948c61d54a4618856b64a12a32b2c4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.599054 11919 raft_consensus.cc:3058] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.599381 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 34bdfb2527c14c7985bc790dcb4d0657 (DEFAULT_TABLE table=default.Table_fd48790fd8f847dba7cbe4437a3eb495 [id=7efc206af13f4104ac48319db0200d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.599663 12029 tablet_service.cc:1468] Processing CreateTablet for tablet c751d05cac1d4d65965e0aca2a94c14a (DEFAULT_TABLE table=default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.600103 11919 raft_consensus.cc:2466] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.600051 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2ff002b6b65e448d8abb729088ca4ac2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.600481 11717 leader_election.cc:304] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:56.600515 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ff002b6b65e448d8abb729088ca4ac2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.600752 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 140c1810e98741479c3754729409b46c with delete_type TABLET_DATA_DELETED (replaced by tablet 3e56586f5cd745a397bf6ed1a63d070e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.600823 12238 raft_consensus.cc:2802] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.600898 12238 raft_consensus.cc:695] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.601024 12238 consensus_queue.cc:237] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.601347 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fd6351d08daa4564ba49cf00d72ecd56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.601403 12173 ts_tablet_manager.cc:1905] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.601645 11993 leader_election.cc:304] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:01:56.601681 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd6351d08daa4564ba49cf00d72ecd56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:56.601866 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 140c1810e98741479c3754729409b46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 140c1810e98741479c3754729409b46c already in progress: creating tablet
I20250625 14:01:56.601879 12666 raft_consensus.cc:2747] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.602097 12172 tablet_bootstrap.cc:654] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.603498 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4199634a8be4e359cc9707d4754cac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.604079 12861 tablet.cc:1722] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:56.605423 12173 ts_tablet_manager.cc:1918] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.605484 12173 log.cc:1199] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/39ff4b0e7ac74ec294550775aaa44468
I20250625 14:01:56.605553 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fc948c61d54a4618856b64a12a32b2c4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.605695 12173 ts_tablet_manager.cc:1939] T 39ff4b0e7ac74ec294550775aaa44468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.605763 12861 tablet.cc:1722] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:56.606261 12172 tablet_bootstrap.cc:492] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.606384 12172 ts_tablet_manager.cc:1397] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20250625 14:01:56.606606 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f0c5509615cf45339c455e8add91a96f
I20250625 14:01:56.606904 12172 raft_consensus.cc:357] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.607005 12172 raft_consensus.cc:383] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.607038 12172 raft_consensus.cc:738] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.607160 12172 consensus_queue.cc:260] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.607470 12172 ts_tablet_manager.cc:1428] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:56.607741 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 5bba2990cca6441fb954b2f30f561708 (table default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]) successfully deleted
I20250625 14:01:56.607767 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 0542b05b9bd5489995ff972289d4b9c5 (DEFAULT_TABLE table=default.Table_11c5f28c7d9c4da59371b1ef5a1d0031 [id=ca9692e6bb984585b43995ad4eceda1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.608013 12172 tablet_bootstrap.cc:492] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.608184 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c751d05cac1d4d65965e0aca2a94c14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.608644 12166 tablet_bootstrap.cc:492] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.608726 12166 ts_tablet_manager.cc:1397] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.125s user 0.001s sys 0.001s
I20250625 14:01:56.609112 12172 tablet_bootstrap.cc:654] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.609191 12166 raft_consensus.cc:357] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.609318 12166 raft_consensus.cc:383] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.609362 12166 raft_consensus.cc:738] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.609481 12166 consensus_queue.cc:260] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.609747 12166 ts_tablet_manager.cc:1428] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.609932 12166 tablet_bootstrap.cc:492] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.610276 12167 tablet_bootstrap.cc:492] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.610394 12167 ts_tablet_manager.cc:1397] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
I20250625 14:01:56.610831 12167 raft_consensus.cc:357] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.610949 12167 raft_consensus.cc:383] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.610954 12166 tablet_bootstrap.cc:654] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.610984 12167 raft_consensus.cc:738] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.611117 12167 consensus_queue.cc:260] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.611416 12167 ts_tablet_manager.cc:1428] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.612246 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_02bf78c154554f73967743f837e7114e" } new_table_name: "default.Table_8354c456c6bc43a6a7f1925797c6e199" modify_external_catalogs: true
W20250625 14:01:56.612713 11717 leader_election.cc:343] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.613863 12172 tablet_bootstrap.cc:492] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.613945 12172 ts_tablet_manager.cc:1397] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250625 14:01:56.614387 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_675a9837739b463fbb71d870eda3a3c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.614473 12172 raft_consensus.cc:357] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.614566 12172 raft_consensus.cc:383] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.614595 12172 raft_consensus.cc:738] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.614720 12172 consensus_queue.cc:260] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:56.614790 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_675a9837739b463fbb71d870eda3a3c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.615033 12172 ts_tablet_manager.cc:1428] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.615252 12172 tablet_bootstrap.cc:492] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.616282 12172 tablet_bootstrap.cc:654] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.617731 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0542b05b9bd5489995ff972289d4b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.617983 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e07ec41a73ce4df9ab09b63d87da79be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.618396 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_99e3b9f63eb947ed8424df6c7a25de5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.618458 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_25d3401a208e46edaf722d190be3cd2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.618726 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99e3b9f63eb947ed8424df6c7a25de5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:56.618773 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25d3401a208e46edaf722d190be3cd2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.618911 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet f0c5509615cf45339c455e8add91a96f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.619065 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 96984bb93836413a85f112f7d162598f with delete_type TABLET_DATA_DELETED (replaced by tablet a25ceea16cbb4e339c2ebcc580c47270) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.619175 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 5bba2990cca6441fb954b2f30f561708 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.619289 12177 tablet_replica.cc:331] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.619408 12177 raft_consensus.cc:2241] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:01:56.619524 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e07ec41a73ce4df9ab09b63d87da79be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.619616 12177 raft_consensus.cc:2270] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.620011 12177 ts_tablet_manager.cc:1905] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.620195 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8641654309e1491691b376a5cb7b52cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.620520 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8641654309e1491691b376a5cb7b52cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.621513 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140c1810e98741479c3754729409b46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.621543 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet f0c5509615cf45339c455e8add91a96f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.622453 12177 ts_tablet_manager.cc:1918] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.622525 12177 log.cc:1199] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f0c5509615cf45339c455e8add91a96f
I20250625 14:01:56.622588 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet e307709d217643358c7c3efb3dd73747 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc5b8ea4f3b47f19c603c235fa79007) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.622732 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.622789 12177 ts_tablet_manager.cc:1939] T f0c5509615cf45339c455e8add91a96f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.622835 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 61acdd21d02e4576adba8f2ff24a154a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.623531 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet f0c5509615cf45339c455e8add91a96f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.623695 12177 tablet_replica.cc:331] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.623852 12177 raft_consensus.cc:2241] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.623880 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5c492cb21c45f391aa20780f680d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.623987 12177 raft_consensus.cc:2270] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.624547 12177 ts_tablet_manager.cc:1905] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.625051 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 140c1810e98741479c3754729409b46c with delete_type TABLET_DATA_DELETED (replaced by tablet 3e56586f5cd745a397bf6ed1a63d070e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.626614 12177 ts_tablet_manager.cc:1918] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.626680 12177 log.cc:1199] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/96984bb93836413a85f112f7d162598f
I20250625 14:01:56.626881 12177 ts_tablet_manager.cc:1939] T 96984bb93836413a85f112f7d162598f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.627128 12666 raft_consensus.cc:491] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.627213 12666 raft_consensus.cc:513] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.627385 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bdfb2527c14c7985bc790dcb4d0657. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.627612 12666 leader_election.cc:290] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:56.628413 11990 leader_election.cc:343] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 6bcdf4d901e34ab5ba2c36fe53456f0e
W20250625 14:01:56.629590 11993 leader_election.cc:343] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 6bcdf4d901e34ab5ba2c36fe53456f0e
I20250625 14:01:56.629680 11993 leader_election.cc:304] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.629871 12666 raft_consensus.cc:2747] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.629587 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c751d05cac1d4d65965e0aca2a94c14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.632764 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21908df7bb384e9782b97abe6f06b0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.634845 12166 tablet_bootstrap.cc:492] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.634963 12166 ts_tablet_manager.cc:1397] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.002s
I20250625 14:01:56.635469 12166 raft_consensus.cc:357] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.635561 12166 raft_consensus.cc:383] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.635582 12166 raft_consensus.cc:738] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.635617 12175 ts_tablet_manager.cc:1918] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.635691 12175 log.cc:1199] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/a8d6c5552b204ec1b2f5e4bf9eba5640
I20250625 14:01:56.635859 12166 consensus_queue.cc:260] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.635972 12175 ts_tablet_manager.cc:1939] T a8d6c5552b204ec1b2f5e4bf9eba5640 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.636184 12166 ts_tablet_manager.cc:1428] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:56.636355 12166 tablet_bootstrap.cc:492] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.636488 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 140c1810e98741479c3754729409b46c with delete_type TABLET_DATA_DELETED (replaced by tablet 3e56586f5cd745a397bf6ed1a63d070e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.637058 12600 raft_consensus.cc:491] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.637152 12600 raft_consensus.cc:513] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.637411 12166 tablet_bootstrap.cc:654] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.637490 12600 leader_election.cc:290] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.637858 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 33790cc725df482e91daceca29c820eb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.637876 12855 raft_consensus.cc:491] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.637871 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5c017990c54099b1cdbddc75a12e10" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.637990 12855 raft_consensus.cc:513] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.638397 12855 leader_election.cc:290] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.638583 12177 tablet_replica.cc:331] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.638607 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5c017990c54099b1cdbddc75a12e10" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:56.638618 11855 leader_election.cc:343] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.638703 11780 raft_consensus.cc:2466] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.638926 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "deee7c3fb5204c63a6618f628848bc81" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.639178 11858 leader_election.cc:304] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.639341 12600 raft_consensus.cc:2802] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.639391 12600 raft_consensus.cc:491] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.639431 12600 raft_consensus.cc:3058] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.639564 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "deee7c3fb5204c63a6618f628848bc81" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.638710 12177 raft_consensus.cc:2241] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.639933 12177 raft_consensus.cc:2270] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.640287 12855 raft_consensus.cc:491] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.640362 12855 raft_consensus.cc:513] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.640456 12177 ts_tablet_manager.cc:1905] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.640501 12600 raft_consensus.cc:513] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.640657 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f0c5509615cf45339c455e8add91a96f (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]) successfully deleted
I20250625 14:01:56.640674 12855 leader_election.cc:290] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.640792 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 96984bb93836413a85f112f7d162598f (table default.Table_4d04289158c94a1a95157a785c3d5829 [id=ffe2f2ab5919440396e245783c966fd3]) successfully deleted
I20250625 14:01:56.640837 12600 leader_election.cc:290] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.641261 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cf7c90591044422fb0bd51e503ec2b0f" } new_table_name: "default.Table_68da0f72df6e43e799a678a4f7211cef" modify_external_catalogs: true
I20250625 14:01:56.641672 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0542b05b9bd5489995ff972289d4b9c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.642062 12172 tablet_bootstrap.cc:492] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.642156 12172 ts_tablet_manager.cc:1397] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.002s
I20250625 14:01:56.642674 12172 raft_consensus.cc:357] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.642773 12172 raft_consensus.cc:383] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.642804 12172 raft_consensus.cc:738] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.642802 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5c017990c54099b1cdbddc75a12e10" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.642819 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4024f05f2d0245da8ef8d15052d80282" } new_table_name: "default.Table_0407310c9aee4d729058ad076b9295d6" modify_external_catalogs: true
I20250625 14:01:56.642925 12172 consensus_queue.cc:260] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:56.643172 11855 leader_election.cc:343] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.643239 12172 ts_tablet_manager.cc:1428] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:56.643299 11717 leader_election.cc:343] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.643435 12172 tablet_bootstrap.cc:492] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.643792 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1f5c017990c54099b1cdbddc75a12e10" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.643893 11780 raft_consensus.cc:3058] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.644201 12167 tablet_bootstrap.cc:492] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.644524 12172 tablet_bootstrap.cc:654] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.644963 11780 raft_consensus.cc:2466] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.645154 12180 raft_consensus.cc:491] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.645224 12180 raft_consensus.cc:513] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.645267 12167 tablet_bootstrap.cc:654] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.645540 12180 leader_election.cc:290] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.645716 11858 leader_election.cc:304] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.646003 12600 raft_consensus.cc:2802] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.646095 12600 raft_consensus.cc:695] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.646237 12600 consensus_queue.cc:237] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:56.646783 11717 leader_election.cc:343] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.646808 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8fee92d68eaa4b22a7f0c122aeb5bc44" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.646854 11717 leader_election.cc:304] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.646982 12180 raft_consensus.cc:2747] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:56.648002 11717 leader_election.cc:343] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.648152 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "72efc3ed21e3404eb0a0ba4326513601" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.648762 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "72efc3ed21e3404eb0a0ba4326513601" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.649013 12173 tablet_replica.cc:331] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.649048 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8fee92d68eaa4b22a7f0c122aeb5bc44" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.649160 12173 raft_consensus.cc:2241] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.649273 12173 raft_consensus.cc:2270] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.649803 12166 tablet_bootstrap.cc:492] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.649910 12166 ts_tablet_manager.cc:1397] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20250625 14:01:56.649832 12173 ts_tablet_manager.cc:1905] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.650450 12166 raft_consensus.cc:357] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.650560 12166 raft_consensus.cc:383] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.650604 12166 raft_consensus.cc:738] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:56.651079 11717 leader_election.cc:343] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.651188 12180 raft_consensus.cc:491] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.651293 12180 raft_consensus.cc:513] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.651583 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 39ff4b0e7ac74ec294550775aaa44468 (table default.Table_7887db4b4d5c4f2a8770f9f0b73832ec [id=12bf9473cabd4d199715d23c94a02005]) successfully deleted
I20250625 14:01:56.651645 12180 leader_election.cc:290] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:01:56.651291 11717 leader_election.cc:343] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.651873 11717 leader_election.cc:304] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.652048 12238 raft_consensus.cc:2747] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:56.652155 11717 leader_election.cc:343] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.652222 11717 leader_election.cc:304] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.652638 12855 raft_consensus.cc:2747] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.653023 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5227c93e932a4ed4b3d03990d7ed7b69" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.653075 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5227c93e932a4ed4b3d03990d7ed7b69" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.653404 11919 raft_consensus.cc:1273] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:56.653528 12055 raft_consensus.cc:1273] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 14:01:56.653568 11717 leader_election.cc:343] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.653802 12166 consensus_queue.cc:260] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.654409 12166 ts_tablet_manager.cc:1428] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:56.654819 12173 ts_tablet_manager.cc:1918] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.654845 12855 consensus_queue.cc:1035] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.654945 12173 log.cc:1199] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9077aa58d4d5488d812e71da4407d87b
I20250625 14:01:56.655305 12173 ts_tablet_manager.cc:1939] T 9077aa58d4d5488d812e71da4407d87b P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:56.655328 11717 leader_election.cc:343] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.655416 11717 leader_election.cc:304] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.655557 12855 raft_consensus.cc:2747] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.655860 12855 consensus_queue.cc:1035] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.656070 12177 ts_tablet_manager.cc:1918] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.656164 12177 log.cc:1199] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/5bba2990cca6441fb954b2f30f561708
I20250625 14:01:56.656394 12166 tablet_bootstrap.cc:492] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.657116 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9077aa58d4d5488d812e71da4407d87b (table default.Table_aad2dbed98a440f19cf6aa8608d96780 [id=c485676a21514b95bab0990f6807c5c7]) successfully deleted
I20250625 14:01:56.657364 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
W20250625 14:01:56.657932 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7b78fd0d543449bdb2e95fee6a53e93f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b78fd0d543449bdb2e95fee6a53e93f already in progress: creating tablet
I20250625 14:01:56.656810 12173 tablet_replica.cc:331] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.658079 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]) successfully deleted
W20250625 14:01:56.658131 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3af8a01ca1f49afb8aa1834807abf7e consensus state has no leader
I20250625 14:01:56.658404 12175 tablet_replica.cc:331] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.658993 12175 raft_consensus.cc:2241] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.659112 12175 raft_consensus.cc:2270] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.659338 12177 ts_tablet_manager.cc:1939] T 5bba2990cca6441fb954b2f30f561708 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.659524 12173 raft_consensus.cc:2241] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.660025 12177 tablet_replica.cc:331] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.660295 12173 raft_consensus.cc:2270] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.660713 12173 ts_tablet_manager.cc:1905] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.661093 12166 tablet_bootstrap.cc:654] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.661414 12666 raft_consensus.cc:491] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.661489 12666 raft_consensus.cc:513] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.661844 12666 leader_election.cc:290] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.662182 12177 raft_consensus.cc:2241] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.662333 12177 raft_consensus.cc:2270] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:56.662822 11990 leader_election.cc:343] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: f47cf7e6d24347a88da2ee8fbd6de1b1
I20250625 14:01:56.662846 12177 ts_tablet_manager.cc:1905] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.664144 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 5bba2990cca6441fb954b2f30f561708 (table default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]) successfully deleted
I20250625 14:01:56.665004 12175 ts_tablet_manager.cc:1905] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.665248 12177 ts_tablet_manager.cc:1918] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.665328 12177 log.cc:1199] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e307709d217643358c7c3efb3dd73747
I20250625 14:01:56.665536 12177 ts_tablet_manager.cc:1939] T e307709d217643358c7c3efb3dd73747 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.666114 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]). Expected version 3 got 0
I20250625 14:01:56.666175 12177 tablet_replica.cc:331] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.666239 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:56.666299 12177 raft_consensus.cc:2241] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.666427 12177 raft_consensus.cc:2270] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.666456 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e307709d217643358c7c3efb3dd73747 (table default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]) successfully deleted
I20250625 14:01:56.667696 12167 tablet_bootstrap.cc:492] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.667797 12167 ts_tablet_manager.cc:1397] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
W20250625 14:01:56.667994 11993 leader_election.cc:343] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: f47cf7e6d24347a88da2ee8fbd6de1b1
I20250625 14:01:56.668064 11993 leader_election.cc:304] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.668239 12666 raft_consensus.cc:2747] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.668439 12167 raft_consensus.cc:357] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.668546 12167 raft_consensus.cc:383] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.668581 12167 raft_consensus.cc:738] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.668705 12167 consensus_queue.cc:260] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.668990 12167 ts_tablet_manager.cc:1428] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.669211 12167 tablet_bootstrap.cc:492] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:56.671219 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 consensus state has no leader
I20250625 14:01:56.671674 12175 ts_tablet_manager.cc:1918] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.671775 12175 log.cc:1199] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f0c5509615cf45339c455e8add91a96f
I20250625 14:01:56.671813 12167 tablet_bootstrap.cc:654] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.671957 12173 ts_tablet_manager.cc:1918] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.672066 12175 ts_tablet_manager.cc:1939] T f0c5509615cf45339c455e8add91a96f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.672096 12173 log.cc:1199] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e7260f6c81d64415ae2469f87fe46c55
I20250625 14:01:56.672433 12173 ts_tablet_manager.cc:1939] T e7260f6c81d64415ae2469f87fe46c55 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:56.672547 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4199634a8be4e359cc9707d4754cac9 consensus state has no leader
I20250625 14:01:56.672857 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f0c5509615cf45339c455e8add91a96f (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]) successfully deleted
I20250625 14:01:56.673188 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e7260f6c81d64415ae2469f87fe46c55 (table default.Table_66c17881414348d49722f825bff86a90 [id=264c5ba782504673b9d5e2caeac31b31]) successfully deleted
I20250625 14:01:56.673457 12173 tablet_replica.cc:331] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.673630 12173 raft_consensus.cc:2241] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.673789 12173 raft_consensus.cc:2270] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.674062 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.674038 12233 tablet.cc:1722] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:56.675043 12430 tablet.cc:1722] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:56.675519 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_25d3401a208e46edaf722d190be3cd2c" } modify_external_catalogs: true
I20250625 14:01:56.675693 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_25d3401a208e46edaf722d190be3cd2c" } modify_external_catalogs: true
I20250625 14:01:56.676359 12166 tablet_bootstrap.cc:492] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.676469 12166 ts_tablet_manager.cc:1397] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
W20250625 14:01:56.676559 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 140c1810e98741479c3754729409b46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 140c1810e98741479c3754729409b46c already in progress: creating tablet
I20250625 14:01:56.676965 12166 raft_consensus.cc:357] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.677081 12166 raft_consensus.cc:383] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.677119 12166 raft_consensus.cc:738] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.677120 12173 ts_tablet_manager.cc:1905] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.677263 12166 consensus_queue.cc:260] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.679430 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.679620 12600 raft_consensus.cc:491] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.679713 12173 ts_tablet_manager.cc:1918] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.679699 12600 raft_consensus.cc:513] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.679771 12173 log.cc:1199] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/92984f3be8454a969b7c39af97a11479
I20250625 14:01:56.680054 12600 leader_election.cc:290] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.680333 12166 ts_tablet_manager.cc:1428] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:56.680641 12166 tablet_bootstrap.cc:492] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.680903 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "882da47c1f5a496f8df2ba2d3501b453" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.681032 11780 raft_consensus.cc:2466] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:56.681432 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "882da47c1f5a496f8df2ba2d3501b453" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.681546 11858 leader_election.cc:304] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.681767 12600 raft_consensus.cc:2802] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.681818 12600 raft_consensus.cc:491] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.681852 12600 raft_consensus.cc:3058] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.682816 12600 raft_consensus.cc:513] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.683127 12600 leader_election.cc:290] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:56.683211 12177 ts_tablet_manager.cc:1905] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.683627 12173 ts_tablet_manager.cc:1939] T 92984f3be8454a969b7c39af97a11479 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:56.684065 11855 leader_election.cc:343] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.684370 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 92984f3be8454a969b7c39af97a11479 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]) successfully deleted
I20250625 14:01:56.684577 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "882da47c1f5a496f8df2ba2d3501b453" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.684742 12180 raft_consensus.cc:491] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.684814 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "882da47c1f5a496f8df2ba2d3501b453" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:56.684931 12173 tablet_replica.cc:331] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.684947 11780 raft_consensus.cc:3058] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.685048 11855 leader_election.cc:343] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.685066 12173 raft_consensus.cc:2241] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.685192 12173 raft_consensus.cc:2270] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.685557 12173 ts_tablet_manager.cc:1905] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.685590 12177 ts_tablet_manager.cc:1918] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.685654 12177 log.cc:1199] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/704ecf1ea8dd423ead2a0d1be113c03d
I20250625 14:01:56.685856 12177 ts_tablet_manager.cc:1939] T 704ecf1ea8dd423ead2a0d1be113c03d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.684823 12180 raft_consensus.cc:513] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.686432 12177 tablet_replica.cc:331] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.686480 12180 leader_election.cc:290] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.686563 12177 raft_consensus.cc:2241] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.685863 11780 raft_consensus.cc:2466] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:56.686699 12177 pending_rounds.cc:70] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:56.686892 12177 pending_rounds.cc:77] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523036631199744 op_type: NO_OP noop_request { }
I20250625 14:01:56.686902 11858 leader_election.cc:304] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.686954 12177 raft_consensus.cc:2887] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.687009 12177 raft_consensus.cc:2270] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.687124 12600 raft_consensus.cc:2802] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.687202 12600 raft_consensus.cc:695] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:56.687326 12600 consensus_queue.cc:237] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.687661 12177 ts_tablet_manager.cc:1905] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.687799 12173 ts_tablet_manager.cc:1918] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.687896 12173 log.cc:1199] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/1a3907e22505461a8df58ec339c342da
I20250625 14:01:56.688179 12173 ts_tablet_manager.cc:1939] T 1a3907e22505461a8df58ec339c342da P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.688799 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c562bfdf6c0f4af8bc8fed3557145b52" } modify_external_catalogs: true
I20250625 14:01:56.688946 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c562bfdf6c0f4af8bc8fed3557145b52" } modify_external_catalogs: true
I20250625 14:01:56.689409 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 704ecf1ea8dd423ead2a0d1be113c03d (table default.Table_009dda51059342099345e5463b33f6f5 [id=5344fd676e7a42d8b33297cda611d5bc]) successfully deleted
I20250625 14:01:56.689882 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "56250a60d7104f22bd4b2206f3a5df14" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.689917 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "56250a60d7104f22bd4b2206f3a5df14" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.690164 12238 consensus_queue.cc:1035] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.690497 12177 ts_tablet_manager.cc:1918] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.690573 12177 log.cc:1199] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/61acdd21d02e4576adba8f2ff24a154a
W20250625 14:01:56.690884 11717 leader_election.cc:343] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:56.691031 11717 leader_election.cc:343] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.691083 11717 leader_election.cc:304] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.691197 12855 raft_consensus.cc:2747] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.692068 12861 tablet.cc:1722] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:56.692153 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_144231cb0a3247a8ab8f184de1ecb378"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.692538 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_144231cb0a3247a8ab8f184de1ecb378 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.693149 12177 ts_tablet_manager.cc:1939] T 61acdd21d02e4576adba8f2ff24a154a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.682859 12166 tablet_bootstrap.cc:654] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.694156 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:56.694793 12233 tablet.cc:1717] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Skipping requested alter to schema version 3, tablet already version 3
I20250625 14:01:56.694865 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 61acdd21d02e4576adba8f2ff24a154a (table default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9 [id=75fe7cfcdb0c446f9af9708ba107c0b7]) successfully deleted
I20250625 14:01:56.695577 12430 tablet.cc:1717] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Skipping requested alter to schema version 3, tablet already version 3
I20250625 14:01:56.695920 12166 tablet_bootstrap.cc:492] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.695998 12166 ts_tablet_manager.cc:1397] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.002s
I20250625 14:01:56.697877 11531 catalog_manager.cc:5582] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:56.698082 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]). Expected version 2 got 0
I20250625 14:01:56.698203 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]). Expected version 1 got 0
I20250625 14:01:56.698295 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]). Expected version 1 got 0
I20250625 14:01:56.698387 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 097b49d0283541478241e6c699504174 (table default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]). Expected version 1 got 0
I20250625 14:01:56.698464 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]). Expected version 1 got 0
I20250625 14:01:56.698603 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_06a503f6355b478caf948985a84c15f6 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 3 got 0
I20250625 14:01:56.700522 11526 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 76ea91c86b7b4f04bb2bdaed2d6c942c
I20250625 14:01:56.701293 12861 tablet.cc:1717] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Skipping requested alter to schema version 3, tablet already version 3
I20250625 14:01:56.702823 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 96fcc61e48e549618197d34346ea5b16 (DEFAULT_TABLE table=default.Table_469eddba721c44d599a1894bf7a95c2a [id=5c6cac0e4f4b453db57e34f39b8f0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.703099 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fcc61e48e549618197d34346ea5b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.699808 12166 raft_consensus.cc:357] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.706068 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 96fcc61e48e549618197d34346ea5b16 (DEFAULT_TABLE table=default.Table_469eddba721c44d599a1894bf7a95c2a [id=5c6cac0e4f4b453db57e34f39b8f0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.701315 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 96fcc61e48e549618197d34346ea5b16 (DEFAULT_TABLE table=default.Table_469eddba721c44d599a1894bf7a95c2a [id=5c6cac0e4f4b453db57e34f39b8f0093]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.706149 12166 raft_consensus.cc:383] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.706184 12166 raft_consensus.cc:738] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.706346 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fcc61e48e549618197d34346ea5b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.706372 12208 consensus_queue.cc:1035] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.706396 12166 consensus_queue.cc:260] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.706830 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fcc61e48e549618197d34346ea5b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.706938 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 1a3907e22505461a8df58ec339c342da (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]) successfully deleted
I20250625 14:01:56.707178 12173 tablet_replica.cc:331] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.707329 12173 raft_consensus.cc:2241] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.707437 12173 raft_consensus.cc:2270] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.707805 12173 ts_tablet_manager.cc:1905] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.707921 12166 ts_tablet_manager.cc:1428] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20250625 14:01:56.708108 12166 tablet_bootstrap.cc:492] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.709587 12166 tablet_bootstrap.cc:654] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.710130 12173 ts_tablet_manager.cc:1918] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.710218 12173 log.cc:1199] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/68a0cfeac48042bdaea66c3b0e370480
I20250625 14:01:56.710480 12173 ts_tablet_manager.cc:1939] T 68a0cfeac48042bdaea66c3b0e370480 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.710875 11894 tablet_service.cc:1468] Processing CreateTablet for tablet f2f40caafd5e4557af321454d28fa2ab (DEFAULT_TABLE table=default.Table_b8bd92761b75460a9dbcf41b3a2a9a4b [id=70d3fc86e64847b9b7edd7945c195dc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.711146 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f40caafd5e4557af321454d28fa2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.711249 12173 tablet_replica.cc:331] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.711381 12173 raft_consensus.cc:2241] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.711480 12173 raft_consensus.cc:2270] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.711835 12173 ts_tablet_manager.cc:1905] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.712014 12166 tablet_bootstrap.cc:492] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.712090 12166 ts_tablet_manager.cc:1397] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:56.712081 12238 raft_consensus.cc:491] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.712173 12238 raft_consensus.cc:513] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.712558 12238 leader_election.cc:290] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.712857 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7541b0989fe04486be69997611bb8ca1" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.712857 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7541b0989fe04486be69997611bb8ca1" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:56.713186 11717 leader_election.cc:343] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:56.713289 11717 leader_election.cc:343] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.713325 11717 leader_election.cc:304] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.713449 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 68a0cfeac48042bdaea66c3b0e370480 (table default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
I20250625 14:01:56.713543 12166 raft_consensus.cc:357] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.713629 12166 raft_consensus.cc:383] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.713656 12166 raft_consensus.cc:738] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.713630 12180 raft_consensus.cc:2747] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.713817 12166 consensus_queue.cc:260] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.713871 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6d1c412286d94eedac62cf4f1f939f68
I20250625 14:01:56.714263 12166 ts_tablet_manager.cc:1428] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.714460 12166 tablet_bootstrap.cc:492] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.714803 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d1c412286d94eedac62cf4f1f939f68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.715317 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d1c412286d94eedac62cf4f1f939f68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.715595 12166 tablet_bootstrap.cc:654] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.716038 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d1c412286d94eedac62cf4f1f939f68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.716275 12177 tablet_replica.cc:331] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.716321 12175 tablet_replica.cc:331] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.716455 12175 raft_consensus.cc:2241] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.716550 12177 raft_consensus.cc:2241] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.716571 12175 raft_consensus.cc:2270] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.716810 12177 raft_consensus.cc:2270] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.716917 12175 ts_tablet_manager.cc:1905] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.717355 12177 ts_tablet_manager.cc:1905] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.719767 12177 ts_tablet_manager.cc:1918] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.719975 12177 log.cc:1199] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6d1c412286d94eedac62cf4f1f939f68
I20250625 14:01:56.720544 12173 ts_tablet_manager.cc:1918] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.720630 12175 ts_tablet_manager.cc:1918] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.720705 12175 log.cc:1199] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6d1c412286d94eedac62cf4f1f939f68
I20250625 14:01:56.720773 12173 log.cc:1199] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9da1d3ee457944399e60e0c5bdd8c428
I20250625 14:01:56.720865 12030 tablet_service.cc:1468] Processing CreateTablet for tablet f2f40caafd5e4557af321454d28fa2ab (DEFAULT_TABLE table=default.Table_b8bd92761b75460a9dbcf41b3a2a9a4b [id=70d3fc86e64847b9b7edd7945c195dc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.721019 12175 ts_tablet_manager.cc:1939] T 6d1c412286d94eedac62cf4f1f939f68 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.721028 12173 ts_tablet_manager.cc:1939] T 9da1d3ee457944399e60e0c5bdd8c428 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.721177 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f40caafd5e4557af321454d28fa2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.721138 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346" } modify_external_catalogs: true
I20250625 14:01:56.721258 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346" } modify_external_catalogs: true
I20250625 14:01:56.722805 12166 tablet_bootstrap.cc:492] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.722879 12166 ts_tablet_manager.cc:1397] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20250625 14:01:56.723335 12166 raft_consensus.cc:357] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.723429 12166 raft_consensus.cc:383] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.723465 12166 raft_consensus.cc:738] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.723577 12166 consensus_queue.cc:260] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.723822 12166 ts_tablet_manager.cc:1428] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.724004 12166 tablet_bootstrap.cc:492] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.724968 12166 tablet_bootstrap.cc:654] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.725553 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6d1c412286d94eedac62cf4f1f939f68 (table default.Table_c562bfdf6c0f4af8bc8fed3557145b52 [id=5e5bed4c27814fc7b14d0c4d9e091890]) successfully deleted
I20250625 14:01:56.725600 12173 tablet_replica.cc:331] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.725723 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9da1d3ee457944399e60e0c5bdd8c428 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
I20250625 14:01:56.725744 12173 raft_consensus.cc:2241] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.725849 12173 raft_consensus.cc:2270] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.726225 12173 ts_tablet_manager.cc:1905] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.727391 12166 tablet_bootstrap.cc:492] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.727478 12166 ts_tablet_manager.cc:1397] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20250625 14:01:56.727805 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a509f117fbe5458fafb958447f82921d" } new_table_name: "default.Table_dca578face4f4457a35e41ae7c8e62d9" modify_external_catalogs: true
I20250625 14:01:56.727954 12166 raft_consensus.cc:357] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.728056 12166 raft_consensus.cc:383] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.728085 12166 raft_consensus.cc:738] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.728227 12166 consensus_queue.cc:260] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.728502 12166 ts_tablet_manager.cc:1428] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.728686 12166 tablet_bootstrap.cc:492] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.728937 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 35ece361f92a4c9a9df5ad3355f87db9 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.729672 12166 tablet_bootstrap.cc:654] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.729681 12173 ts_tablet_manager.cc:1918] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.729743 12173 log.cc:1199] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/205f83a0ffbc440492e241a75657f1b8
I20250625 14:01:56.729956 12173 ts_tablet_manager.cc:1939] T 205f83a0ffbc440492e241a75657f1b8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.731920 12166 tablet_bootstrap.cc:492] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.732012 12166 ts_tablet_manager.cc:1397] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:56.732234 12173 tablet_replica.cc:331] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.732355 12173 raft_consensus.cc:2241] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.732456 12173 raft_consensus.cc:2270] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:56.732465 11531 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5227c93e932a4ed4b3d03990d7ed7b69 consensus state has no leader
I20250625 14:01:56.732475 12166 raft_consensus.cc:357] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.732579 12166 raft_consensus.cc:383] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.732609 12166 raft_consensus.cc:738] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.732715 12166 consensus_queue.cc:260] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.732998 12166 ts_tablet_manager.cc:1428] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.733161 12166 tablet_bootstrap.cc:492] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.733374 11527 catalog_manager.cc:5582] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:56.733675 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_06a503f6355b478caf948985a84c15f6 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 3 got 0
I20250625 14:01:56.734104 12166 tablet_bootstrap.cc:654] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.734891 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 205f83a0ffbc440492e241a75657f1b8 (table default.Table_56b605b35a0d4335b2916c5748f8ab38 [id=f7efaf49a2fe422185ac18faf97835b0]) successfully deleted
I20250625 14:01:56.735109 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449] alter complete (version 3)
I20250625 14:01:56.735582 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 10506b2cb6c5468daa6ef270b6ed2d4d from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.736433 12173 ts_tablet_manager.cc:1905] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.738821 12166 tablet_bootstrap.cc:492] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.738880 12173 ts_tablet_manager.cc:1918] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.738932 12166 ts_tablet_manager.cc:1397] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:56.738958 12173 log.cc:1199] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/dce48b28d6634330bcfa6e28d9f0c49d
I20250625 14:01:56.739224 12173 ts_tablet_manager.cc:1939] T dce48b28d6634330bcfa6e28d9f0c49d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.739506 12166 raft_consensus.cc:357] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.739617 12166 raft_consensus.cc:383] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.739650 12166 raft_consensus.cc:738] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.739764 12166 consensus_queue.cc:260] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.739909 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet dce48b28d6634330bcfa6e28d9f0c49d (table default.Table_0764c545c28d4a3c82093556ae3f970b [id=5f1140a89f654aa0874f801a35ffa3e8]) successfully deleted
I20250625 14:01:56.740080 12166 ts_tablet_manager.cc:1428] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.740252 12166 tablet_bootstrap.cc:492] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.740669 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 10506b2cb6c5468daa6ef270b6ed2d4d
I20250625 14:01:56.741233 12166 tablet_bootstrap.cc:654] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.741518 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 10506b2cb6c5468daa6ef270b6ed2d4d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.741904 12173 tablet_replica.cc:331] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.722842 11759 tablet_service.cc:1468] Processing CreateTablet for tablet f2f40caafd5e4557af321454d28fa2ab (DEFAULT_TABLE table=default.Table_b8bd92761b75460a9dbcf41b3a2a9a4b [id=70d3fc86e64847b9b7edd7945c195dc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.742077 12173 raft_consensus.cc:2241] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.742213 12173 raft_consensus.cc:2270] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.742278 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f40caafd5e4557af321454d28fa2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.742514 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 10506b2cb6c5468daa6ef270b6ed2d4d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.742705 12175 tablet_replica.cc:331] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.742827 12175 raft_consensus.cc:2241] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.742997 12175 raft_consensus.cc:2270] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.742724 12177 ts_tablet_manager.cc:1939] T 6d1c412286d94eedac62cf4f1f939f68 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.743600 12175 ts_tablet_manager.cc:1905] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.744230 11894 tablet_service.cc:1468] Processing CreateTablet for tablet a4ca3d5203a64d99912765b83af97c09 (DEFAULT_TABLE table=default.Table_e43289a5fa434695a866d39a58d5c776 [id=d02b8ccb415e4358832eb8334c21a8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.744561 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ca3d5203a64d99912765b83af97c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.728663 12180 raft_consensus.cc:491] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.745211 12180 raft_consensus.cc:513] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.745417 12054 raft_consensus.cc:3058] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.745601 12180 leader_election.cc:290] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.734236 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 7541b0989fe04486be69997611bb8ca1 with delete_type TABLET_DATA_DELETED (replaced by tablet 93d666f4b403435287f4157bda971193) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.734192 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.734192 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet deee7c3fb5204c63a6618f628848bc81 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.734320 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 with delete_type TABLET_DATA_DELETED (replaced by tablet e98a2085fe67479db141b2675f69a2d9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.734326 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet bfdb34255cb147c48a322514b7a7a19d with delete_type TABLET_DATA_DELETED (replaced by tablet cc9e2afd5bc443398293d0ed572f6c05) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.746002 12175 ts_tablet_manager.cc:1918] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.746070 12175 log.cc:1199] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/10506b2cb6c5468daa6ef270b6ed2d4d
I20250625 14:01:56.746265 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6d1c412286d94eedac62cf4f1f939f68 (table default.Table_c562bfdf6c0f4af8bc8fed3557145b52 [id=5e5bed4c27814fc7b14d0c4d9e091890]) successfully deleted
I20250625 14:01:56.746613 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e3af8a01ca1f49afb8aa1834807abf7e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.746734 11919 raft_consensus.cc:2466] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.746819 11754 tablet_service.cc:1468] Processing CreateTablet for tablet a4ca3d5203a64d99912765b83af97c09 (DEFAULT_TABLE table=default.Table_e43289a5fa434695a866d39a58d5c776 [id=d02b8ccb415e4358832eb8334c21a8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.747009 12175 ts_tablet_manager.cc:1939] T 10506b2cb6c5468daa6ef270b6ed2d4d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.741402 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 10506b2cb6c5468daa6ef270b6ed2d4d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.747077 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ca3d5203a64d99912765b83af97c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.747354 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e3af8a01ca1f49afb8aa1834807abf7e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.748057 12173 ts_tablet_manager.cc:1905] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.748594 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 10506b2cb6c5468daa6ef270b6ed2d4d (table default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346 [id=62eeb40941e44946a64d1067d3d44dc7]) successfully deleted
I20250625 14:01:56.749212 11717 leader_election.cc:304] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.749249 12166 tablet_bootstrap.cc:492] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.749325 12166 ts_tablet_manager.cc:1397] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
W20250625 14:01:56.749464 11717 leader_election.cc:343] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.749647 12894 raft_consensus.cc:2802] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.749702 12894 raft_consensus.cc:491] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.749740 12894 raft_consensus.cc:3058] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.749784 12166 raft_consensus.cc:357] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.749881 12166 raft_consensus.cc:383] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.749929 12166 raft_consensus.cc:738] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.750079 12166 consensus_queue.cc:260] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.750257 12173 ts_tablet_manager.cc:1918] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.750339 12173 log.cc:1199] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a7ede0ddacb74e39b07f175b5ef2a2c5
I20250625 14:01:56.750444 12166 ts_tablet_manager.cc:1428] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.750558 12173 ts_tablet_manager.cc:1939] T a7ede0ddacb74e39b07f175b5ef2a2c5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.751082 12173 tablet_replica.cc:331] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.751066 12894 raft_consensus.cc:513] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.751230 12173 raft_consensus.cc:2241] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.751264 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a7ede0ddacb74e39b07f175b5ef2a2c5 (table default.Table_0407310c9aee4d729058ad076b9295d6 [id=f5c7890a67b34de29d7bb56262c9e0c3]) successfully deleted
I20250625 14:01:56.751335 12173 raft_consensus.cc:2270] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.751420 12894 leader_election.cc:290] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.751507 12894 consensus_queue.cc:1035] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.751694 12030 tablet_service.cc:1468] Processing CreateTablet for tablet a4ca3d5203a64d99912765b83af97c09 (DEFAULT_TABLE table=default.Table_e43289a5fa434695a866d39a58d5c776 [id=d02b8ccb415e4358832eb8334c21a8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.752157 12166 tablet_bootstrap.cc:492] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.751976 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ca3d5203a64d99912765b83af97c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.752657 11894 tablet_service.cc:1468] Processing CreateTablet for tablet fce93c919a3446bb9999be958e08b500 (DEFAULT_TABLE table=default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.752955 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce93c919a3446bb9999be958e08b500. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.753206 12166 tablet_bootstrap.cc:654] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.754112 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e3af8a01ca1f49afb8aa1834807abf7e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.754231 11919 raft_consensus.cc:3058] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.754216 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e3af8a01ca1f49afb8aa1834807abf7e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:56.755416 11717 leader_election.cc:343] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.755853 11754 tablet_service.cc:1468] Processing CreateTablet for tablet fce93c919a3446bb9999be958e08b500 (DEFAULT_TABLE table=default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.756105 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce93c919a3446bb9999be958e08b500. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.756582 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 21908df7bb384e9782b97abe6f06b0f5 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.757834 12177 tablet_replica.cc:331] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.757995 12177 raft_consensus.cc:2241] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.758111 12177 raft_consensus.cc:2270] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.758922 12177 ts_tablet_manager.cc:1905] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.760185 11919 raft_consensus.cc:2466] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.760454 11717 leader_election.cc:304] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.751685 12173 ts_tablet_manager.cc:1905] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.760715 12894 raft_consensus.cc:2802] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.760812 12894 raft_consensus.cc:695] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.760838 12238 raft_consensus.cc:491] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.760918 12238 raft_consensus.cc:513] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.760955 12894 consensus_queue.cc:237] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.761269 12238 leader_election.cc:290] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.761598 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b76d36bac354543b8f7cef071aaa661" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.761598 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b76d36bac354543b8f7cef071aaa661" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.761708 11919 raft_consensus.cc:2466] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.762405 11717 leader_election.cc:304] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:56.762566 11717 leader_election.cc:343] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.762760 12167 tablet_bootstrap.cc:492] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.762858 12167 ts_tablet_manager.cc:1397] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.094s user 0.001s sys 0.000s
I20250625 14:01:56.763201 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 35ece361f92a4c9a9df5ad3355f87db9
I20250625 14:01:56.763373 12167 raft_consensus.cc:357] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.763490 12167 raft_consensus.cc:383] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.763532 12167 raft_consensus.cc:738] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.763662 12167 consensus_queue.cc:260] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.763841 11526 catalog_manager.cc:6652] ReplaceTablet: tablet 35ece361f92a4c9a9df5ad3355f87db9 deleted and replaced by tablet fae1eddf1156499aa346502f7a200125
I20250625 14:01:56.763847 12238 raft_consensus.cc:2802] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.763914 12238 raft_consensus.cc:491] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.763965 12238 raft_consensus.cc:3058] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.763970 12167 ts_tablet_manager.cc:1428] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.764181 12167 tablet_bootstrap.cc:492] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.764887 12238 raft_consensus.cc:513] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.765252 12238 leader_election.cc:290] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:56.765293 12167 tablet_bootstrap.cc:654] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.765336 12238 raft_consensus.cc:491] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.765396 12238 raft_consensus.cc:513] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.765692 12238 leader_election.cc:290] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.766804 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b76d36bac354543b8f7cef071aaa661" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.766933 11919 raft_consensus.cc:3058] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.767920 11919 raft_consensus.cc:2466] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.768014 11530 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:56.768540 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7cc7e962e4b146bc88a06fde969eb99d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.768540 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7cc7e962e4b146bc88a06fde969eb99d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.768718 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 with delete_type TABLET_DATA_DELETED (replaced by tablet e98a2085fe67479db141b2675f69a2d9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.768762 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4b76d36bac354543b8f7cef071aaa661" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.768920 12175 tablet_replica.cc:331] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.769029 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 with delete_type TABLET_DATA_DELETED (replaced by tablet fae1eddf1156499aa346502f7a200125) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.769061 12175 raft_consensus.cc:2241] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.769172 12175 raft_consensus.cc:2270] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.769155 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
W20250625 14:01:56.769557 11717 leader_election.cc:343] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:56.769678 11717 leader_election.cc:343] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.769754 11717 leader_election.cc:304] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.769783 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 with delete_type TABLET_DATA_DELETED (replaced by tablet fae1eddf1156499aa346502f7a200125) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:56.769929 11717 leader_election.cc:343] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.769989 11717 leader_election.cc:304] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.769914 12208 raft_consensus.cc:491] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.770229 12208 raft_consensus.cc:513] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.770601 12208 leader_election.cc:290] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.770913 12175 ts_tablet_manager.cc:1905] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.771171 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 21908df7bb384e9782b97abe6f06b0f5
I20250625 14:01:56.771414 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 21908df7bb384e9782b97abe6f06b0f5 deleted and replaced by tablet 44dd83c53b15400d94bb7b1a8784569a
I20250625 14:01:56.772028 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 44dd83c53b15400d94bb7b1a8784569a) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.772528 12855 raft_consensus.cc:2802] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.772599 12855 raft_consensus.cc:695] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.772720 12855 consensus_queue.cc:237] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.773422 12855 raft_consensus.cc:2747] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.773487 12175 ts_tablet_manager.cc:1918] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.773551 12175 log.cc:1199] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8fee92d68eaa4b22a7f0c122aeb5bc44
I20250625 14:01:56.773765 12175 ts_tablet_manager.cc:1939] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.774590 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 (table default.Table_12a1e16f6b284bbca04f3f1c10950265 [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
I20250625 14:01:56.774677 12027 tablet_service.cc:1468] Processing CreateTablet for tablet fce93c919a3446bb9999be958e08b500 (DEFAULT_TABLE table=default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.774971 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce93c919a3446bb9999be958e08b500. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.775969 11894 tablet_service.cc:1468] Processing CreateTablet for tablet f9ed052ae88e4b679ac55177a3bbab88 (DEFAULT_TABLE table=default.Table_608373c028f24b7583710ee5df593160 [id=314875c052534d13abab06e5c163c974]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.776293 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ed052ae88e4b679ac55177a3bbab88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.777189 12430 tablet.cc:1722] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:56.777370 12028 tablet_service.cc:1468] Processing CreateTablet for tablet f9ed052ae88e4b679ac55177a3bbab88 (DEFAULT_TABLE table=default.Table_608373c028f24b7583710ee5df593160 [id=314875c052534d13abab06e5c163c974]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.777606 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ed052ae88e4b679ac55177a3bbab88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.777674 12233 tablet.cc:1722] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:56.779765 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b (DEFAULT_TABLE table=default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.780027 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.780058 12172 tablet_bootstrap.cc:492] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.780155 12172 ts_tablet_manager.cc:1397] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.137s user 0.001s sys 0.000s
I20250625 14:01:56.780663 12172 raft_consensus.cc:357] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.780784 12172 raft_consensus.cc:383] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.780819 12172 raft_consensus.cc:738] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.780938 12172 consensus_queue.cc:260] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.780972 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "baf41b19a5ba4eddb65d31567b375eaa" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.781072 11919 raft_consensus.cc:2466] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.781281 12172 ts_tablet_manager.cc:1428] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.781450 12172 tablet_bootstrap.cc:492] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.781436 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dfb0fb317e8d4ca799c64b29140de875"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.781837 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfb0fb317e8d4ca799c64b29140de875 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.782111 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f8f9e822f0d4483f8b4af1775c472dc2" } new_table_name: "default.Table_ac37faa91c204435ada9ba6a31078de5" modify_external_catalogs: true
I20250625 14:01:56.783885 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "baf41b19a5ba4eddb65d31567b375eaa" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.784220 12166 tablet_bootstrap.cc:492] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.784476 12172 tablet_bootstrap.cc:654] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.785219 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b (DEFAULT_TABLE table=default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.785493 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.785784 12166 ts_tablet_manager.cc:1397] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20250625 14:01:56.786520 12172 tablet_bootstrap.cc:492] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.786661 12172 ts_tablet_manager.cc:1397] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:56.787221 12172 raft_consensus.cc:357] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.787549 12172 raft_consensus.cc:383] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.787634 12172 raft_consensus.cc:738] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.788149 12861 tablet.cc:1722] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:56.788359 12172 consensus_queue.cc:260] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.788599 12166 raft_consensus.cc:357] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.788674 12172 ts_tablet_manager.cc:1428] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.788723 12166 raft_consensus.cc:383] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.788758 12166 raft_consensus.cc:738] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.789232 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:56.789522 11717 leader_election.cc:343] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.789637 11717 leader_election.cc:304] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.789665 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 44dd83c53b15400d94bb7b1a8784569a) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.789914 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 with delete_type TABLET_DATA_DELETED (replaced by tablet fae1eddf1156499aa346502f7a200125) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.789947 11760 tablet_service.cc:1468] Processing CreateTablet for tablet f9ed052ae88e4b679ac55177a3bbab88 (DEFAULT_TABLE table=default.Table_608373c028f24b7583710ee5df593160 [id=314875c052534d13abab06e5c163c974]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.790058 12166 consensus_queue.cc:260] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.790186 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ed052ae88e4b679ac55177a3bbab88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.791158 12166 ts_tablet_manager.cc:1428] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:01:56.791184 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 44dd83c53b15400d94bb7b1a8784569a) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.791777 12167 tablet_bootstrap.cc:492] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.791888 12167 ts_tablet_manager.cc:1397] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.001s
I20250625 14:01:56.792091 12166 tablet_bootstrap.cc:492] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.792374 12167 raft_consensus.cc:357] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.792472 12167 raft_consensus.cc:383] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.792510 12167 raft_consensus.cc:738] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.792498 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b (DEFAULT_TABLE table=default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.792646 12167 consensus_queue.cc:260] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.792946 12167 ts_tablet_manager.cc:1428] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.793112 12167 tablet_bootstrap.cc:492] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.793109 12177 ts_tablet_manager.cc:1918] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250625 14:01:56.793359 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3693e166c2c4af0b7a8f7994507de2c consensus state has no leader
I20250625 14:01:56.793620 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c99e790aef874f6c8875c93bd8df8256" } modify_external_catalogs: true
I20250625 14:01:56.793712 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c99e790aef874f6c8875c93bd8df8256" } modify_external_catalogs: true
I20250625 14:01:56.793689 11525 catalog_manager.cc:5582] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:56.793900 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697]). Expected version 2 got 0
I20250625 14:01:56.794152 12167 tablet_bootstrap.cc:654] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.791779 12173 ts_tablet_manager.cc:1918] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.795434 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4571ef6dee28441bb7db7d12168d94c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.795529 12173 log.cc:1199] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7302430d7e4a4610bfe271c114718d35
W20250625 14:01:56.795794 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4571ef6dee28441bb7db7d12168d94c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.795820 12173 ts_tablet_manager.cc:1939] T 7302430d7e4a4610bfe271c114718d35 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.796072 12894 raft_consensus.cc:2802] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.796133 12894 raft_consensus.cc:491] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.796099 12238 consensus_queue.cc:1035] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.796173 12894 raft_consensus.cc:3058] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.796891 12208 raft_consensus.cc:491] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.796967 12208 raft_consensus.cc:513] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.797230 12894 raft_consensus.cc:513] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.797323 12208 leader_election.cc:290] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.797489 12894 leader_election.cc:290] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:56.798288 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 35ece361f92a4c9a9df5ad3355f87db9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ece361f92a4c9a9df5ad3355f87db9 already in progress: creating tablet
W20250625 14:01:56.798509 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 21908df7bb384e9782b97abe6f06b0f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21908df7bb384e9782b97abe6f06b0f5 already in progress: creating tablet
I20250625 14:01:56.798576 12166 tablet_bootstrap.cc:654] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.798635 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7302430d7e4a4610bfe271c114718d35 (table default.Table_3d82e197e7174db08e444c89b45c77be [id=1cf0251105444beca355668b5a0da27b]) successfully deleted
I20250625 14:01:56.799131 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.799530 12173 tablet_replica.cc:331] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.799666 12173 raft_consensus.cc:2241] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.799780 12173 raft_consensus.cc:2270] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.800151 12173 ts_tablet_manager.cc:1905] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.800882 12177 log.cc:1199] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7541b0989fe04486be69997611bb8ca1
I20250625 14:01:56.800973 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "097b49d0283541478241e6c699504174" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.801013 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "097b49d0283541478241e6c699504174" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.801124 11919 raft_consensus.cc:2466] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.801156 12177 ts_tablet_manager.cc:1939] T 7541b0989fe04486be69997611bb8ca1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.801581 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "baf41b19a5ba4eddb65d31567b375eaa" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.801630 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "baf41b19a5ba4eddb65d31567b375eaa" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.801715 11919 raft_consensus.cc:3058] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.801730 12177 tablet_replica.cc:331] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.801868 12177 raft_consensus.cc:2241] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.801961 12177 raft_consensus.cc:2270] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.802495 12177 ts_tablet_manager.cc:1905] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.802554 11533 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.802695 11919 raft_consensus.cc:2466] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.804665 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 96984bb93836413a85f112f7d162598f with delete_type TABLET_DATA_DELETED (replaced by tablet a25ceea16cbb4e339c2ebcc580c47270) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.808737 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.808838 11717 leader_election.cc:304] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.809023 12238 raft_consensus.cc:2802] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.809080 12238 raft_consensus.cc:491] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.809123 12238 raft_consensus.cc:3058] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.809034 11717 leader_election.cc:304] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.809403 12894 raft_consensus.cc:2802] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.809465 12894 raft_consensus.cc:695] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.809583 12894 consensus_queue.cc:237] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.810175 12238 raft_consensus.cc:513] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.810505 12238 leader_election.cc:290] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.811311 12172 tablet_bootstrap.cc:492] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.812623 12173 ts_tablet_manager.cc:1918] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.812783 12173 log.cc:1199] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/cbd18834c5594897a2b16c7069a90c18
I20250625 14:01:56.813087 12173 ts_tablet_manager.cc:1939] T cbd18834c5594897a2b16c7069a90c18 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.813089 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1f5c017990c54099b1cdbddc75a12e10
W20250625 14:01:56.813517 11717 leader_election.cc:343] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.814066 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 1f5c017990c54099b1cdbddc75a12e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:56.814122 11717 leader_election.cc:343] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.814260 12175 tablet_replica.cc:331] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.814427 12175 raft_consensus.cc:2241] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:56.814595 12175 pending_rounds.cc:70] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:56.814641 12175 pending_rounds.cc:77] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523037784756224 op_type: NO_OP noop_request { }
I20250625 14:01:56.814706 12175 raft_consensus.cc:2887] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:56.814764 12175 raft_consensus.cc:2270] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.814733 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet cbd18834c5594897a2b16c7069a90c18 (table default.Table_d0f93962f9df42408804933938d2595c [id=2b85fd3adb7f4584887aa464e3ba929f]) successfully deleted
W20250625 14:01:56.814882 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 0752a7f1371e42d68d83afe41d2f1da9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0752a7f1371e42d68d83afe41d2f1da9 already in progress: creating tablet
W20250625 14:01:56.815001 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet db4a9e4dfdd145bab965004ee5562e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db4a9e4dfdd145bab965004ee5562e2b already in progress: creating tablet
I20250625 14:01:56.815155 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 1f5c017990c54099b1cdbddc75a12e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.815510 12175 ts_tablet_manager.cc:1905] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.815598 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "097b49d0283541478241e6c699504174" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.816113 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7541b0989fe04486be69997611bb8ca1 (table default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]) successfully deleted
I20250625 14:01:56.816159 12173 tablet_replica.cc:331] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:01:56.816318 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet fbf41efa64294f388894a9a57b45fdc2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbf41efa64294f388894a9a57b45fdc2 already in progress: creating tablet
I20250625 14:01:56.818125 12175 ts_tablet_manager.cc:1918] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.818181 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 09a197bdabd24d7c96febe1fd5352a14 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.818218 12175 log.cc:1199] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/1f5c017990c54099b1cdbddc75a12e10
I20250625 14:01:56.818177 12173 raft_consensus.cc:2241] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.818440 12173 raft_consensus.cc:2270] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.819077 12173 ts_tablet_manager.cc:1905] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.819183 12175 ts_tablet_manager.cc:1939] T 1f5c017990c54099b1cdbddc75a12e10 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.820276 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e28b81e130be4741a8b96e733248cf1a" } modify_external_catalogs: true
I20250625 14:01:56.820401 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e28b81e130be4741a8b96e733248cf1a" } modify_external_catalogs: true
W20250625 14:01:56.820822 11855 consensus_peers.cc:487] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:56.821183 11780 raft_consensus.cc:1273] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:56.821628 12558 consensus_queue.cc:1035] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.823047 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "097b49d0283541478241e6c699504174" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.823182 11921 raft_consensus.cc:3058] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.823518 11717 leader_election.cc:343] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.823969 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 1f5c017990c54099b1cdbddc75a12e10 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.824312 11921 raft_consensus.cc:2466] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.824309 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 1f5c017990c54099b1cdbddc75a12e10 (table default.Table_c99e790aef874f6c8875c93bd8df8256 [id=b1f7726fb4e44a9992a4ef7a1afb339d]) successfully deleted
I20250625 14:01:56.824527 12172 tablet_bootstrap.cc:654] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.825680 11717 leader_election.cc:304] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.825959 12180 raft_consensus.cc:2802] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.826043 12180 raft_consensus.cc:695] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.826189 12180 consensus_queue.cc:237] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.826757 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 09a197bdabd24d7c96febe1fd5352a14
W20250625 14:01:56.827080 11717 consensus_peers.cc:487] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:56.827117 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 09a197bdabd24d7c96febe1fd5352a14 deleted and replaced by tablet 7b817bda69f44497a6787d1d649ef5e9
I20250625 14:01:56.827559 11921 raft_consensus.cc:1273] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:56.827575 12166 tablet_bootstrap.cc:492] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.827939 12166 ts_tablet_manager.cc:1397] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:01:56.828764 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 09a197bdabd24d7c96febe1fd5352a14 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b817bda69f44497a6787d1d649ef5e9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.828929 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 09a197bdabd24d7c96febe1fd5352a14 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b817bda69f44497a6787d1d649ef5e9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.828941 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97] alter complete (version 1)
I20250625 14:01:56.829718 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet 704ecf1ea8dd423ead2a0d1be113c03d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.828826 12173 ts_tablet_manager.cc:1918] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.829983 12173 log.cc:1199] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/32d345da0f674704b8e1f23a74bac3ce
I20250625 14:01:56.830817 12175 tablet_replica.cc:331] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.830297 12173 ts_tablet_manager.cc:1939] T 32d345da0f674704b8e1f23a74bac3ce P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.831001 12175 raft_consensus.cc:2241] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.831142 12175 raft_consensus.cc:2270] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.831560 12175 ts_tablet_manager.cc:1905] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.833134 12430 tablet.cc:1722] T 5d1979e44eab46c7a54a204603963839 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:56.833343 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 32d345da0f674704b8e1f23a74bac3ce (table default.Table_1aa440e8532d4a51a048ec92c4a363bf [id=f6b6cc48a6f54d6bb64dba30511a4c41]) successfully deleted
W20250625 14:01:56.833824 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet deee7c3fb5204c63a6618f628848bc81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet deee7c3fb5204c63a6618f628848bc81 already in progress: creating tablet
I20250625 14:01:56.833861 12233 tablet.cc:1722] T 5d1979e44eab46c7a54a204603963839 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:56.833967 12594 mvcc.cc:204] Tried to move back new op lower bound from 7171523038493024256 to 7171523036871725056. Current Snapshot: MvccSnapshot[applied={T|T < 7171523038493024256}]
I20250625 14:01:56.834021 12173 tablet_replica.cc:331] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.834163 12173 raft_consensus.cc:2241] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.834156 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 097b49d0283541478241e6c699504174 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.834282 12173 raft_consensus.cc:2270] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.834692 12173 ts_tablet_manager.cc:1905] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.835021 12800 raft_consensus.cc:491] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.835093 12800 raft_consensus.cc:513] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.835464 12800 leader_election.cc:290] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:56.836570 11990 leader_election.cc:343] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 8b82e99ecc994068b7823ef75d5b233f
I20250625 14:01:56.837044 12173 ts_tablet_manager.cc:1918] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:56.837116 12173 log.cc:1199] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/44d41513c1d444cba5288a05f2c4652c
I20250625 14:01:56.837154 12177 ts_tablet_manager.cc:1918] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.837239 12177 log.cc:1199] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/72efc3ed21e3404eb0a0ba4326513601
I20250625 14:01:56.837397 12173 ts_tablet_manager.cc:1939] T 44d41513c1d444cba5288a05f2c4652c P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.837450 12177 ts_tablet_manager.cc:1939] T 72efc3ed21e3404eb0a0ba4326513601 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.838092 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 44d41513c1d444cba5288a05f2c4652c (table default.Table_82021dac408c42e9898349055acf8936 [id=8cc7744ad13545cba212ea3affd17d9d]) successfully deleted
I20250625 14:01:56.838366 12177 tablet_replica.cc:331] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.838398 12175 ts_tablet_manager.cc:1918] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:56.838510 12177 raft_consensus.cc:2241] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.838606 12175 log.cc:1199] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/09a197bdabd24d7c96febe1fd5352a14
I20250625 14:01:56.839107 12177 raft_consensus.cc:2270] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.839246 12175 ts_tablet_manager.cc:1939] T 09a197bdabd24d7c96febe1fd5352a14 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.839877 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]) successfully deleted
I20250625 14:01:56.841398 12172 tablet_bootstrap.cc:492] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.841491 12172 ts_tablet_manager.cc:1397] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250625 14:01:56.841955 12177 ts_tablet_manager.cc:1905] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.841960 12172 raft_consensus.cc:357] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:56.842054 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7541b0989fe04486be69997611bb8ca1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7541b0989fe04486be69997611bb8ca1 already in progress: creating tablet
I20250625 14:01:56.842089 12172 raft_consensus.cc:383] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.842120 12172 raft_consensus.cc:738] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.842257 12172 consensus_queue.cc:260] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.842367 12173 tablet_replica.cc:331] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.842505 12173 raft_consensus.cc:2241] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.842603 12173 raft_consensus.cc:2270] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.842657 12172 ts_tablet_manager.cc:1428] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.842823 12172 tablet_bootstrap.cc:492] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.842984 12173 ts_tablet_manager.cc:1905] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.843897 12172 tablet_bootstrap.cc:654] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.844682 12177 ts_tablet_manager.cc:1918] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.844741 12177 log.cc:1199] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/deee7c3fb5204c63a6618f628848bc81
I20250625 14:01:56.844952 12177 ts_tablet_manager.cc:1939] T deee7c3fb5204c63a6618f628848bc81 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.844985 12173 ts_tablet_manager.cc:1918] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.845012 12800 raft_consensus.cc:491] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.845050 12173 log.cc:1199] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6bcdf4d901e34ab5ba2c36fe53456f0e
I20250625 14:01:56.845089 12800 raft_consensus.cc:513] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.845260 12173 ts_tablet_manager.cc:1939] T 6bcdf4d901e34ab5ba2c36fe53456f0e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.845496 12177 tablet_replica.cc:331] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.845522 12800 leader_election.cc:290] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.845638 12177 raft_consensus.cc:2241] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.845732 12177 raft_consensus.cc:2270] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.845810 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6bcdf4d901e34ab5ba2c36fe53456f0e (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:56.845925 12167 tablet_bootstrap.cc:492] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.845992 12167 ts_tablet_manager.cc:1397] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20250625 14:01:56.846117 12173 tablet_replica.cc:331] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.846236 12173 raft_consensus.cc:2241] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.846264 12177 ts_tablet_manager.cc:1905] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.846349 12173 raft_consensus.cc:2270] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.846509 12167 raft_consensus.cc:357] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.846602 12167 raft_consensus.cc:383] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.846632 12167 raft_consensus.cc:738] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.846642 12173 ts_tablet_manager.cc:1905] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.846742 12167 consensus_queue.cc:260] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.846979 12167 ts_tablet_manager.cc:1428] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.847194 12167 tablet_bootstrap.cc:492] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.848115 12167 tablet_bootstrap.cc:654] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.848556 12177 ts_tablet_manager.cc:1918] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.848627 12177 log.cc:1199] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8fee92d68eaa4b22a7f0c122aeb5bc44
I20250625 14:01:56.848786 12173 ts_tablet_manager.cc:1918] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.848819 12177 ts_tablet_manager.cc:1939] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.848845 12173 log.cc:1199] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f47cf7e6d24347a88da2ee8fbd6de1b1
I20250625 14:01:56.849045 12173 ts_tablet_manager.cc:1939] T f47cf7e6d24347a88da2ee8fbd6de1b1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.849387 12177 tablet_replica.cc:331] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.849522 12177 raft_consensus.cc:2241] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.849622 12177 raft_consensus.cc:2270] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.849817 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fa719388db36434cbfd373ed001644c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.850109 12177 ts_tablet_manager.cc:1905] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.850224 12173 tablet_replica.cc:331] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:01:56.850297 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa719388db36434cbfd373ed001644c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.850380 12173 raft_consensus.cc:2241] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.850481 12173 raft_consensus.cc:2270] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.851037 12173 ts_tablet_manager.cc:1905] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.852501 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f47cf7e6d24347a88da2ee8fbd6de1b1 (table default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]) successfully deleted
W20250625 14:01:56.853279 11990 leader_election.cc:343] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 33790cc725df482e91daceca29c820eb
I20250625 14:01:56.854473 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:56.854635 12173 ts_tablet_manager.cc:1918] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.854651 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 097b49d0283541478241e6c699504174 (table default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]). Expected version 1 got 0
I20250625 14:01:56.854702 12173 log.cc:1199] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d8e509824fc94993b1676f5b68515002
I20250625 14:01:56.854727 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]). Expected version 1 got 0
I20250625 14:01:56.854787 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 56250a60d7104f22bd4b2206f3a5df14 (table default.Table_892620871def4b818f36f2c0b4f1cbed [id=e1d9126672684e808d499d3902fc371b]). Expected version 1 got 0
I20250625 14:01:56.854868 11531 catalog_manager.cc:5582] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:56.855058 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]). Expected version 1 got 0
I20250625 14:01:56.855146 12173 ts_tablet_manager.cc:1939] T d8e509824fc94993b1676f5b68515002 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.855767 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d8e509824fc94993b1676f5b68515002 (table default.Table_209865c613024f86a2947aa757e43d68 [id=250ef151258b4c7da08be26888e9ecf0]) successfully deleted
I20250625 14:01:56.855975 12173 tablet_replica.cc:331] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.856262 12173 raft_consensus.cc:2241] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.856360 12173 raft_consensus.cc:2270] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.857008 12173 ts_tablet_manager.cc:1905] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.857116 12166 raft_consensus.cc:357] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.857230 12166 raft_consensus.cc:383] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.857272 12166 raft_consensus.cc:738] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.857441 12166 consensus_queue.cc:260] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.858696 12166 ts_tablet_manager.cc:1428] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20250625 14:01:56.858807 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.859004 11526 catalog_manager.cc:5582] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:56.859189 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_06a503f6355b478caf948985a84c15f6 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 3 got 0
I20250625 14:01:56.859305 11526 catalog_manager.cc:5582] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:56.859447 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 295ddb94cd4f489c9d53875bd1578474 (DEFAULT_TABLE table=default.Table_144231cb0a3247a8ab8f184de1ecb378 [id=9954b567381b49cf81d3cea6b706f327]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.859692 12166 tablet_bootstrap.cc:492] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.859716 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ddb94cd4f489c9d53875bd1578474. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.860916 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 295ddb94cd4f489c9d53875bd1578474 (DEFAULT_TABLE table=default.Table_144231cb0a3247a8ab8f184de1ecb378 [id=9954b567381b49cf81d3cea6b706f327]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.861199 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ddb94cd4f489c9d53875bd1578474. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.861994 12238 raft_consensus.cc:491] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.862088 12238 raft_consensus.cc:513] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.862401 12172 tablet_bootstrap.cc:492] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.862438 12166 tablet_bootstrap.cc:654] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.862494 12172 ts_tablet_manager.cc:1397] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20250625 14:01:56.862530 12238 leader_election.cc:290] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.863032 12172 raft_consensus.cc:357] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.863155 12172 raft_consensus.cc:383] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.863191 12172 raft_consensus.cc:738] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.863406 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_de10db8210b34241a0e63aaa8702fb67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.863492 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 (DEFAULT_TABLE table=default.Table_e07ec41a73ce4df9ab09b63d87da79be [id=e6ec8721bee347c19b4724c249a20e2f]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:56.863807 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de10db8210b34241a0e63aaa8702fb67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.863830 11899 tablet_service.cc:1468] Processing CreateTablet for tablet e9476529c1b7401683c02e146f54a228 (DEFAULT_TABLE table=default.Table_fd6351d08daa4564ba49cf00d72ecd56 [id=ebc9dc830f034c5682988e810c4eb9d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.863853 11900 tablet_service.cc:1468] Processing CreateTablet for tablet e15bd70671f8458db5b9e52423189eda (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.863932 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 (DEFAULT_TABLE table=default.Table_e07ec41a73ce4df9ab09b63d87da79be [id=e6ec8721bee347c19b4724c249a20e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.864130 11895 tablet_service.cc:1468] Processing CreateTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 (DEFAULT_TABLE table=default.Table_675a9837739b463fbb71d870eda3a3c2 [id=3177ee8dc2ee43adbbf768c40dae97bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.864183 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.864171 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e11dc32e96254d3489a8f9c7028feaca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.864475 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e11dc32e96254d3489a8f9c7028feaca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.864627 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5f98d59df4eb46318868cd55ce407c04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.864929 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f98d59df4eb46318868cd55ce407c04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.865211 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_95a3171b6e53412880ef07bf3291f0bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.865504 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95a3171b6e53412880ef07bf3291f0bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.866266 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bd047e00bc2045538f5a1a59bb15519f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.866417 12028 tablet_service.cc:1468] Processing CreateTablet for tablet e9476529c1b7401683c02e146f54a228 (DEFAULT_TABLE table=default.Table_fd6351d08daa4564ba49cf00d72ecd56 [id=ebc9dc830f034c5682988e810c4eb9d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:56.866626 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd047e00bc2045538f5a1a59bb15519f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.866639 12167 tablet_bootstrap.cc:492] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.866734 12167 ts_tablet_manager.cc:1397] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250625 14:01:56.866791 12032 tablet_service.cc:1468] Processing CreateTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 (DEFAULT_TABLE table=default.Table_675a9837739b463fbb71d870eda3a3c2 [id=3177ee8dc2ee43adbbf768c40dae97bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.867072 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 0627b4ff4173405eba5bd0686bab8e55 (DEFAULT_TABLE table=default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.866647 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9476529c1b7401683c02e146f54a228. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.867290 12167 raft_consensus.cc:357] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.867342 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fa193e07de344ccdb0d6f6e45a201fe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:56.867394 12167 raft_consensus.cc:383] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.867425 12167 raft_consensus.cc:738] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.867549 12167 consensus_queue.cc:260] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:56.867636 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa193e07de344ccdb0d6f6e45a201fe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.867858 12167 ts_tablet_manager.cc:1428] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.868115 12167 tablet_bootstrap.cc:492] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.869186 12167 tablet_bootstrap.cc:654] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.870052 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0627b4ff4173405eba5bd0686bab8e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.870455 11754 tablet_service.cc:1468] Processing CreateTablet for tablet e15bd70671f8458db5b9e52423189eda (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.870528 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 295ddb94cd4f489c9d53875bd1578474 (DEFAULT_TABLE table=default.Table_144231cb0a3247a8ab8f184de1ecb378 [id=9954b567381b49cf81d3cea6b706f327]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.870702 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15bd70671f8458db5b9e52423189eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.871157 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 09a197bdabd24d7c96febe1fd5352a14 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b817bda69f44497a6787d1d649ef5e9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.871120 12172 consensus_queue.cc:260] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.871322 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad291ba0da4f3fa70aa9548ef71d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.871410 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ddb94cd4f489c9d53875bd1578474. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.871482 12172 ts_tablet_manager.cc:1428] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20250625 14:01:56.871651 12172 tablet_bootstrap.cc:492] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.873679 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 0627b4ff4173405eba5bd0686bab8e55 (DEFAULT_TABLE table=default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.873765 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.875074 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 801fae4d88114ff29eacde80365b84a0 (DEFAULT_TABLE table=default.Table_99e3b9f63eb947ed8424df6c7a25de5e [id=c1cfd4563a0043058570d3ce22551316]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.875470 11754 tablet_service.cc:1468] Processing CreateTablet for tablet e9476529c1b7401683c02e146f54a228 (DEFAULT_TABLE table=default.Table_fd6351d08daa4564ba49cf00d72ecd56 [id=ebc9dc830f034c5682988e810c4eb9d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.875584 11892 tablet_service.cc:1468] Processing CreateTablet for tablet fae1eddf1156499aa346502f7a200125 (DEFAULT_TABLE table=default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.875739 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9476529c1b7401683c02e146f54a228. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.876104 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.876245 12172 tablet_bootstrap.cc:654] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.876346 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e56586f5cd745a397bf6ed1a63d070e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.878650 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 801fae4d88114ff29eacde80365b84a0 (DEFAULT_TABLE table=default.Table_99e3b9f63eb947ed8424df6c7a25de5e [id=c1cfd4563a0043058570d3ce22551316]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.878650 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 44dd83c53b15400d94bb7b1a8784569a (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.878909 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801fae4d88114ff29eacde80365b84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.879495 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49c8487f502b4f5299387daa9e89604b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.879557 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49c8487f502b4f5299387daa9e89604b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.879673 11919 raft_consensus.cc:2466] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:56.880409 11754 tablet_service.cc:1468] Processing CreateTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 (DEFAULT_TABLE table=default.Table_675a9837739b463fbb71d870eda3a3c2 [id=3177ee8dc2ee43adbbf768c40dae97bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.880748 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad291ba0da4f3fa70aa9548ef71d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.881263 12265 consensus_queue.cc:1035] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.881479 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 72efc3ed21e3404eb0a0ba4326513601 (table default.Table_03ca42d86d7d454699eea52f84b29ffb [id=e32fff7acb81496caed3c543cbb849fd]) successfully deleted
I20250625 14:01:56.881608 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet deee7c3fb5204c63a6618f628848bc81 (table default.Table_e97f0540e97b415fa28869e09d50620e [id=ae16a007c35f4784b80230d2eb49b42c]) successfully deleted
I20250625 14:01:56.881695 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 (table default.Table_12a1e16f6b284bbca04f3f1c10950265 [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
I20250625 14:01:56.884728 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 2e5c492cb21c45f391aa20780f680d5f
I20250625 14:01:56.887012 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e5c492cb21c45f391aa20780f680d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:56.887476 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 2e5c492cb21c45f391aa20780f680d5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e5c492cb21c45f391aa20780f680d5f already in progress: creating tablet
I20250625 14:01:56.888242 12894 raft_consensus.cc:491] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.888334 12894 raft_consensus.cc:513] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.888368 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e5c492cb21c45f391aa20780f680d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.888510 12208 consensus_queue.cc:1035] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.888660 12894 leader_election.cc:290] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.888888 11717 leader_election.cc:304] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.889225 12180 raft_consensus.cc:2802] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.889279 12180 raft_consensus.cc:491] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.889318 12180 raft_consensus.cc:3058] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.889900 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_37917022f1ad4c3288d7753c8e655bd6" } new_table_name: "default.Table_5ca55989aaad4709ae95a79ee2c7085c" modify_external_catalogs: true
I20250625 14:01:56.890435 12180 raft_consensus.cc:513] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.890728 12180 leader_election.cc:290] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.890872 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 5bba2990cca6441fb954b2f30f561708 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:54 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.892000 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 7541b0989fe04486be69997611bb8ca1 with delete_type TABLET_DATA_DELETED (replaced by tablet 93d666f4b403435287f4157bda971193) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.892410 12175 tablet_replica.cc:331] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.892403 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.892578 12175 raft_consensus.cc:2241] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.892624 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet deee7c3fb5204c63a6618f628848bc81 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.892685 12175 raft_consensus.cc:2270] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.892714 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9eba3e4e9f1d46cc9f3cf00e825727ea" } new_table_name: "default.Table_6500987d0b3b4d7ea53959771641fcbf" modify_external_catalogs: true
I20250625 14:01:56.892792 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet bfdb34255cb147c48a322514b7a7a19d with delete_type TABLET_DATA_DELETED (replaced by tablet cc9e2afd5bc443398293d0ed572f6c05) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.893226 12175 ts_tablet_manager.cc:1905] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.893726 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_144231cb0a3247a8ab8f184de1ecb378" } new_table_name: "default.Table_478843ad04c04773be560cc8ac45cc52" modify_external_catalogs: true
I20250625 14:01:56.893864 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "87974ef08b3b4cc299ae643c0cb5d694" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.894395 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "87974ef08b3b4cc299ae643c0cb5d694" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:56.894706 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad291ba0da4f3fa70aa9548ef71d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.894851 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0627b4ff4173405eba5bd0686bab8e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.895080 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9476529c1b7401683c02e146f54a228. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.895237 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae1eddf1156499aa346502f7a200125. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.895342 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dd83c53b15400d94bb7b1a8784569a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.895586 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.895793 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e56586f5cd745a397bf6ed1a63d070e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.896102 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801fae4d88114ff29eacde80365b84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.896385 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15bd70671f8458db5b9e52423189eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.897411 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 44dd83c53b15400d94bb7b1a8784569a (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.897683 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dd83c53b15400d94bb7b1a8784569a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:56.898561 11993 leader_election.cc:343] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 33790cc725df482e91daceca29c820eb
I20250625 14:01:56.898635 11993 leader_election.cc:304] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.898792 12030 tablet_service.cc:1468] Processing CreateTablet for tablet e15bd70671f8458db5b9e52423189eda (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.898865 12800 raft_consensus.cc:2747] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.899029 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15bd70671f8458db5b9e52423189eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.899556 12175 ts_tablet_manager.cc:1918] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.899621 12175 log.cc:1199] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7541b0989fe04486be69997611bb8ca1
I20250625 14:01:56.899698 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 (DEFAULT_TABLE table=default.Table_e07ec41a73ce4df9ab09b63d87da79be [id=e6ec8721bee347c19b4724c249a20e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.899825 12175 ts_tablet_manager.cc:1939] T 7541b0989fe04486be69997611bb8ca1 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.899992 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.900760 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7541b0989fe04486be69997611bb8ca1 (table default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]) successfully deleted
I20250625 14:01:56.903290 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e07ec41a73ce4df9ab09b63d87da79be" } modify_external_catalogs: true
I20250625 14:01:56.903407 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e07ec41a73ce4df9ab09b63d87da79be" } modify_external_catalogs: true
I20250625 14:01:56.908957 11756 tablet_service.cc:1468] Processing CreateTablet for tablet fae1eddf1156499aa346502f7a200125 (DEFAULT_TABLE table=default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.912482 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 96ec205b0f31484a91054fedf619b9ab (table default.Table_6c025a609dc74d37a082a5050f756463 [id=62132df62b3a42fb9886592b9b885d31]). Expected version 1 got 0
I20250625 14:01:56.912585 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.912830 12029 tablet_service.cc:1468] Processing CreateTablet for tablet fae1eddf1156499aa346502f7a200125 (DEFAULT_TABLE table=default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.913092 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae1eddf1156499aa346502f7a200125. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.917666 12175 tablet_replica.cc:331] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.917831 12175 raft_consensus.cc:2241] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.918387 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_14d8a31a1e8b4fa5a08673620892fc67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:56.918773 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14d8a31a1e8b4fa5a08673620892fc67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:56.919134 12175 raft_consensus.cc:2270] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:56.909030 11717 leader_election.cc:343] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:56.919456 11717 leader_election.cc:343] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.919564 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ac9132782f574ad8a5d69192e7168e79" } modify_external_catalogs: true
I20250625 14:01:56.919662 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ac9132782f574ad8a5d69192e7168e79" } modify_external_catalogs: true
I20250625 14:01:56.919863 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49c8487f502b4f5299387daa9e89604b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.920032 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49c8487f502b4f5299387daa9e89604b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.920145 11921 raft_consensus.cc:3058] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.909245 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae1eddf1156499aa346502f7a200125. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.921162 12173 ts_tablet_manager.cc:1918] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.921201 11921 raft_consensus.cc:2466] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.921237 12173 log.cc:1199] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8b82e99ecc994068b7823ef75d5b233f
I20250625 14:01:56.921454 12173 ts_tablet_manager.cc:1939] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.921470 12911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:56.921579 12911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
I20250625 14:01:56.909439 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 44dd83c53b15400d94bb7b1a8784569a (DEFAULT_TABLE table=default.Table_55126bbe64de49bb88e911c8dfa1d9b9 [id=55cc2676447f4267a1b31fb53a7705dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.922588 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dd83c53b15400d94bb7b1a8784569a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.923123 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8b82e99ecc994068b7823ef75d5b233f (table default.Table_06a503f6355b478caf948985a84c15f6 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
I20250625 14:01:56.923259 12167 tablet_bootstrap.cc:492] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.923326 12173 tablet_replica.cc:331] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.923341 12167 ts_tablet_manager.cc:1397] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.000s
I20250625 14:01:56.923456 12173 raft_consensus.cc:2241] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.923552 12173 raft_consensus.cc:2270] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.923822 12167 raft_consensus.cc:357] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.923882 12173 ts_tablet_manager.cc:1905] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.923921 12167 raft_consensus.cc:383] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.923955 12167 raft_consensus.cc:738] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.924065 12167 consensus_queue.cc:260] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.924350 12167 ts_tablet_manager.cc:1428] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.924541 12167 tablet_bootstrap.cc:492] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.909544 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e5c492cb21c45f391aa20780f680d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.909602 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet a7e0385d1c584c2d9560cbe138686565 with delete_type TABLET_DATA_DELETED (replaced by tablet a4ca3d5203a64d99912765b83af97c09) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.910431 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 0627b4ff4173405eba5bd0686bab8e55 (DEFAULT_TABLE table=default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.924970 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0627b4ff4173405eba5bd0686bab8e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.925529 12167 tablet_bootstrap.cc:654] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.925920 12175 ts_tablet_manager.cc:1905] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.911765 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e (DEFAULT_TABLE table=default.Table_10a18d192fee4f6092695ec20f30a5ae [id=e7c4295c0e4b4f3bad40b4d458861960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.915068 12177 ts_tablet_manager.cc:1918] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.926964 12177 log.cc:1199] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/bfdb34255cb147c48a322514b7a7a19d
I20250625 14:01:56.927078 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e56586f5cd745a397bf6ed1a63d070e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.927224 12177 ts_tablet_manager.cc:1939] T bfdb34255cb147c48a322514b7a7a19d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.927788 12177 tablet_replica.cc:331] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.927949 12177 raft_consensus.cc:2241] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.928061 12177 raft_consensus.cc:2270] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.928401 12175 ts_tablet_manager.cc:1918] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.928469 12175 log.cc:1199] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/72efc3ed21e3404eb0a0ba4326513601
I20250625 14:01:56.928632 12177 ts_tablet_manager.cc:1905] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.928689 12175 ts_tablet_manager.cc:1939] T 72efc3ed21e3404eb0a0ba4326513601 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.918401 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 801fae4d88114ff29eacde80365b84a0 (DEFAULT_TABLE table=default.Table_99e3b9f63eb947ed8424df6c7a25de5e [id=c1cfd4563a0043058570d3ce22551316]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:56.928966 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801fae4d88114ff29eacde80365b84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:56.929531 12175 tablet_replica.cc:331] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.929592 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 72efc3ed21e3404eb0a0ba4326513601 (table default.Table_03ca42d86d7d454699eea52f84b29ffb [id=e32fff7acb81496caed3c543cbb849fd]) successfully deleted
I20250625 14:01:56.929661 12175 raft_consensus.cc:2241] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.929756 12175 raft_consensus.cc:2270] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.930284 12175 ts_tablet_manager.cc:1905] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.930626 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet e307709d217643358c7c3efb3dd73747 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dc5b8ea4f3b47f19c603c235fa79007) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.930814 12177 ts_tablet_manager.cc:1918] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:56.930883 12177 log.cc:1199] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/10506b2cb6c5468daa6ef270b6ed2d4d
I20250625 14:01:56.931155 12177 ts_tablet_manager.cc:1939] T 10506b2cb6c5468daa6ef270b6ed2d4d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.931735 12177 tablet_replica.cc:331] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:01:56.931727 11993 leader_election.cc:343] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 8b82e99ecc994068b7823ef75d5b233f
I20250625 14:01:56.931805 11993 leader_election.cc:304] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.931864 12177 raft_consensus.cc:2241] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:01:56.931903 11993 raft_consensus.cc:2684] T 8b82e99ecc994068b7823ef75d5b233f P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:56.931955 12177 raft_consensus.cc:2270] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.932437 12177 ts_tablet_manager.cc:1905] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.932776 12175 ts_tablet_manager.cc:1918] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.932847 12175 log.cc:1199] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/deee7c3fb5204c63a6618f628848bc81
I20250625 14:01:56.933049 12175 ts_tablet_manager.cc:1939] T deee7c3fb5204c63a6618f628848bc81 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.933584 12175 tablet_replica.cc:331] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.933707 12175 raft_consensus.cc:2241] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.933796 12175 raft_consensus.cc:2270] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.934257 12175 ts_tablet_manager.cc:1905] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.935905 12172 tablet_bootstrap.cc:492] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.936002 12172 ts_tablet_manager.cc:1397] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.000s
I20250625 14:01:56.936506 12172 raft_consensus.cc:357] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.936592 12175 ts_tablet_manager.cc:1918] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.936614 12172 raft_consensus.cc:383] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.936646 12172 raft_consensus.cc:738] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.936662 12175 log.cc:1199] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/bfdb34255cb147c48a322514b7a7a19d
I20250625 14:01:56.936875 12175 ts_tablet_manager.cc:1939] T bfdb34255cb147c48a322514b7a7a19d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.937594 12172 consensus_queue.cc:260] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.938032 12172 ts_tablet_manager.cc:1428] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:56.938375 12172 tablet_bootstrap.cc:492] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.938544 12800 raft_consensus.cc:491] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.938630 12800 raft_consensus.cc:513] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.939044 12800 leader_election.cc:290] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:56.939069 11717 leader_election.cc:343] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.939141 11717 leader_election.cc:304] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:56.939270 12238 raft_consensus.cc:2747] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.939392 11717 leader_election.cc:304] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.939529 12238 raft_consensus.cc:2802] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.939505 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e62aba799c354c178db2d8c31ce7e969" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.939610 12238 raft_consensus.cc:695] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:56.939731 12238 consensus_queue.cc:237] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.940495 12233 tablet.cc:1722] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:56.941356 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet deee7c3fb5204c63a6618f628848bc81 (table default.Table_e97f0540e97b415fa28869e09d50620e [id=ae16a007c35f4784b80230d2eb49b42c]) successfully deleted
I20250625 14:01:56.941526 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet bfdb34255cb147c48a322514b7a7a19d (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:56.941772 12054 raft_consensus.cc:3058] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:56.943063 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0547992986704a949305e7c5d014b965 consensus state has no leader
I20250625 14:01:56.943507 12558 consensus_queue.cc:1035] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:56.945154 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 94232e8e88e84350b5f150a6eb433c92 consensus state has no leader
I20250625 14:01:56.945773 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 1 got 0
I20250625 14:01:56.945947 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_06a503f6355b478caf948985a84c15f6 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 3 got 0
I20250625 14:01:56.946098 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:56.946336 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:56.946426 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 96ec205b0f31484a91054fedf619b9ab (table default.Table_6c025a609dc74d37a082a5050f756463 [id=62132df62b3a42fb9886592b9b885d31]). Expected version 1 got 0
I20250625 14:01:56.946555 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697]). Expected version 2 got 0
I20250625 14:01:56.946668 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]). Expected version 2 got 0
W20250625 14:01:56.947846 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 295ddb94cd4f489c9d53875bd1578474 consensus state has no leader
I20250625 14:01:56.948098 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4
I20250625 14:01:56.948238 12172 tablet_bootstrap.cc:654] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.948752 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:56.949177 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 already in progress: creating tablet
I20250625 14:01:56.949882 12177 ts_tablet_manager.cc:1918] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.949949 12177 log.cc:1199] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7cc7e962e4b146bc88a06fde969eb99d
I20250625 14:01:56.950161 12177 ts_tablet_manager.cc:1939] T 7cc7e962e4b146bc88a06fde969eb99d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.950601 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 097b49d0283541478241e6c699504174
I20250625 14:01:56.950902 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 097b49d0283541478241e6c699504174 deleted and replaced by tablet fa2ccf77288144e5b81513dede9d4302
I20250625 14:01:56.950945 12167 tablet_bootstrap.cc:492] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.951035 12167 ts_tablet_manager.cc:1397] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:01:56.951108 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_ac37faa91c204435ada9ba6a31078de5 [id=0a1fbbbc90124c79b0735327a9836f18] alter complete (version 1)
I20250625 14:01:56.951201 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 097b49d0283541478241e6c699504174 with delete_type TABLET_DATA_DELETED (replaced by tablet fa2ccf77288144e5b81513dede9d4302) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.951584 12167 raft_consensus.cc:357] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.951640 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dc38af2e12bd48faa284df718dff16f9" } modify_external_catalogs: true
I20250625 14:01:56.951709 12167 raft_consensus.cc:383] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.951714 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet a7e0385d1c584c2d9560cbe138686565 with delete_type TABLET_DATA_DELETED (replaced by tablet a4ca3d5203a64d99912765b83af97c09) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.951742 12167 raft_consensus.cc:738] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.951754 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dc38af2e12bd48faa284df718dff16f9" } modify_external_catalogs: true
I20250625 14:01:56.951864 12175 tablet_replica.cc:331] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.951870 12167 consensus_queue.cc:260] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.952020 12175 raft_consensus.cc:2241] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.952127 12175 raft_consensus.cc:2270] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.952154 12167 ts_tablet_manager.cc:1428] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.952351 12167 tablet_bootstrap.cc:492] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.953717 12238 raft_consensus.cc:491] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.953809 12238 raft_consensus.cc:513] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.953930 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.954071 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 097b49d0283541478241e6c699504174 with delete_type TABLET_DATA_DELETED (replaced by tablet fa2ccf77288144e5b81513dede9d4302) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.954192 12238 leader_election.cc:290] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.954407 12167 tablet_bootstrap.cc:654] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.954408 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697]). Expected version 2 got 0
I20250625 14:01:56.954540 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:56.954782 12175 ts_tablet_manager.cc:1905] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.955631 12167 tablet_bootstrap.cc:492] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.955708 12167 ts_tablet_manager.cc:1397] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:56.955844 12800 raft_consensus.cc:491] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.955926 12800 raft_consensus.cc:513] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.955972 12166 tablet_bootstrap.cc:492] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.956055 12166 ts_tablet_manager.cc:1397] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.001s
I20250625 14:01:56.956151 12167 raft_consensus.cc:357] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.956235 12167 raft_consensus.cc:383] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.956269 12167 raft_consensus.cc:738] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.956310 12800 leader_election.cc:290] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.956374 12167 consensus_queue.cc:260] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.956568 12166 raft_consensus.cc:357] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.956650 12166 raft_consensus.cc:383] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.956672 12166 raft_consensus.cc:738] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.956709 12167 ts_tablet_manager.cc:1428] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.956758 12166 consensus_queue.cc:260] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.956885 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet cc9e2afd5bc443398293d0ed572f6c05 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.956957 12167 tablet_bootstrap.cc:492] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:56.957027 12166 ts_tablet_manager.cc:1428] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:56.957371 12166 tablet_bootstrap.cc:492] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.958017 12167 tablet_bootstrap.cc:654] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.958165 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:56.959089 12177 tablet_replica.cc:331] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.959241 12177 raft_consensus.cc:2241] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.959352 12177 raft_consensus.cc:2270] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:56.960422 11990 leader_election.cc:343] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: e307709d217643358c7c3efb3dd73747
I20250625 14:01:56.960495 12166 tablet_bootstrap.cc:654] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.961033 12177 ts_tablet_manager.cc:1905] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.963762 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 87974ef08b3b4cc299ae643c0cb5d694
I20250625 14:01:56.963860 12177 ts_tablet_manager.cc:1918] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.963933 12177 log.cc:1199] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/1f5c017990c54099b1cdbddc75a12e10
I20250625 14:01:56.964146 12177 ts_tablet_manager.cc:1939] T 1f5c017990c54099b1cdbddc75a12e10 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.964454 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 87974ef08b3b4cc299ae643c0cb5d694 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.964620 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet bfdb34255cb147c48a322514b7a7a19d (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:56.964830 12172 tablet_bootstrap.cc:492] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.964892 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 87974ef08b3b4cc299ae643c0cb5d694 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.964931 12172 ts_tablet_manager.cc:1397] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:01:56.965360 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 10506b2cb6c5468daa6ef270b6ed2d4d (table default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346 [id=62eeb40941e44946a64d1067d3d44dc7]) successfully deleted
I20250625 14:01:56.965431 12172 raft_consensus.cc:357] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.965570 12172 raft_consensus.cc:383] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.965605 12172 raft_consensus.cc:738] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.965595 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 5d1979e44eab46c7a54a204603963839 (table default.Table_ac37faa91c204435ada9ba6a31078de5 [id=0a1fbbbc90124c79b0735327a9836f18]). Expected version 1 got 0
I20250625 14:01:56.965691 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]). Expected version 2 got 0
I20250625 14:01:56.965729 12172 consensus_queue.cc:260] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.966089 12172 ts_tablet_manager.cc:1428] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:56.965710 11717 leader_election.cc:343] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.966392 12172 tablet_bootstrap.cc:492] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.967424 12172 tablet_bootstrap.cc:654] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.967523 12167 tablet_bootstrap.cc:492] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.967622 12167 ts_tablet_manager.cc:1397] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:01:56.968194 12167 raft_consensus.cc:357] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.968304 12167 raft_consensus.cc:383] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.968335 12167 raft_consensus.cc:738] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.968492 12167 consensus_queue.cc:260] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.968912 12167 ts_tablet_manager.cc:1428] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.969157 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7cc7e962e4b146bc88a06fde969eb99d (table default.Table_0b3cb311c8ff42a6a5488448051f33a8 [id=c8d56c06b27f4a54ae3a23126f7d04a9]) successfully deleted
I20250625 14:01:56.969249 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96ec205b0f31484a91054fedf619b9ab" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:56.969404 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 21908df7bb384e9782b97abe6f06b0f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21908df7bb384e9782b97abe6f06b0f5 already in progress: creating tablet
I20250625 14:01:56.969388 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96ec205b0f31484a91054fedf619b9ab" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:56.969527 11921 raft_consensus.cc:2466] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:01:56.969635 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 35ece361f92a4c9a9df5ad3355f87db9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ece361f92a4c9a9df5ad3355f87db9 already in progress: creating tablet
I20250625 14:01:56.970140 12167 tablet_bootstrap.cc:492] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:56.970202 11717 leader_election.cc:343] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.970348 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.970402 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e62aba799c354c178db2d8c31ce7e969" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:56.970479 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 097b49d0283541478241e6c699504174 with delete_type TABLET_DATA_DELETED (replaced by tablet fa2ccf77288144e5b81513dede9d4302) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.970664 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 87974ef08b3b4cc299ae643c0cb5d694 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:56.971267 12167 tablet_bootstrap.cc:654] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.971192 12430 tablet.cc:1722] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:56.971917 12173 ts_tablet_manager.cc:1918] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.972002 12173 log.cc:1199] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8363c9c6dab64a30b08ab92a152a3ee5
I20250625 14:01:56.972229 12173 ts_tablet_manager.cc:1939] T 8363c9c6dab64a30b08ab92a152a3ee5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:56.972262 12177 tablet_replica.cc:331] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:56.972402 12177 raft_consensus.cc:2241] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.972527 12177 raft_consensus.cc:2270] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.972920 12177 ts_tablet_manager.cc:1905] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.974502 12175 ts_tablet_manager.cc:1918] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:56.974574 12175 log.cc:1199] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/097b49d0283541478241e6c699504174
I20250625 14:01:56.974777 12175 ts_tablet_manager.cc:1939] T 097b49d0283541478241e6c699504174 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:56.975504 12175 tablet_replica.cc:331] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:56.975505 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 097b49d0283541478241e6c699504174 (table default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]) successfully deleted
I20250625 14:01:56.975634 12175 raft_consensus.cc:2241] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.975736 12175 raft_consensus.cc:2270] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.976218 12175 ts_tablet_manager.cc:1905] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.976320 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697]). Expected version 2 got 0
I20250625 14:01:56.976657 12173 tablet_replica.cc:331] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:56.976805 12173 raft_consensus.cc:2241] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:56.976929 12173 raft_consensus.cc:2270] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:56.977439 11993 leader_election.cc:304] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.977669 12800 raft_consensus.cc:2747] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:56.978049 11993 leader_election.cc:343] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: e307709d217643358c7c3efb3dd73747
I20250625 14:01:56.978127 11993 leader_election.cc:304] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:56.978463 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 1f5c017990c54099b1cdbddc75a12e10 (table default.Table_c99e790aef874f6c8875c93bd8df8256 [id=b1f7726fb4e44a9992a4ef7a1afb339d]) successfully deleted
I20250625 14:01:56.978623 12800 raft_consensus.cc:2747] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:56.978695 11717 leader_election.cc:304] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:56.978989 12894 raft_consensus.cc:2802] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:56.979055 12894 raft_consensus.cc:491] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:56.979107 12894 raft_consensus.cc:3058] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.980041 12173 ts_tablet_manager.cc:1905] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:56.980122 12894 raft_consensus.cc:513] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.980460 12894 leader_election.cc:290] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.981213 12172 tablet_bootstrap.cc:492] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:56.981307 12172 ts_tablet_manager.cc:1397] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:56.981817 12172 raft_consensus.cc:357] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.981936 12172 raft_consensus.cc:383] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.981968 12172 raft_consensus.cc:738] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.982088 12172 consensus_queue.cc:260] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:56.982578 12056 raft_consensus.cc:3058] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.982645 12172 ts_tablet_manager.cc:1428] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:56.982831 12172 tablet_bootstrap.cc:492] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:56.983085 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96ec205b0f31484a91054fedf619b9ab" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:56.983193 11919 raft_consensus.cc:3058] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.984130 12172 tablet_bootstrap.cc:654] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.984117 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8363c9c6dab64a30b08ab92a152a3ee5 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]) successfully deleted
I20250625 14:01:56.984229 11919 raft_consensus.cc:2466] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:56.984380 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96ec205b0f31484a91054fedf619b9ab" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:56.984395 12558 consensus_queue.cc:1035] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:56.985561 12166 tablet_bootstrap.cc:492] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:56.985662 12166 ts_tablet_manager.cc:1397] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.000s
I20250625 14:01:56.987180 11717 leader_election.cc:304] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:56.987361 12238 raft_consensus.cc:2802] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:56.987448 12238 raft_consensus.cc:695] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
W20250625 14:01:56.987468 11717 leader_election.cc:343] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:56.987586 12238 consensus_queue.cc:237] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.987653 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7c68ae7ecff34d34baaffe47c740bac6
I20250625 14:01:56.988576 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.988747 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.988893 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet cc9e2afd5bc443398293d0ed572f6c05
I20250625 14:01:56.989172 11524 catalog_manager.cc:6652] ReplaceTablet: tablet cc9e2afd5bc443398293d0ed572f6c05 deleted and replaced by tablet a05b09a3225f45db841978b7b9b1fe51
I20250625 14:01:56.989264 12233 tablet.cc:1717] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:56.989646 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 with delete_type TABLET_DATA_DELETED (replaced by tablet a05b09a3225f45db841978b7b9b1fe51) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:56.989915 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 with delete_type TABLET_DATA_DELETED (replaced by tablet a05b09a3225f45db841978b7b9b1fe51) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:56.991029 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet fc948c61d54a4618856b64a12a32b2c4 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.992309 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet e15bd70671f8458db5b9e52423189eda from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:56.992362 12177 ts_tablet_manager.cc:1918] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:56.992441 12177 log.cc:1199] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/09a197bdabd24d7c96febe1fd5352a14
I20250625 14:01:56.992573 12430 tablet.cc:1717] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:56.992702 12177 ts_tablet_manager.cc:1939] T 09a197bdabd24d7c96febe1fd5352a14 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:56.993484 12167 tablet_bootstrap.cc:492] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:56.993582 12167 ts_tablet_manager.cc:1397] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:56.994123 12167 raft_consensus.cc:357] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.994253 12167 raft_consensus.cc:383] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.994293 12167 raft_consensus.cc:738] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.994407 12166 raft_consensus.cc:357] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.994513 12166 raft_consensus.cc:383] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:56.994541 12166 raft_consensus.cc:738] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:56.994706 12167 consensus_queue.cc:260] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.994799 12166 consensus_queue.cc:260] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.995277 12056 raft_consensus.cc:3058] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:56.995455 12166 ts_tablet_manager.cc:1428] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250625 14:01:56.995635 12166 tablet_bootstrap.cc:492] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:56.996104 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4d04289158c94a1a95157a785c3d5829" } new_table_name: "default.Table_d6d78f7d158248f6a25dc311131eed4d" modify_external_catalogs: true
I20250625 14:01:56.997242 12861 tablet.cc:1722] T 5d1979e44eab46c7a54a204603963839 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:56.998059 12238 raft_consensus.cc:491] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:56.998149 12238 raft_consensus.cc:513] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:56.998536 12238 leader_election.cc:290] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:56.998826 12167 ts_tablet_manager.cc:1428] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20250625 14:01:56.998994 12166 tablet_bootstrap.cc:654] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:56.999017 12167 tablet_bootstrap.cc:492] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.000802 12167 tablet_bootstrap.cc:654] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.002202 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e15bd70671f8458db5b9e52423189eda
I20250625 14:01:57.002238 12177 tablet_replica.cc:331] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.002399 12177 raft_consensus.cc:2241] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.002514 11525 catalog_manager.cc:6652] ReplaceTablet: tablet e15bd70671f8458db5b9e52423189eda deleted and replaced by tablet 1d596792632e4e32be161450f46b4168
I20250625 14:01:57.002954 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet e15bd70671f8458db5b9e52423189eda with delete_type TABLET_DATA_DELETED (replaced by tablet 1d596792632e4e32be161450f46b4168) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.003118 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet e15bd70671f8458db5b9e52423189eda with delete_type TABLET_DATA_DELETED (replaced by tablet 1d596792632e4e32be161450f46b4168) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.002503 12177 raft_consensus.cc:2270] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.003883 12177 ts_tablet_manager.cc:1905] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.004302 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet fc948c61d54a4618856b64a12a32b2c4
I20250625 14:01:57.004577 11524 catalog_manager.cc:6652] ReplaceTablet: tablet fc948c61d54a4618856b64a12a32b2c4 deleted and replaced by tablet fee20f2812d34d188b7181e6da00f823
I20250625 14:01:57.004874 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet fc948c61d54a4618856b64a12a32b2c4 with delete_type TABLET_DATA_DELETED (replaced by tablet fee20f2812d34d188b7181e6da00f823) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.005028 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet fc948c61d54a4618856b64a12a32b2c4 with delete_type TABLET_DATA_DELETED (replaced by tablet fee20f2812d34d188b7181e6da00f823) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.006502 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 with delete_type TABLET_DATA_DELETED (replaced by tablet a05b09a3225f45db841978b7b9b1fe51) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:57.006553 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a25ceea16cbb4e339c2ebcc580c47270 consensus state has no leader
I20250625 14:01:57.006754 12167 tablet_bootstrap.cc:492] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.006835 12167 ts_tablet_manager.cc:1397] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s
I20250625 14:01:57.006911 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet e15bd70671f8458db5b9e52423189eda with delete_type TABLET_DATA_DELETED (replaced by tablet 1d596792632e4e32be161450f46b4168) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.007210 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ebac6abf36f44fb93f556b59b2dd022" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.007284 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]) successfully deleted
I20250625 14:01:57.007345 12167 raft_consensus.cc:357] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:57.007447 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 2e5c492cb21c45f391aa20780f680d5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e5c492cb21c45f391aa20780f680d5f already in progress: creating tablet
I20250625 14:01:57.007441 12173 ts_tablet_manager.cc:1918] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:57.007516 12173 log.cc:1199] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a7f797fe89204fa18340bfb43ab36cbf
I20250625 14:01:57.007565 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet fc948c61d54a4618856b64a12a32b2c4 with delete_type TABLET_DATA_DELETED (replaced by tablet fee20f2812d34d188b7181e6da00f823) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.007793 12173 ts_tablet_manager.cc:1939] T a7f797fe89204fa18340bfb43ab36cbf P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.008105 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ebac6abf36f44fb93f556b59b2dd022" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.008484 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a7f797fe89204fa18340bfb43ab36cbf (table default.Table_06caae8b35634d028c7368ee9936151a [id=ccfb2f80b431431db5df92e0b400520c]) successfully deleted
W20250625 14:01:57.008663 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 6d41c8cea082478d9cc16c143b3a3f7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d41c8cea082478d9cc16c143b3a3f7a already in progress: creating tablet
I20250625 14:01:57.007452 12167 raft_consensus.cc:383] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.008837 12167 raft_consensus.cc:738] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.008992 12167 consensus_queue.cc:260] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:57.009241 11717 leader_election.cc:343] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.009317 12167 ts_tablet_manager.cc:1428] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:57.009436 11921 raft_consensus.cc:1273] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:57.009523 12167 tablet_bootstrap.cc:492] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.010501 12167 tablet_bootstrap.cc:654] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.011467 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.012092 12177 ts_tablet_manager.cc:1918] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.012172 12177 log.cc:1199] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a7e0385d1c584c2d9560cbe138686565
I20250625 14:01:57.012502 12177 ts_tablet_manager.cc:1939] T a7e0385d1c584c2d9560cbe138686565 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.013258 12177 tablet_replica.cc:331] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.013401 12177 raft_consensus.cc:2241] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:01:57.009389 11717 leader_election.cc:343] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.013480 11717 leader_election.cc:304] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:57.013550 12177 pending_rounds.cc:70] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:57.013612 12177 pending_rounds.cc:77] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523038521483264 op_type: NO_OP noop_request { }
I20250625 14:01:57.013659 12894 raft_consensus.cc:2747] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.013808 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a7e0385d1c584c2d9560cbe138686565 (table default.Table_e43289a5fa434695a866d39a58d5c776 [id=d02b8ccb415e4358832eb8334c21a8b9]) successfully deleted
I20250625 14:01:57.013852 12177 raft_consensus.cc:2887] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20250625 14:01:57.014031 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 already in progress: creating tablet
I20250625 14:01:57.014760 12167 tablet_bootstrap.cc:492] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.014866 12167 ts_tablet_manager.cc:1397] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:01:57.014022 12177 raft_consensus.cc:2270] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:57.013863 11717 consensus_peers.cc:487] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:57.015434 12167 raft_consensus.cc:357] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:57.015527 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 562187f6db8a4883a5bb2d939a31b769 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 562187f6db8a4883a5bb2d939a31b769 already in progress: creating tablet
I20250625 14:01:57.015552 12167 raft_consensus.cc:383] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.015588 12167 raft_consensus.cc:738] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.015683 12894 consensus_queue.cc:1035] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.015705 12167 consensus_queue.cc:260] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.015790 12177 ts_tablet_manager.cc:1905] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.015983 12167 ts_tablet_manager.cc:1428] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:57.016176 12167 tablet_bootstrap.cc:492] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.016283 12175 ts_tablet_manager.cc:1918] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.016351 12175 log.cc:1199] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/a7e0385d1c584c2d9560cbe138686565
I20250625 14:01:57.016549 12175 ts_tablet_manager.cc:1939] T a7e0385d1c584c2d9560cbe138686565 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.017302 12167 tablet_bootstrap.cc:654] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.017445 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a7e0385d1c584c2d9560cbe138686565 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7e0385d1c584c2d9560cbe138686565 already in progress: creating tablet
I20250625 14:01:57.017522 12600 raft_consensus.cc:491] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.017608 12600 raft_consensus.cc:513] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.017747 12175 tablet_replica.cc:331] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:01:57.017858 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1dc443822d504733b5d67e212020df0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dc443822d504733b5d67e212020df0e already in progress: creating tablet
I20250625 14:01:57.017884 12175 raft_consensus.cc:2241] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.017989 12175 raft_consensus.cc:2270] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.018043 12600 leader_election.cc:290] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.018462 12175 ts_tablet_manager.cc:1905] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.018894 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet a7e0385d1c584c2d9560cbe138686565 (table default.Table_e43289a5fa434695a866d39a58d5c776 [id=d02b8ccb415e4358832eb8334c21a8b9]) successfully deleted
I20250625 14:01:57.019115 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5227c93e932a4ed4b3d03990d7ed7b69" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.019245 11782 raft_consensus.cc:2466] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:57.019706 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5227c93e932a4ed4b3d03990d7ed7b69" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.019879 11858 leader_election.cc:304] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:57.020634 11855 leader_election.cc:343] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.020917 12600 raft_consensus.cc:2802] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.020977 12600 raft_consensus.cc:491] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.021014 12600 raft_consensus.cc:3058] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.020947 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f41c7ed5d5c64d7196b15168dc43ccab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.021335 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f41c7ed5d5c64d7196b15168dc43ccab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.021488 12173 tablet_replica.cc:331] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.021634 12173 raft_consensus.cc:2241] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.021755 12173 raft_consensus.cc:2270] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.021970 12600 raft_consensus.cc:513] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.022126 12173 ts_tablet_manager.cc:1905] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.022207 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5f98d59df4eb46318868cd55ce407c04" } modify_external_catalogs: true
I20250625 14:01:57.022300 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5f98d59df4eb46318868cd55ce407c04" } modify_external_catalogs: true
I20250625 14:01:57.022338 12600 leader_election.cc:290] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.022754 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0407310c9aee4d729058ad076b9295d6" } new_table_name: "default.Table_d996cc697ed246c7b1118cdd14e3450c" modify_external_catalogs: true
I20250625 14:01:57.022950 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5227c93e932a4ed4b3d03990d7ed7b69" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:57.023072 11782 raft_consensus.cc:3058] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.024060 11782 raft_consensus.cc:2466] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:57.024323 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5227c93e932a4ed4b3d03990d7ed7b69" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.025099 11858 leader_election.cc:304] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.025532 12600 raft_consensus.cc:2802] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.025619 12600 raft_consensus.cc:695] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:57.025743 12600 consensus_queue.cc:237] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:57.026937 11855 leader_election.cc:343] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.028963 11526 catalog_manager.cc:5582] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.029175 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]). Expected version 1 got 0
I20250625 14:01:57.029358 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:57.029875 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]). Expected version 1 got 0
I20250625 14:01:57.029891 12177 ts_tablet_manager.cc:1918] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:57.029964 12177 log.cc:1199] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/097b49d0283541478241e6c699504174
I20250625 14:01:57.030231 12177 ts_tablet_manager.cc:1939] T 097b49d0283541478241e6c699504174 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.030478 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 56250a60d7104f22bd4b2206f3a5df14 (table default.Table_892620871def4b818f36f2c0b4f1cbed [id=e1d9126672684e808d499d3902fc371b]). Expected version 1 got 0
I20250625 14:01:57.031023 12177 tablet_replica.cc:331] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.031239 12177 raft_consensus.cc:2241] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.031351 12177 raft_consensus.cc:2270] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.031571 12166 tablet_bootstrap.cc:492] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.031680 12166 ts_tablet_manager.cc:1397] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:01:57.031962 12173 ts_tablet_manager.cc:1918] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.032051 12173 log.cc:1199] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/61acdd21d02e4576adba8f2ff24a154a
I20250625 14:01:57.032143 12166 raft_consensus.cc:357] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.032253 12166 raft_consensus.cc:383] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.032285 12166 raft_consensus.cc:738] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.032835 12177 ts_tablet_manager.cc:1905] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.032891 12233 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:57.033515 12430 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:57.034709 11899 tablet_service.cc:1468] Processing CreateTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 (DEFAULT_TABLE table=default.Table_bd047e00bc2045538f5a1a59bb15519f [id=afb45b5ae6fd44d79aeffec0dfa629c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.035097 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 00437d4f1cae420698471935887c2418 (DEFAULT_TABLE table=default.Table_fa193e07de344ccdb0d6f6e45a201fe7 [id=56373baba3584912bcff9379fed13ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.035429 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf (DEFAULT_TABLE table=default.Table_de10db8210b34241a0e63aaa8702fb67 [id=e183bb9e565845b7aab4a61a32ccb7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.035727 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 837e98e4e48a465fa9c3e697ae34c9ea (DEFAULT_TABLE table=default.Table_fa719388db36434cbfd373ed001644c9 [id=740dddd095854d55afb3091ebf06d72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.037415 11754 tablet_service.cc:1468] Processing CreateTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 (DEFAULT_TABLE table=default.Table_bd047e00bc2045538f5a1a59bb15519f [id=afb45b5ae6fd44d79aeffec0dfa629c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.037659 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97c5c63a8184f07ad6e8054d056ff58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.040148 11897 tablet_service.cc:1468] Processing CreateTablet for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (DEFAULT_TABLE table=default.Table_4571ef6dee28441bb7db7d12168d94c7 [id=f61687f702554b25b0d74b90450e9947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.032387 12166 consensus_queue.cc:260] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.041090 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]). Expected version 1 got 0
I20250625 14:01:57.042346 12166 ts_tablet_manager.cc:1428] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250625 14:01:57.043383 12166 tablet_bootstrap.cc:492] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.046173 12177 ts_tablet_manager.cc:1918] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.046252 12177 log.cc:1199] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/87974ef08b3b4cc299ae643c0cb5d694
I20250625 14:01:57.046532 12177 ts_tablet_manager.cc:1939] T 87974ef08b3b4cc299ae643c0cb5d694 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.047703 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 097b49d0283541478241e6c699504174 (table default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]) successfully deleted
I20250625 14:01:57.047971 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf (DEFAULT_TABLE table=default.Table_de10db8210b34241a0e63aaa8702fb67 [id=e183bb9e565845b7aab4a61a32ccb7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.048240 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebec65b7f6a475ab01359aab392d1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.048220 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 882da47c1f5a496f8df2ba2d3501b453 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.048453 12172 tablet_bootstrap.cc:492] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.048545 12172 ts_tablet_manager.cc:1397] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.000s
I20250625 14:01:57.048533 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3d8fdaed60c54eb6a0587add293c3e61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.048907 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d8fdaed60c54eb6a0587add293c3e61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.049011 12172 raft_consensus.cc:357] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.049106 12172 raft_consensus.cc:383] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.049158 12172 raft_consensus.cc:738] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.049288 12172 consensus_queue.cc:260] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.049618 12172 ts_tablet_manager.cc:1428] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.049791 12172 tablet_bootstrap.cc:492] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.050129 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 00437d4f1cae420698471935887c2418 (DEFAULT_TABLE table=default.Table_fa193e07de344ccdb0d6f6e45a201fe7 [id=56373baba3584912bcff9379fed13ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.050431 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00437d4f1cae420698471935887c2418. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.050798 12172 tablet_bootstrap.cc:654] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.055610 12558 consensus_queue.cc:1035] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.061352 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 837e98e4e48a465fa9c3e697ae34c9ea (DEFAULT_TABLE table=default.Table_fa719388db36434cbfd373ed001644c9 [id=740dddd095854d55afb3091ebf06d72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.063045 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837e98e4e48a465fa9c3e697ae34c9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.063223 12177 tablet_replica.cc:331] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.063565 12177 raft_consensus.cc:2241] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:57.063773 12177 pending_rounds.cc:70] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:01:57.063865 12177 pending_rounds.cc:77] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523037599174656 op_type: NO_OP noop_request { }
I20250625 14:01:57.063997 12177 raft_consensus.cc:2887] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:57.064096 12177 raft_consensus.cc:2270] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.064678 12177 ts_tablet_manager.cc:1905] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.064978 11531 catalog_manager.cc:5582] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.065202 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]). Expected version 1 got 0
I20250625 14:01:57.065331 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_06a503f6355b478caf948985a84c15f6 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 3 got 0
I20250625 14:01:57.066744 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.067149 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.068512 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 (DEFAULT_TABLE table=default.Table_dfb0fb317e8d4ca799c64b29140de875 [id=ca4d9657d22c41cb8df831d8a7470745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.068678 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 (DEFAULT_TABLE table=default.Table_e11dc32e96254d3489a8f9c7028feaca [id=9644f5266f174f748510e2c26e6b102f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.068806 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 7b817bda69f44497a6787d1d649ef5e9 (DEFAULT_TABLE table=default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.068678 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 (DEFAULT_TABLE table=default.Table_5f98d59df4eb46318868cd55ce407c04 [id=dd7a0ca76f43401a945a0ed0fc973001]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.068967 12855 raft_consensus.cc:491] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.069047 12855 raft_consensus.cc:513] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.069454 12855 leader_election.cc:290] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.069839 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef (DEFAULT_TABLE table=default.Table_95a3171b6e53412880ef07bf3291f0bb [id=d2c5d6b97745451cabb9a44a25c19b80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.070053 12177 ts_tablet_manager.cc:1918] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:57.070219 12177 log.cc:1199] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/fc948c61d54a4618856b64a12a32b2c4
I20250625 14:01:57.070582 12177 ts_tablet_manager.cc:1939] T fc948c61d54a4618856b64a12a32b2c4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:01:57.071244 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4199634a8be4e359cc9707d4754cac9 consensus state has no leader
I20250625 14:01:57.071527 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 043622be53ec4198b6c9b25a0404c0d2
I20250625 14:01:57.072117 12855 raft_consensus.cc:491] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.072227 12855 raft_consensus.cc:513] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.072549 12855 leader_election.cc:290] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.073525 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.074860 12166 tablet_bootstrap.cc:654] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.075275 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 882da47c1f5a496f8df2ba2d3501b453
I20250625 14:01:57.075502 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.075595 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 882da47c1f5a496f8df2ba2d3501b453 deleted and replaced by tablet 6c8c667108694caab967bd91f74759b6
I20250625 14:01:57.075695 11760 tablet_service.cc:1468] Processing CreateTablet for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (DEFAULT_TABLE table=default.Table_4571ef6dee28441bb7db7d12168d94c7 [id=f61687f702554b25b0d74b90450e9947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.075862 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 882da47c1f5a496f8df2ba2d3501b453 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c8c667108694caab967bd91f74759b6) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.075966 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1af86cdb13f427ea61ee8ad56ca3f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.076364 12233 tablet.cc:1722] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.077167 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 87974ef08b3b4cc299ae643c0cb5d694 (table default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]) successfully deleted
W20250625 14:01:57.077316 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet cc9e2afd5bc443398293d0ed572f6c05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc9e2afd5bc443398293d0ed572f6c05 already in progress: creating tablet
W20250625 14:01:57.077425 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet e15bd70671f8458db5b9e52423189eda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e15bd70671f8458db5b9e52423189eda already in progress: creating tablet
I20250625 14:01:57.077539 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
W20250625 14:01:57.077654 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7c68ae7ecff34d34baaffe47c740bac6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c68ae7ecff34d34baaffe47c740bac6 already in progress: creating tablet
I20250625 14:01:57.078176 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 (DEFAULT_TABLE table=default.Table_dfb0fb317e8d4ca799c64b29140de875 [id=ca4d9657d22c41cb8df831d8a7470745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.078426 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 (DEFAULT_TABLE table=default.Table_5f98d59df4eb46318868cd55ce407c04 [id=dd7a0ca76f43401a945a0ed0fc973001]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.078676 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 7b817bda69f44497a6787d1d649ef5e9 (DEFAULT_TABLE table=default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.078899 12172 tablet_bootstrap.cc:492] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.078919 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 (DEFAULT_TABLE table=default.Table_e11dc32e96254d3489a8f9c7028feaca [id=9644f5266f174f748510e2c26e6b102f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.078979 12172 ts_tablet_manager.cc:1397] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250625 14:01:57.079144 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef (DEFAULT_TABLE table=default.Table_95a3171b6e53412880ef07bf3291f0bb [id=d2c5d6b97745451cabb9a44a25c19b80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.079282 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ef10dc2de8460c90dc0cf3bb5fe234. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.079463 12172 raft_consensus.cc:357] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.079571 12172 raft_consensus.cc:383] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.079612 12172 raft_consensus.cc:738] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.079741 12172 consensus_queue.cc:260] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.079998 12172 ts_tablet_manager.cc:1428] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.080214 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb0b1a9a04ca4911b5f6e441d0239977" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.080291 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54f0be19f9134fa3a88ae867b108c7e8" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.080338 11921 raft_consensus.cc:2466] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:57.081396 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697] alter complete (version 2)
I20250625 14:01:57.082365 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.082495 12172 tablet_bootstrap.cc:492] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.083694 12172 tablet_bootstrap.cc:654] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.084441 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1bf8f04694456e91687d89ceb39d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.085459 12600 raft_consensus.cc:491] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.085544 12600 raft_consensus.cc:513] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.085933 12600 leader_election.cc:290] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.086808 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "56250a60d7104f22bd4b2206f3a5df14" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.086926 11782 raft_consensus.cc:2466] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:57.087236 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b817bda69f44497a6787d1d649ef5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.087249 11858 leader_election.cc:304] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.087419 12600 raft_consensus.cc:2802] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.087466 12600 raft_consensus.cc:491] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.087502 12600 raft_consensus.cc:3058] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.087859 11717 leader_election.cc:304] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.088042 12894 raft_consensus.cc:2802] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.088094 12894 raft_consensus.cc:491] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.088132 12894 raft_consensus.cc:3058] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.088569 12600 raft_consensus.cc:513] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.088968 12600 leader_election.cc:290] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.089061 12894 raft_consensus.cc:513] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.089406 12894 leader_election.cc:290] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.089504 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043622be53ec4198b6c9b25a0404c0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.091213 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1bf8f04694456e91687d89ceb39d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.091352 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043622be53ec4198b6c9b25a0404c0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.091570 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b817bda69f44497a6787d1d649ef5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.091698 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00437d4f1cae420698471935887c2418. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.091809 12953 tablet.cc:1722] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.091863 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.091995 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837e98e4e48a465fa9c3e697ae34c9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.092296 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1af86cdb13f427ea61ee8ad56ca3f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.092461 12166 tablet_bootstrap.cc:492] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.092530 12166 ts_tablet_manager.cc:1397] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.000s
I20250625 14:01:57.092573 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ef10dc2de8460c90dc0cf3bb5fe234. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.092722 11717 leader_election.cc:343] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.093019 12166 raft_consensus.cc:357] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.093142 12166 raft_consensus.cc:383] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.093176 12166 raft_consensus.cc:738] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.093308 12166 consensus_queue.cc:260] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.094545 12166 ts_tablet_manager.cc:1428] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:57.094594 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebec65b7f6a475ab01359aab392d1cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.094573 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 043622be53ec4198b6c9b25a0404c0d2 because the tablet was not found. No further retry: Not found: Tablet not found: 043622be53ec4198b6c9b25a0404c0d2
I20250625 14:01:57.095238 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.096681 12166 tablet_bootstrap.cc:492] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.036110 12032 tablet_service.cc:1468] Processing CreateTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 (DEFAULT_TABLE table=default.Table_bd047e00bc2045538f5a1a59bb15519f [id=afb45b5ae6fd44d79aeffec0dfa629c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.096946 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97c5c63a8184f07ad6e8054d056ff58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.097239 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb0b1a9a04ca4911b5f6e441d0239977" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:57.097357 11920 raft_consensus.cc:3058] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.097508 12173 ts_tablet_manager.cc:1939] T 61acdd21d02e4576adba8f2ff24a154a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.097765 12166 tablet_bootstrap.cc:654] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.098196 12173 tablet_replica.cc:331] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.098261 11920 raft_consensus.cc:2466] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:57.098378 12173 raft_consensus.cc:2241] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.098495 12173 raft_consensus.cc:2270] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.099031 12175 ts_tablet_manager.cc:1918] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.099100 12175 log.cc:1199] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/87974ef08b3b4cc299ae643c0cb5d694
I20250625 14:01:57.036551 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 00437d4f1cae420698471935887c2418 (DEFAULT_TABLE table=default.Table_fa193e07de344ccdb0d6f6e45a201fe7 [id=56373baba3584912bcff9379fed13ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.099309 12175 ts_tablet_manager.cc:1939] T 87974ef08b3b4cc299ae643c0cb5d694 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.099473 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00437d4f1cae420698471935887c2418. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.100049 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 87974ef08b3b4cc299ae643c0cb5d694 (table default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]) successfully deleted
I20250625 14:01:57.101176 11717 leader_election.cc:304] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.036763 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf (DEFAULT_TABLE table=default.Table_de10db8210b34241a0e63aaa8702fb67 [id=e183bb9e565845b7aab4a61a32ccb7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.101888 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ebec65b7f6a475ab01359aab392d1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.102782 12172 tablet_bootstrap.cc:492] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.102880 12172 ts_tablet_manager.cc:1397] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250625 14:01:57.036963 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 837e98e4e48a465fa9c3e697ae34c9ea (DEFAULT_TABLE table=default.Table_fa719388db36434cbfd373ed001644c9 [id=740dddd095854d55afb3091ebf06d72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.104204 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837e98e4e48a465fa9c3e697ae34c9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.104593 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2037e3cc66de4c68bc580a95e021e860"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.105137 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9616d3e97f6e49b9b75d91cf6df7490f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.105300 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.105720 12177 tablet_replica.cc:331] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.105788 12666 raft_consensus.cc:491] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 14:01:57.105839 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.105873 12177 raft_consensus.cc:2241] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.105860 12666 raft_consensus.cc:513] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.059096 12029 tablet_service.cc:1468] Processing CreateTablet for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (DEFAULT_TABLE table=default.Table_4571ef6dee28441bb7db7d12168d94c7 [id=f61687f702554b25b0d74b90450e9947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.106236 12666 leader_election.cc:290] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:57.106356 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9616d3e97f6e49b9b75d91cf6df7490f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.106421 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1af86cdb13f427ea61ee8ad56ca3f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.059237 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef (DEFAULT_TABLE table=default.Table_95a3171b6e53412880ef07bf3291f0bb [id=d2c5d6b97745451cabb9a44a25c19b80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.106634 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.106700 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97c5c63a8184f07ad6e8054d056ff58. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.107309 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2037e3cc66de4c68bc580a95e021e860 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.059334 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 (DEFAULT_TABLE table=default.Table_dfb0fb317e8d4ca799c64b29140de875 [id=ca4d9657d22c41cb8df831d8a7470745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.059527 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 (DEFAULT_TABLE table=default.Table_5f98d59df4eb46318868cd55ce407c04 [id=dd7a0ca76f43401a945a0ed0fc973001]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.059731 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 (DEFAULT_TABLE table=default.Table_e11dc32e96254d3489a8f9c7028feaca [id=9644f5266f174f748510e2c26e6b102f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.059096 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 7b817bda69f44497a6787d1d649ef5e9 (DEFAULT_TABLE table=default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.072398 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.073849 12800 raft_consensus.cc:491] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.109443 12800 raft_consensus.cc:513] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.109825 12800 leader_election.cc:290] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.110136 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b817bda69f44497a6787d1d649ef5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.110661 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "56250a60d7104f22bd4b2206f3a5df14" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.110811 11919 raft_consensus.cc:2391] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:57.110973 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "56250a60d7104f22bd4b2206f3a5df14" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:57.111097 11782 raft_consensus.cc:3058] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.111528 12173 ts_tablet_manager.cc:1905] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.111828 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1bf8f04694456e91687d89ceb39d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.112171 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "882da47c1f5a496f8df2ba2d3501b453" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.114091 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ef10dc2de8460c90dc0cf3bb5fe234. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.114447 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043622be53ec4198b6c9b25a0404c0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.114923 12173 ts_tablet_manager.cc:1918] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:57.114985 12173 log.cc:1199] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a8d6c5552b204ec1b2f5e4bf9eba5640
I20250625 14:01:57.115243 12173 ts_tablet_manager.cc:1939] T a8d6c5552b204ec1b2f5e4bf9eba5640 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.115906 12173 tablet_replica.cc:331] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.116019 12173 raft_consensus.cc:2241] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.116143 12173 raft_consensus.cc:2270] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.116528 12173 ts_tablet_manager.cc:1905] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.118291 12173 ts_tablet_manager.cc:1918] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:57.118386 12173 log.cc:1199] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f0c5509615cf45339c455e8add91a96f
I20250625 14:01:57.118602 12173 ts_tablet_manager.cc:1939] T f0c5509615cf45339c455e8add91a96f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.119261 12173 tablet_replica.cc:331] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.119377 12173 raft_consensus.cc:2241] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.119465 12173 raft_consensus.cc:2270] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.119792 12173 ts_tablet_manager.cc:1905] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.121783 12173 ts_tablet_manager.cc:1918] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.121852 12173 log.cc:1199] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/33790cc725df482e91daceca29c820eb
I20250625 14:01:57.121994 12053 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb0b1a9a04ca4911b5f6e441d0239977" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.122082 12173 ts_tablet_manager.cc:1939] T 33790cc725df482e91daceca29c820eb P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.122800 12173 tablet_replica.cc:331] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.122929 12800 raft_consensus.cc:491] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.122932 12173 raft_consensus.cc:2241] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.123028 12800 raft_consensus.cc:513] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.123106 12173 raft_consensus.cc:2270] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.123422 12800 leader_election.cc:290] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.123487 12173 ts_tablet_manager.cc:1905] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.123983 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8a19bb755ba242b59b812cd643e79646"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.124202 11990 leader_election.cc:343] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 704ecf1ea8dd423ead2a0d1be113c03d
W20250625 14:01:57.124452 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a19bb755ba242b59b812cd643e79646 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.125399 12173 ts_tablet_manager.cc:1918] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:57.125458 12173 log.cc:1199] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6d1c412286d94eedac62cf4f1f939f68
I20250625 14:01:57.125684 12173 ts_tablet_manager.cc:1939] T 6d1c412286d94eedac62cf4f1f939f68 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.126408 12173 tablet_replica.cc:331] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.126550 12173 raft_consensus.cc:2241] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.126652 12173 raft_consensus.cc:2270] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.127066 12173 ts_tablet_manager.cc:1905] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.127087 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 61acdd21d02e4576adba8f2ff24a154a (table default.Table_927fcd09348d43e0aeb7ecf78c5f7fd9 [id=75fe7cfcdb0c446f9af9708ba107c0b7]) successfully deleted
I20250625 14:01:57.127511 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a8d6c5552b204ec1b2f5e4bf9eba5640 (table default.Table_55bf09a13eda41eeacbb9ef4a8473575 [id=518547b2a04a411da963ce5d4cb09184]) successfully deleted
I20250625 14:01:57.127715 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f0c5509615cf45339c455e8add91a96f (table default.Table_1992a377fa074076a3e2b67ad1cb336d [id=e5011c6ffb3947b4a72edfde26b3374c]) successfully deleted
W20250625 14:01:57.127846 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 140c1810e98741479c3754729409b46c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 140c1810e98741479c3754729409b46c already in progress: creating tablet
I20250625 14:01:57.128053 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 33790cc725df482e91daceca29c820eb (table default.Table_046e760e5933440995f2198870cdbc31 [id=6ef064ea2c9d4934903469536450aad7]) successfully deleted
I20250625 14:01:57.128252 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6d1c412286d94eedac62cf4f1f939f68 (table default.Table_c562bfdf6c0f4af8bc8fed3557145b52 [id=5e5bed4c27814fc7b14d0c4d9e091890]) successfully deleted
I20250625 14:01:57.129287 12173 ts_tablet_manager.cc:1918] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:57.129361 12173 log.cc:1199] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/10506b2cb6c5468daa6ef270b6ed2d4d
I20250625 14:01:57.129379 11782 raft_consensus.cc:2466] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:57.129593 12173 ts_tablet_manager.cc:1939] T 10506b2cb6c5468daa6ef270b6ed2d4d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.074898 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb0b1a9a04ca4911b5f6e441d0239977" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.075783 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54f0be19f9134fa3a88ae867b108c7e8" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.076043 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 882da47c1f5a496f8df2ba2d3501b453 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c8c667108694caab967bd91f74759b6) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.084940 12861 tablet.cc:1722] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.130123 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet f6116f7e64ae4e19863629a0e88a7265 with delete_type TABLET_DATA_DELETED (replaced by tablet 21f88f43067643dd80ec8a2f5fb370c1) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.086527 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "56250a60d7104f22bd4b2206f3a5df14" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.130240 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 10506b2cb6c5468daa6ef270b6ed2d4d (table default.Table_4ea0a3f1ee0b486cb0ffffffdbcb8346 [id=62eeb40941e44946a64d1067d3d44dc7]) successfully deleted
I20250625 14:01:57.130297 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 882da47c1f5a496f8df2ba2d3501b453 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c8c667108694caab967bd91f74759b6) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.089875 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "56250a60d7104f22bd4b2206f3a5df14" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.092552 12167 tablet_bootstrap.cc:492] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.130470 12167 ts_tablet_manager.cc:1397] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.000s
I20250625 14:01:57.130636 12054 raft_consensus.cc:2466] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:57.130970 12167 raft_consensus.cc:357] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.131067 12167 raft_consensus.cc:383] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.131099 12167 raft_consensus.cc:738] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.131220 12167 consensus_queue.cc:260] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.131490 12167 ts_tablet_manager.cc:1428] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.131641 12167 tablet_bootstrap.cc:492] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.131963 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b5bb34897dbe408eb18a7210d5178009"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.132328 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5bb34897dbe408eb18a7210d5178009 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.132743 12167 tablet_bootstrap.cc:654] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.133561 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_049d9acf2b4942958531ca1b61d7cde6" } modify_external_catalogs: true
I20250625 14:01:57.133654 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_049d9acf2b4942958531ca1b61d7cde6" } modify_external_catalogs: true
I20250625 14:01:57.134557 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_195a649075684f668a243215a37a93e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.134964 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_195a649075684f668a243215a37a93e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.135944 12172 raft_consensus.cc:357] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.136058 12172 raft_consensus.cc:383] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.136091 12172 raft_consensus.cc:738] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.136224 12172 consensus_queue.cc:260] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.136427 12208 raft_consensus.cc:2802] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.136535 12208 raft_consensus.cc:695] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:57.136618 12177 raft_consensus.cc:2270] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.136672 12208 consensus_queue.cc:237] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.137229 12177 ts_tablet_manager.cc:1905] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:57.137883 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 35ece361f92a4c9a9df5ad3355f87db9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ece361f92a4c9a9df5ad3355f87db9 already in progress: creating tablet
W20250625 14:01:57.138377 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 21908df7bb384e9782b97abe6f06b0f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21908df7bb384e9782b97abe6f06b0f5 already in progress: creating tablet
I20250625 14:01:57.139055 11858 leader_election.cc:304] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.139300 12265 raft_consensus.cc:2802] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.139395 12265 raft_consensus.cc:695] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:57.139528 12265 consensus_queue.cc:237] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.139760 12177 ts_tablet_manager.cc:1918] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.139827 12177 log.cc:1199] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/5872bfb53bd04ac79d02f8d87a4ea090
I20250625 14:01:57.140026 12855 raft_consensus.cc:491] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.140125 12855 raft_consensus.cc:513] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.136543 12172 ts_tablet_manager.cc:1428] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.034s user 0.001s sys 0.000s
I20250625 14:01:57.140458 12855 leader_election.cc:290] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.140563 12172 tablet_bootstrap.cc:492] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.140041 12177 ts_tablet_manager.cc:1939] T 5872bfb53bd04ac79d02f8d87a4ea090 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.141594 12172 tablet_bootstrap.cc:654] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.141685 12177 tablet_replica.cc:331] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.141816 12177 raft_consensus.cc:2241] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.141906 12177 raft_consensus.cc:2270] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.142467 12800 raft_consensus.cc:491] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.142582 12800 raft_consensus.cc:513] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:57.142856 11717 leader_election.cc:343] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.142982 12800 leader_election.cc:290] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:57.143376 11717 leader_election.cc:343] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.143451 11717 leader_election.cc:304] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:57.143486 12177 ts_tablet_manager.cc:1905] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:57.143643 11990 leader_election.cc:343] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 8fee92d68eaa4b22a7f0c122aeb5bc44
I20250625 14:01:57.143914 12175 tablet_replica.cc:331] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.144053 12175 raft_consensus.cc:2241] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.144166 12175 raft_consensus.cc:2270] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.144613 12894 raft_consensus.cc:2747] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:57.144871 11717 leader_election.cc:343] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.145463 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "882da47c1f5a496f8df2ba2d3501b453" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.145608 11782 raft_consensus.cc:2391] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:57.145895 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "56250a60d7104f22bd4b2206f3a5df14" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.146042 11782 raft_consensus.cc:2391] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
W20250625 14:01:57.146571 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7c68ae7ecff34d34baaffe47c740bac6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c68ae7ecff34d34baaffe47c740bac6 already in progress: creating tablet
W20250625 14:01:57.146742 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet cc9e2afd5bc443398293d0ed572f6c05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc9e2afd5bc443398293d0ed572f6c05 already in progress: creating tablet
W20250625 14:01:57.146874 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet e15bd70671f8458db5b9e52423189eda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e15bd70671f8458db5b9e52423189eda already in progress: creating tablet
I20250625 14:01:57.146996 12175 ts_tablet_manager.cc:1905] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.147444 12800 raft_consensus.cc:491] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.147549 12800 raft_consensus.cc:513] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.147957 12800 leader_election.cc:290] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.148656 12177 ts_tablet_manager.cc:1918] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.148739 12177 log.cc:1199] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f6116f7e64ae4e19863629a0e88a7265
I20250625 14:01:57.148967 12177 ts_tablet_manager.cc:1939] T f6116f7e64ae4e19863629a0e88a7265 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.149535 12177 tablet_replica.cc:331] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.149686 12177 raft_consensus.cc:2241] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.149859 12177 raft_consensus.cc:2270] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.150233 12177 ts_tablet_manager.cc:1905] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.150725 11993 leader_election.cc:304] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.150878 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8615e96c59474da5ae6214402aba4a46" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.151008 12800 raft_consensus.cc:3058] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.152166 12800 raft_consensus.cc:2747] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.152204 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8615e96c59474da5ae6214402aba4a46" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.152305 12173 tablet_replica.cc:331] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.152439 12173 raft_consensus.cc:2241] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.152570 12173 raft_consensus.cc:2270] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.152998 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_95a3171b6e53412880ef07bf3291f0bb" } new_table_name: "default.Table_06d43b44b02e415d81733ddc00e3d18b" modify_external_catalogs: true
I20250625 14:01:57.153133 12173 ts_tablet_manager.cc:1905] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.154172 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_06a503f6355b478caf948985a84c15f6" } new_table_name: "default.Table_94bdbb1851e54749bf15e9804ea45471" modify_external_catalogs: true
W20250625 14:01:57.154234 11990 leader_election.cc:343] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 1f5c017990c54099b1cdbddc75a12e10
I20250625 14:01:57.155475 12173 ts_tablet_manager.cc:1918] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.155556 12173 log.cc:1199] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/96984bb93836413a85f112f7d162598f
I20250625 14:01:57.155778 12173 ts_tablet_manager.cc:1939] T 96984bb93836413a85f112f7d162598f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.156422 12173 tablet_replica.cc:331] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.156550 12173 raft_consensus.cc:2241] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.156548 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 96984bb93836413a85f112f7d162598f (table default.Table_d6d78f7d158248f6a25dc311131eed4d [id=ffe2f2ab5919440396e245783c966fd3]) successfully deleted
I20250625 14:01:57.156648 12173 raft_consensus.cc:2270] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.157284 11993 leader_election.cc:304] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.157310 12177 ts_tablet_manager.cc:1918] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.157390 12177 log.cc:1199] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/882da47c1f5a496f8df2ba2d3501b453
I20250625 14:01:57.157557 12800 raft_consensus.cc:3058] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.157598 12177 ts_tablet_manager.cc:1939] T 882da47c1f5a496f8df2ba2d3501b453 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.158545 12800 raft_consensus.cc:2747] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.158773 12167 tablet_bootstrap.cc:492] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.158869 12167 ts_tablet_manager.cc:1397] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.000s
I20250625 14:01:57.159354 12167 raft_consensus.cc:357] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.159482 12167 raft_consensus.cc:383] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.159516 12167 raft_consensus.cc:738] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.159634 12167 consensus_queue.cc:260] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.159910 12167 ts_tablet_manager.cc:1428] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.160121 12167 tablet_bootstrap.cc:492] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.160354 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 5872bfb53bd04ac79d02f8d87a4ea090 (table default.Table_9aa153abf09346f4a92998fa6a4c1cb0 [id=f7e3bef19fc644cf89f008469f969c03]) successfully deleted
I20250625 14:01:57.160682 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_10a18d192fee4f6092695ec20f30a5ae" } new_table_name: "default.Table_6d4b84f13d9e48689d2869134361da04" modify_external_catalogs: true
I20250625 14:01:57.161219 12167 tablet_bootstrap.cc:654] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.161798 11717 leader_election.cc:343] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:57.161927 11717 leader_election.cc:343] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.161984 11717 leader_election.cc:304] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:57.162107 12894 raft_consensus.cc:2747] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:57.158864 11993 leader_election.cc:343] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 704ecf1ea8dd423ead2a0d1be113c03d
I20250625 14:01:57.162205 11993 leader_election.cc:304] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.162444 12666 raft_consensus.cc:2747] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:57.162465 11993 leader_election.cc:343] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 8fee92d68eaa4b22a7f0c122aeb5bc44
I20250625 14:01:57.162528 11993 leader_election.cc:304] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.162638 12666 raft_consensus.cc:2747] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:57.162726 11993 leader_election.cc:343] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 1f5c017990c54099b1cdbddc75a12e10
I20250625 14:01:57.162781 11993 leader_election.cc:304] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:01:57.162843 11993 raft_consensus.cc:2684] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:57.163372 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bd047e00bc2045538f5a1a59bb15519f" } modify_external_catalogs: true
I20250625 14:01:57.163452 12054 raft_consensus.cc:3058] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.163488 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bd047e00bc2045538f5a1a59bb15519f" } modify_external_catalogs: true
I20250625 14:01:57.163539 12173 ts_tablet_manager.cc:1905] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.164214 12175 ts_tablet_manager.cc:1918] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.164300 12175 log.cc:1199] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/fc948c61d54a4618856b64a12a32b2c4
I20250625 14:01:57.164531 12175 ts_tablet_manager.cc:1939] T fc948c61d54a4618856b64a12a32b2c4 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.165235 12167 tablet_bootstrap.cc:492] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.165315 12167 ts_tablet_manager.cc:1397] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:01:57.165314 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
I20250625 14:01:57.165804 12167 raft_consensus.cc:357] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.165917 12167 raft_consensus.cc:383] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.165966 12167 raft_consensus.cc:738] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.166085 12167 consensus_queue.cc:260] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.166143 12861 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:01:57.166229 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet d3cf1f09ba14436cbdce5a58da0f202d from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.166385 12167 ts_tablet_manager.cc:1428] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.166543 12167 tablet_bootstrap.cc:492] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.167532 12167 tablet_bootstrap.cc:654] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.167546 11899 tablet_service.cc:1468] Processing CreateTablet for tablet ccf9474414824e6c84c2e81c52bb802a (DEFAULT_TABLE table=default.Table_14d8a31a1e8b4fa5a08673620892fc67 [id=a82f666dac0f4e8d829c04a3f68f18a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.167858 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf9474414824e6c84c2e81c52bb802a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.168727 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]). Expected version 1 got 0
I20250625 14:01:57.169196 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]). Expected version 1 got 0
I20250625 14:01:57.169948 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 8615e96c59474da5ae6214402aba4a46 (table default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]). Expected version 1 got 0
I20250625 14:01:57.170094 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 54f0be19f9134fa3a88ae867b108c7e8 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:01:57.170193 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:57.170362 11526 catalog_manager.cc:5582] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.170471 12173 ts_tablet_manager.cc:1918] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.170567 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 96ec205b0f31484a91054fedf619b9ab (table default.Table_6c025a609dc74d37a082a5050f756463 [id=62132df62b3a42fb9886592b9b885d31]). Expected version 1 got 0
I20250625 14:01:57.170678 12173 log.cc:1199] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/1f5c017990c54099b1cdbddc75a12e10
I20250625 14:01:57.170935 12173 ts_tablet_manager.cc:1939] T 1f5c017990c54099b1cdbddc75a12e10 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.171447 12026 tablet_service.cc:1468] Processing CreateTablet for tablet ccf9474414824e6c84c2e81c52bb802a (DEFAULT_TABLE table=default.Table_14d8a31a1e8b4fa5a08673620892fc67 [id=a82f666dac0f4e8d829c04a3f68f18a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.171751 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf9474414824e6c84c2e81c52bb802a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.171810 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 1f5c017990c54099b1cdbddc75a12e10 (table default.Table_c99e790aef874f6c8875c93bd8df8256 [id=b1f7726fb4e44a9992a4ef7a1afb339d]) successfully deleted
I20250625 14:01:57.171913 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 1d596792632e4e32be161450f46b4168 (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.172024 12173 tablet_replica.cc:331] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.172158 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d596792632e4e32be161450f46b4168. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.172153 12173 raft_consensus.cc:2241] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:57.172339 12173 raft_consensus.cc:2270] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.172713 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f6116f7e64ae4e19863629a0e88a7265 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]) successfully deleted
I20250625 14:01:57.172748 12173 ts_tablet_manager.cc:1905] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.172842 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]) successfully deleted
I20250625 14:01:57.175598 12173 ts_tablet_manager.cc:1918] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:57.175732 12173 log.cc:1199] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/09a197bdabd24d7c96febe1fd5352a14
I20250625 14:01:57.175851 11899 tablet_service.cc:1468] Processing CreateTablet for tablet a05b09a3225f45db841978b7b9b1fe51 (DEFAULT_TABLE table=default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.176118 12173 ts_tablet_manager.cc:1939] T 09a197bdabd24d7c96febe1fd5352a14 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.176167 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05b09a3225f45db841978b7b9b1fe51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.176827 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 09a197bdabd24d7c96febe1fd5352a14 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]) successfully deleted
I20250625 14:01:57.177086 12173 tablet_replica.cc:331] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.177268 12173 raft_consensus.cc:2241] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.177222 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_06e8bc49777a442bbce90e7f4312b059"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.177433 12173 raft_consensus.cc:2270] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:57.177608 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06e8bc49777a442bbce90e7f4312b059 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.177891 12173 ts_tablet_manager.cc:1905] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.177866 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 1d596792632e4e32be161450f46b4168 (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.178097 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d596792632e4e32be161450f46b4168. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.178953 12034 tablet_service.cc:1468] Processing CreateTablet for tablet a05b09a3225f45db841978b7b9b1fe51 (DEFAULT_TABLE table=default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.179206 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05b09a3225f45db841978b7b9b1fe51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.180532 12173 ts_tablet_manager.cc:1918] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.180589 12173 log.cc:1199] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/704ecf1ea8dd423ead2a0d1be113c03d
I20250625 14:01:57.180783 12173 ts_tablet_manager.cc:1939] T 704ecf1ea8dd423ead2a0d1be113c03d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.182103 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 704ecf1ea8dd423ead2a0d1be113c03d (table default.Table_009dda51059342099345e5463b33f6f5 [id=5344fd676e7a42d8b33297cda611d5bc]) successfully deleted
I20250625 14:01:57.182404 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771] alter complete (version 1)
I20250625 14:01:57.182937 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b0ebdaac5dcb4ca0abae0f22dd521551" } modify_external_catalogs: true
I20250625 14:01:57.183048 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b0ebdaac5dcb4ca0abae0f22dd521551" } modify_external_catalogs: true
I20250625 14:01:57.183173 12800 raft_consensus.cc:491] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.183269 12800 raft_consensus.cc:513] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.183586 12800 leader_election.cc:290] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.183187 12167 tablet_bootstrap.cc:492] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.183815 12167 ts_tablet_manager.cc:1397] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
W20250625 14:01:57.183974 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef consensus state has no leader
I20250625 14:01:57.184293 12167 raft_consensus.cc:357] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.184389 12167 raft_consensus.cc:383] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.184417 12167 raft_consensus.cc:738] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.184533 12167 consensus_queue.cc:260] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.185633 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1dc5b8ea4f3b47f19c603c235fa79007
W20250625 14:01:57.186205 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e56586f5cd745a397bf6ed1a63d070e consensus state has no leader
W20250625 14:01:57.186405 11990 leader_election.cc:343] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: fc948c61d54a4618856b64a12a32b2c4
I20250625 14:01:57.186661 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.186823 12167 ts_tablet_manager.cc:1428] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:57.186820 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.187034 12167 tablet_bootstrap.cc:492] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.187201 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 with delete_type TABLET_DATA_DELETED (replaced by tablet e98a2085fe67479db141b2675f69a2d9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.188079 12167 tablet_bootstrap.cc:654] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.188436 11899 tablet_service.cc:1468] Processing CreateTablet for tablet fee20f2812d34d188b7181e6da00f823 (DEFAULT_TABLE table=default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.188766 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee20f2812d34d188b7181e6da00f823. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.189944 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 2e5c492cb21c45f391aa20780f680d5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e5c492cb21c45f391aa20780f680d5f already in progress: creating tablet
I20250625 14:01:57.190176 12173 tablet_replica.cc:331] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.190645 12173 raft_consensus.cc:2241] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.190737 12034 tablet_service.cc:1468] Processing CreateTablet for tablet fee20f2812d34d188b7181e6da00f823 (DEFAULT_TABLE table=default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.190908 12173 raft_consensus.cc:2270] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.191008 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee20f2812d34d188b7181e6da00f823. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.191886 12173 ts_tablet_manager.cc:1905] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.194412 12173 ts_tablet_manager.cc:1918] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.194572 12173 log.cc:1199] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/5bba2990cca6441fb954b2f30f561708
I20250625 14:01:57.194839 12173 ts_tablet_manager.cc:1939] T 5bba2990cca6441fb954b2f30f561708 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.195638 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 5bba2990cca6441fb954b2f30f561708 (table default.Table_b77e6933073d4d4eb6a1a937e5d0347e [id=c6107f84da2747c4a52af70fe104579d]) successfully deleted
I20250625 14:01:57.195938 12173 tablet_replica.cc:331] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.196122 12173 raft_consensus.cc:2241] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.196290 12173 raft_consensus.cc:2270] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.196779 12173 ts_tablet_manager.cc:1905] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.199141 12173 ts_tablet_manager.cc:1918] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.199141 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b97c5c63a8184f07ad6e8054d056ff58
I20250625 14:01:57.199298 12173 log.cc:1199] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e307709d217643358c7c3efb3dd73747
I20250625 14:01:57.199705 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d3cf1f09ba14436cbdce5a58da0f202d
I20250625 14:01:57.199947 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.200016 11532 catalog_manager.cc:6652] ReplaceTablet: tablet d3cf1f09ba14436cbdce5a58da0f202d deleted and replaced by tablet 714bb5a28ec648f990fa1525a1b50129
I20250625 14:01:57.200466 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d with delete_type TABLET_DATA_DELETED (replaced by tablet 714bb5a28ec648f990fa1525a1b50129) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.200208 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.200292 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d with delete_type TABLET_DATA_DELETED (replaced by tablet 714bb5a28ec648f990fa1525a1b50129) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:57.200840 11526 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 54f0be19f9134fa3a88ae867b108c7e8 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 54f0be19f9134fa3a88ae867b108c7e8 consensus state has no leader
I20250625 14:01:57.201017 12173 ts_tablet_manager.cc:1939] T e307709d217643358c7c3efb3dd73747 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.201385 12166 tablet_bootstrap.cc:492] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.201483 12166 ts_tablet_manager.cc:1397] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.105s user 0.000s sys 0.001s
I20250625 14:01:57.202003 12166 raft_consensus.cc:357] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.202117 12166 raft_consensus.cc:383] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.202158 12166 raft_consensus.cc:738] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:57.202252 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 already in progress: creating tablet
I20250625 14:01:57.202280 12166 consensus_queue.cc:260] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.202605 12166 ts_tablet_manager.cc:1428] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:57.202792 12166 tablet_bootstrap.cc:492] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:57.202819 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 097b49d0283541478241e6c699504174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 097b49d0283541478241e6c699504174 already in progress: creating tablet
W20250625 14:01:57.203742 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 87974ef08b3b4cc299ae643c0cb5d694 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87974ef08b3b4cc299ae643c0cb5d694 already in progress: creating tablet
I20250625 14:01:57.204053 12166 tablet_bootstrap.cc:654] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.204104 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7c68ae7ecff34d34baaffe47c740bac6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c68ae7ecff34d34baaffe47c740bac6 already in progress: creating tablet
W20250625 14:01:57.204437 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet cc9e2afd5bc443398293d0ed572f6c05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc9e2afd5bc443398293d0ed572f6c05 already in progress: creating tablet
W20250625 14:01:57.204782 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet e15bd70671f8458db5b9e52423189eda because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e15bd70671f8458db5b9e52423189eda already in progress: creating tablet
I20250625 14:01:57.205403 12173 tablet_replica.cc:331] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.205688 12173 raft_consensus.cc:2241] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.205657 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 67002721ac274619b435e8bf16fc149a (DEFAULT_TABLE table=default.Table_f41c7ed5d5c64d7196b15168dc43ccab [id=41cea1d0aade416ca6b75cbb14127245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.205859 12173 raft_consensus.cc:2270] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.205946 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67002721ac274619b435e8bf16fc149a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.206485 12173 ts_tablet_manager.cc:1905] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.207003 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_94bdbb1851e54749bf15e9804ea45471 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 4 got 3
I20250625 14:01:57.208508 12558 raft_consensus.cc:491] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.208626 12558 raft_consensus.cc:513] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.208667 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:57.208791 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]). Expected version 1 got 0
I20250625 14:01:57.208915 11526 catalog_manager.cc:5582] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.209045 12558 leader_election.cc:290] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.209065 12173 ts_tablet_manager.cc:1918] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.209259 12173 log.cc:1199] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/fc948c61d54a4618856b64a12a32b2c4
I20250625 14:01:57.209532 12173 ts_tablet_manager.cc:1939] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.210078 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
I20250625 14:01:57.210088 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7cc7e962e4b146bc88a06fde969eb99d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:57.210484 11855 leader_election.cc:343] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:57.210763 11858 leader_election.cc:343] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 7cc7e962e4b146bc88a06fde969eb99d
I20250625 14:01:57.210840 11858 leader_election.cc:304] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.211203 12558 raft_consensus.cc:2747] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:57.211236 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 043622be53ec4198b6c9b25a0404c0d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 043622be53ec4198b6c9b25a0404c0d2 already in progress: creating tablet
I20250625 14:01:57.211902 12173 tablet_replica.cc:331] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.212083 12173 raft_consensus.cc:2241] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.212221 12173 raft_consensus.cc:2270] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.212998 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_94bdbb1851e54749bf15e9804ea45471 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 4 got 3
I20250625 14:01:57.213160 12173 ts_tablet_manager.cc:1905] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.213125 11529 catalog_manager.cc:5582] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:57.213318 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 56250a60d7104f22bd4b2206f3a5df14 (table default.Table_892620871def4b818f36f2c0b4f1cbed [id=e1d9126672684e808d499d3902fc371b]). Expected version 1 got 0
I20250625 14:01:57.214550 12026 tablet_service.cc:1468] Processing CreateTablet for tablet fa2ccf77288144e5b81513dede9d4302 (DEFAULT_TABLE table=default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.214825 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2ccf77288144e5b81513dede9d4302. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.215683 12173 ts_tablet_manager.cc:1918] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.215803 12173 log.cc:1199] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/882da47c1f5a496f8df2ba2d3501b453
I20250625 14:01:57.216094 12173 ts_tablet_manager.cc:1939] T 882da47c1f5a496f8df2ba2d3501b453 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.216792 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]) successfully deleted
I20250625 14:01:57.216954 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 72efc3ed21e3404eb0a0ba4326513601 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:57.217404 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1dc5b8ea4f3b47f19c603c235fa79007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dc5b8ea4f3b47f19c603c235fa79007 already in progress: creating tablet
I20250625 14:01:57.217607 12173 tablet_replica.cc:331] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.217772 12173 raft_consensus.cc:2241] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.217907 12173 raft_consensus.cc:2270] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.218501 12173 ts_tablet_manager.cc:1905] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.218895 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5a6cb21f6391471fad9ad3a56e283930" } modify_external_catalogs: true
I20250625 14:01:57.219070 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5a6cb21f6391471fad9ad3a56e283930" } modify_external_catalogs: true
I20250625 14:01:57.220167 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 67002721ac274619b435e8bf16fc149a (DEFAULT_TABLE table=default.Table_f41c7ed5d5c64d7196b15168dc43ccab [id=41cea1d0aade416ca6b75cbb14127245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.220463 12173 ts_tablet_manager.cc:1918] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.220598 12173 log.cc:1199] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8fee92d68eaa4b22a7f0c122aeb5bc44
I20250625 14:01:57.220846 12173 ts_tablet_manager.cc:1939] T 8fee92d68eaa4b22a7f0c122aeb5bc44 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.221545 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8fee92d68eaa4b22a7f0c122aeb5bc44 (table default.Table_12a1e16f6b284bbca04f3f1c10950265 [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
W20250625 14:01:57.222023 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d3cf1f09ba14436cbdce5a58da0f202d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3cf1f09ba14436cbdce5a58da0f202d already in progress: creating tablet
W20250625 14:01:57.222489 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b97c5c63a8184f07ad6e8054d056ff58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b97c5c63a8184f07ad6e8054d056ff58 already in progress: creating tablet
I20250625 14:01:57.222855 12173 tablet_replica.cc:331] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.220474 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67002721ac274619b435e8bf16fc149a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.223031 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet c751d05cac1d4d65965e0aca2a94c14a from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.223021 12173 raft_consensus.cc:2241] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.223249 12173 raft_consensus.cc:2270] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.223714 12173 ts_tablet_manager.cc:1905] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.224416 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a3faac0915c648f7add30508a11e4224" } new_table_name: "default.Table_b28f9c1348994d7da3bacbb75fa2fffa" modify_external_catalogs: true
I20250625 14:01:57.225356 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet d3cf1f09ba14436cbdce5a58da0f202d from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.226140 12173 ts_tablet_manager.cc:1918] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.226219 12173 log.cc:1199] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/72efc3ed21e3404eb0a0ba4326513601
I20250625 14:01:57.226621 12173 ts_tablet_manager.cc:1939] T 72efc3ed21e3404eb0a0ba4326513601 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.227283 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 72efc3ed21e3404eb0a0ba4326513601 (table default.Table_03ca42d86d7d454699eea52f84b29ffb [id=e32fff7acb81496caed3c543cbb849fd]) successfully deleted
I20250625 14:01:57.228384 12172 tablet_bootstrap.cc:492] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.228485 12172 ts_tablet_manager.cc:1397] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.088s user 0.001s sys 0.000s
I20250625 14:01:57.228941 12172 raft_consensus.cc:357] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.229050 12172 raft_consensus.cc:383] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.229082 12172 raft_consensus.cc:738] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.229188 12172 consensus_queue.cc:260] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.229440 12172 ts_tablet_manager.cc:1428] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.229643 12172 tablet_bootstrap.cc:492] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.229871 11762 tablet_service.cc:1468] Processing CreateTablet for tablet ccf9474414824e6c84c2e81c52bb802a (DEFAULT_TABLE table=default.Table_14d8a31a1e8b4fa5a08673620892fc67 [id=a82f666dac0f4e8d829c04a3f68f18a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.230159 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf9474414824e6c84c2e81c52bb802a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.230588 12172 tablet_bootstrap.cc:654] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.232797 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 1d596792632e4e32be161450f46b4168 (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.233438 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d with delete_type TABLET_DATA_DELETED (replaced by tablet 714bb5a28ec648f990fa1525a1b50129) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.233459 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 67002721ac274619b435e8bf16fc149a (DEFAULT_TABLE table=default.Table_f41c7ed5d5c64d7196b15168dc43ccab [id=41cea1d0aade416ca6b75cbb14127245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.233680 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67002721ac274619b435e8bf16fc149a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.233721 11754 tablet_service.cc:1468] Processing CreateTablet for tablet fee20f2812d34d188b7181e6da00f823 (DEFAULT_TABLE table=default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.233922 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee20f2812d34d188b7181e6da00f823. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.236248 11993 leader_election.cc:343] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: fc948c61d54a4618856b64a12a32b2c4
I20250625 14:01:57.236338 11993 leader_election.cc:304] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:01:57.236433 11993 raft_consensus.cc:2684] T fc948c61d54a4618856b64a12a32b2c4 P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:57.236832 11754 tablet_service.cc:1468] Processing CreateTablet for tablet fa2ccf77288144e5b81513dede9d4302 (DEFAULT_TABLE table=default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.237082 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2ccf77288144e5b81513dede9d4302. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.237067 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.237211 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.232836 11764 tablet_service.cc:1468] Processing CreateTablet for tablet a05b09a3225f45db841978b7b9b1fe51 (DEFAULT_TABLE table=default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.237588 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05b09a3225f45db841978b7b9b1fe51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.237833 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b
I20250625 14:01:57.238786 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.238991 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.240655 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:57.240775 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b already in progress: creating tablet
I20250625 14:01:57.243131 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a25ceea16cbb4e339c2ebcc580c47270 (table default.Table_d6d78f7d158248f6a25dc311131eed4d [id=ffe2f2ab5919440396e245783c966fd3]). Expected version 1 got 0
I20250625 14:01:57.243321 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_94bdbb1851e54749bf15e9804ea45471 [id=d60959d1e4b14c1d820f04d9bfedfe11]). Expected version 4 got 3
W20250625 14:01:57.244189 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d3cf1f09ba14436cbdce5a58da0f202d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3cf1f09ba14436cbdce5a58da0f202d already in progress: creating tablet
W20250625 14:01:57.244355 11520 catalog_manager.cc:5001] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): alter failed for tablet fc948c61d54a4618856b64a12a32b2c4 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]),no further retry: Not found: Tablet not found: fc948c61d54a4618856b64a12a32b2c4
W20250625 14:01:57.244585 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1dc5b8ea4f3b47f19c603c235fa79007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dc5b8ea4f3b47f19c603c235fa79007 already in progress: creating tablet
W20250625 14:01:57.244917 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b97c5c63a8184f07ad6e8054d056ff58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b97c5c63a8184f07ad6e8054d056ff58 already in progress: creating tablet
I20250625 14:01:57.246146 12172 tablet_bootstrap.cc:492] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.246237 12172 ts_tablet_manager.cc:1397] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:57.247011 12172 raft_consensus.cc:357] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.247148 12172 raft_consensus.cc:383] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.247189 12172 raft_consensus.cc:738] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.247326 12172 consensus_queue.cc:260] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.247685 12172 ts_tablet_manager.cc:1428] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:57.247972 12172 tablet_bootstrap.cc:492] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:57.248406 11858 consensus_peers.cc:487] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 882da47c1f5a496f8df2ba2d3501b453. This is attempt 1: this message will repeat every 5th retry.
W20250625 14:01:57.248739 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 043622be53ec4198b6c9b25a0404c0d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 043622be53ec4198b6c9b25a0404c0d2 already in progress: creating tablet
I20250625 14:01:57.248968 12175 tablet_replica.cc:331] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.249114 12175 raft_consensus.cc:2241] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:57.246274 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d596792632e4e32be161450f46b4168. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.249478 12175 pending_rounds.cc:70] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:57.249529 12175 pending_rounds.cc:77] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523037952802816 op_type: NO_OP noop_request { }
I20250625 14:01:57.249596 12175 raft_consensus.cc:2887] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:57.249656 12175 raft_consensus.cc:2270] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.249984 11899 tablet_service.cc:1468] Processing CreateTablet for tablet fa2ccf77288144e5b81513dede9d4302 (DEFAULT_TABLE table=default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.250293 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2ccf77288144e5b81513dede9d4302. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.251600 12172 tablet_bootstrap.cc:654] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.252195 12175 ts_tablet_manager.cc:1905] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.253914 12167 tablet_bootstrap.cc:492] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.254027 12167 ts_tablet_manager.cc:1397] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.000s
I20250625 14:01:57.254590 12167 raft_consensus.cc:357] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.254724 12167 raft_consensus.cc:383] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.254767 12167 raft_consensus.cc:738] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.254917 12167 consensus_queue.cc:260] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.255239 12167 ts_tablet_manager.cc:1428] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.255295 12166 tablet_bootstrap.cc:492] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.255388 12166 ts_tablet_manager.cc:1397] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20250625 14:01:57.255470 12167 tablet_bootstrap.cc:492] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.255847 12166 raft_consensus.cc:357] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.255975 12166 raft_consensus.cc:383] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.256022 12166 raft_consensus.cc:738] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.256165 12166 consensus_queue.cc:260] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.256476 12166 ts_tablet_manager.cc:1428] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.256709 12166 tablet_bootstrap.cc:492] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.260079 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f4b53c4642624cbfa6a08f50289641f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.260555 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4b53c4642624cbfa6a08f50289641f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.261085 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5489ee768c384fc0a1c8b6bed25b3a26 consensus state has no leader
I20250625 14:01:57.261673 12166 tablet_bootstrap.cc:654] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.263448 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a05b09a3225f45db841978b7b9b1fe51
I20250625 14:01:57.263548 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet f6116f7e64ae4e19863629a0e88a7265 with delete_type TABLET_DATA_DELETED (replaced by tablet 21f88f43067643dd80ec8a2f5fb370c1) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.263918 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c751d05cac1d4d65965e0aca2a94c14a
I20250625 14:01:57.263999 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet a05b09a3225f45db841978b7b9b1fe51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.264200 11530 catalog_manager.cc:6652] ReplaceTablet: tablet c751d05cac1d4d65965e0aca2a94c14a deleted and replaced by tablet 288e0c1644a34b8dabc06ccdda9f0fa9
I20250625 14:01:57.256565 12167 tablet_bootstrap.cc:654] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.264422 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet c751d05cac1d4d65965e0aca2a94c14a with delete_type TABLET_DATA_DELETED (replaced by tablet 288e0c1644a34b8dabc06ccdda9f0fa9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.265946 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet a05b09a3225f45db841978b7b9b1fe51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.266111 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet c751d05cac1d4d65965e0aca2a94c14a with delete_type TABLET_DATA_DELETED (replaced by tablet 288e0c1644a34b8dabc06ccdda9f0fa9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.266206 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 097b49d0283541478241e6c699504174 with delete_type TABLET_DATA_DELETED (replaced by tablet fa2ccf77288144e5b81513dede9d4302) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.266347 12173 tablet_replica.cc:331] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:01:57.266405 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a05b09a3225f45db841978b7b9b1fe51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a05b09a3225f45db841978b7b9b1fe51 already in progress: creating tablet
I20250625 14:01:57.266477 12173 raft_consensus.cc:2241] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.266587 12173 raft_consensus.cc:2270] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:57.266575 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c751d05cac1d4d65965e0aca2a94c14a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c751d05cac1d4d65965e0aca2a94c14a already in progress: creating tablet
I20250625 14:01:57.267789 12233 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:57.268208 12800 raft_consensus.cc:491] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.268296 12800 raft_consensus.cc:513] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.268625 12800 leader_election.cc:290] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.272078 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "baf41b19a5ba4eddb65d31567b375eaa" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.272241 11919 raft_consensus.cc:2391] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:57.276842 12173 ts_tablet_manager.cc:1905] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.277191 12861 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:57.277793 12800 raft_consensus.cc:491] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.277889 12800 raft_consensus.cc:513] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.278295 12800 leader_election.cc:290] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.278818 12953 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:57.279479 12173 ts_tablet_manager.cc:1918] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.279541 12173 log.cc:1199] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/097b49d0283541478241e6c699504174
I20250625 14:01:57.279738 12173 ts_tablet_manager.cc:1939] T 097b49d0283541478241e6c699504174 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.280604 12166 tablet_bootstrap.cc:492] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.280685 12166 ts_tablet_manager.cc:1397] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20250625 14:01:57.281194 12166 raft_consensus.cc:357] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.281301 12166 raft_consensus.cc:383] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.281335 12166 raft_consensus.cc:738] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.282071 12166 consensus_queue.cc:260] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.282948 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 097b49d0283541478241e6c699504174 (table default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]) successfully deleted
I20250625 14:01:57.273926 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.283298 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e3af8a01ca1f49afb8aa1834807abf7e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.274042 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet c751d05cac1d4d65965e0aca2a94c14a with delete_type TABLET_DATA_DELETED (replaced by tablet 288e0c1644a34b8dabc06ccdda9f0fa9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.274114 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet a05b09a3225f45db841978b7b9b1fe51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.274179 12855 consensus_queue.cc:1035] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.276687 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "baf41b19a5ba4eddb65d31567b375eaa" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.277387 12172 tablet_bootstrap.cc:492] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.284212 12172 ts_tablet_manager.cc:1397] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:01:57.284729 12172 raft_consensus.cc:357] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.284848 12172 raft_consensus.cc:383] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.284900 12172 raft_consensus.cc:738] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.285035 12172 consensus_queue.cc:260] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.285354 12172 ts_tablet_manager.cc:1428] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.285564 12172 tablet_bootstrap.cc:492] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.286432 12167 tablet_bootstrap.cc:492] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.286441 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet c2307a7c00204e8fa1a14b5112659d91 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.286532 12167 ts_tablet_manager.cc:1397] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:01:57.286693 12172 tablet_bootstrap.cc:654] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.287065 12167 raft_consensus.cc:357] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.287192 12167 raft_consensus.cc:383] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.287236 12167 raft_consensus.cc:738] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.287350 12167 consensus_queue.cc:260] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.287652 12167 ts_tablet_manager.cc:1428] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20250625 14:01:57.287778 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b already in progress: creating tablet
I20250625 14:01:57.287838 12167 tablet_bootstrap.cc:492] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:57.287959 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c751d05cac1d4d65965e0aca2a94c14a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c751d05cac1d4d65965e0aca2a94c14a already in progress: creating tablet
W20250625 14:01:57.288093 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a05b09a3225f45db841978b7b9b1fe51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a05b09a3225f45db841978b7b9b1fe51 already in progress: creating tablet
I20250625 14:01:57.288223 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_99e3b9f63eb947ed8424df6c7a25de5e" } modify_external_catalogs: true
I20250625 14:01:57.288343 11993 leader_election.cc:304] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.288357 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_99e3b9f63eb947ed8424df6c7a25de5e" } modify_external_catalogs: true
I20250625 14:01:57.288547 12800 raft_consensus.cc:3058] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.288687 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6500987d0b3b4d7ea53959771641fcbf" } new_table_name: "default.Table_fc6abd07a4dc4176a7a9c81d3fb81fa4" modify_external_catalogs: true
I20250625 14:01:57.288746 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5d6003fae2534a169754d1e128e3f7fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.289140 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d6003fae2534a169754d1e128e3f7fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.289552 12800 raft_consensus.cc:2747] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.290102 12167 tablet_bootstrap.cc:654] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.292759 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_94bdbb1851e54749bf15e9804ea45471 [id=d60959d1e4b14c1d820f04d9bfedfe11] alter complete (version 4)
I20250625 14:01:57.293686 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_973b50c79f674df1b6cf16c53eb85f04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.294085 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_973b50c79f674df1b6cf16c53eb85f04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.298931 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 7541b0989fe04486be69997611bb8ca1 with delete_type TABLET_DATA_DELETED (replaced by tablet 93d666f4b403435287f4157bda971193) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.299221 12173 tablet_replica.cc:331] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.299335 12233 tablet.cc:1722] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.299383 12173 raft_consensus.cc:2241] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.299499 12173 raft_consensus.cc:2270] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.299243 12175 ts_tablet_manager.cc:1918] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:57.300012 12173 ts_tablet_manager.cc:1905] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.304384 12173 ts_tablet_manager.cc:1918] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.304551 12173 log.cc:1199] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7541b0989fe04486be69997611bb8ca1
I20250625 14:01:57.304919 12173 ts_tablet_manager.cc:1939] T 7541b0989fe04486be69997611bb8ca1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:01:57.305812 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 94232e8e88e84350b5f150a6eb433c92 consensus state has no leader
I20250625 14:01:57.305895 12175 log.cc:1199] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/882da47c1f5a496f8df2ba2d3501b453
I20250625 14:01:57.306195 12175 ts_tablet_manager.cc:1939] T 882da47c1f5a496f8df2ba2d3501b453 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.306476 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7541b0989fe04486be69997611bb8ca1 (table default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee [id=27af5f3cf87a4e71937c303a90e3d366]) successfully deleted
I20250625 14:01:57.303992 12166 ts_tablet_manager.cc:1428] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s
I20250625 14:01:57.308912 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]) successfully deleted
I20250625 14:01:57.311220 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e3af8a01ca1f49afb8aa1834807abf7e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.311614 12166 tablet_bootstrap.cc:492] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.311759 12953 tablet.cc:1722] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:01:57.312441 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1dc5b8ea4f3b47f19c603c235fa79007 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dc5b8ea4f3b47f19c603c235fa79007 already in progress: creating tablet
I20250625 14:01:57.312721 12166 tablet_bootstrap.cc:654] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.313143 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b97c5c63a8184f07ad6e8054d056ff58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b97c5c63a8184f07ad6e8054d056ff58 already in progress: creating tablet
W20250625 14:01:57.314369 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d3cf1f09ba14436cbdce5a58da0f202d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3cf1f09ba14436cbdce5a58da0f202d already in progress: creating tablet
W20250625 14:01:57.314810 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b already in progress: creating tablet
I20250625 14:01:57.314885 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_56262f7334bf48819421af1329c18542 [id=fd301ff410ac4d2ca79e2eed57e9d9eb] alter complete (version 1)
I20250625 14:01:57.315244 12861 tablet.cc:1722] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.315414 12175 tablet_replica.cc:331] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.315559 12175 raft_consensus.cc:2241] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.315666 12175 raft_consensus.cc:2270] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.319768 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.319862 11993 leader_election.cc:304] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.319973 12177 tablet_replica.cc:331] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.320127 12177 raft_consensus.cc:2241] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.320225 12800 raft_consensus.cc:2747] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.320277 12177 raft_consensus.cc:2270] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.320742 12177 ts_tablet_manager.cc:1905] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.322829 12175 ts_tablet_manager.cc:1905] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.323073 12558 raft_consensus.cc:491] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.323192 12177 ts_tablet_manager.cc:1918] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.323175 12558 raft_consensus.cc:513] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.323257 12177 log.cc:1199] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7cd1672cf1164e469a862c5b43ec6f12
I20250625 14:01:57.323454 12177 ts_tablet_manager.cc:1939] T 7cd1672cf1164e469a862c5b43ec6f12 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.323565 12558 leader_election.cc:290] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.324096 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f6116f7e64ae4e19863629a0e88a7265" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:57.324446 11858 leader_election.cc:343] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: f6116f7e64ae4e19863629a0e88a7265
W20250625 14:01:57.324540 11855 leader_election.cc:343] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.324623 12172 tablet_bootstrap.cc:492] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.324617 11855 leader_election.cc:304] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.324714 12172 ts_tablet_manager.cc:1397] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20250625 14:01:57.325065 12558 raft_consensus.cc:2747] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.325263 12172 raft_consensus.cc:357] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.325359 12172 raft_consensus.cc:383] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.325389 12172 raft_consensus.cc:738] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.325413 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7cd1672cf1164e469a862c5b43ec6f12 (table default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]) successfully deleted
I20250625 14:01:57.325490 12172 consensus_queue.cc:260] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.325776 12172 ts_tablet_manager.cc:1428] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.325975 12172 tablet_bootstrap.cc:492] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.325992 12167 tablet_bootstrap.cc:492] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.326067 12167 ts_tablet_manager.cc:1397] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20250625 14:01:57.326862 12167 raft_consensus.cc:357] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.326964 12172 tablet_bootstrap.cc:654] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.326982 12167 raft_consensus.cc:383] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.327013 12167 raft_consensus.cc:738] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.327149 12167 consensus_queue.cc:260] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.327891 12167 ts_tablet_manager.cc:1428] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250625 14:01:57.328191 12167 tablet_bootstrap.cc:492] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.329573 12167 tablet_bootstrap.cc:654] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.330158 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet bfdb34255cb147c48a322514b7a7a19d with delete_type TABLET_DATA_DELETED (replaced by tablet cc9e2afd5bc443398293d0ed572f6c05) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.331352 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 5489ee768c384fc0a1c8b6bed25b3a26 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.331437 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet db4a9e4dfdd145bab965004ee5562e2b with delete_type TABLET_DATA_DELETED (replaced by tablet 140c1810e98741479c3754729409b46c) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.331739 12173 tablet_replica.cc:331] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.331883 12173 raft_consensus.cc:2241] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.332011 12173 raft_consensus.cc:2270] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.332425 12177 tablet_replica.cc:331] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.332530 12173 ts_tablet_manager.cc:1905] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.332566 12177 raft_consensus.cc:2241] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.332669 12177 raft_consensus.cc:2270] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.332726 12054 raft_consensus.cc:3058] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.333840 12177 ts_tablet_manager.cc:1905] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.334885 12173 ts_tablet_manager.cc:1918] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.334955 12173 log.cc:1199] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/bfdb34255cb147c48a322514b7a7a19d
I20250625 14:01:57.334913 12861 tablet.cc:1722] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:57.335179 12173 ts_tablet_manager.cc:1939] T bfdb34255cb147c48a322514b7a7a19d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.336316 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet bfdb34255cb147c48a322514b7a7a19d (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:57.338480 12177 ts_tablet_manager.cc:1918] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.338558 12177 log.cc:1199] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/db4a9e4dfdd145bab965004ee5562e2b
I20250625 14:01:57.338768 12177 ts_tablet_manager.cc:1939] T db4a9e4dfdd145bab965004ee5562e2b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.340034 12175 ts_tablet_manager.cc:1918] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.340132 12175 log.cc:1199] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7cc7e962e4b146bc88a06fde969eb99d
I20250625 14:01:57.340350 12175 ts_tablet_manager.cc:1939] T 7cc7e962e4b146bc88a06fde969eb99d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.341171 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet db4a9e4dfdd145bab965004ee5562e2b (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
I20250625 14:01:57.342007 12175 tablet_replica.cc:331] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.342033 12208 consensus_queue.cc:1035] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.342123 12166 tablet_bootstrap.cc:492] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.342197 12166 ts_tablet_manager.cc:1397] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.000s
I20250625 14:01:57.342229 12175 raft_consensus.cc:2241] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.342399 12265 raft_consensus.cc:491] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.342432 12175 raft_consensus.cc:2270] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.342492 12265 raft_consensus.cc:513] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.342828 12265 leader_election.cc:290] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.342903 12166 raft_consensus.cc:357] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.343007 12166 raft_consensus.cc:383] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.343040 12166 raft_consensus.cc:738] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.343181 12166 consensus_queue.cc:260] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.343207 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ebac6abf36f44fb93f556b59b2dd022" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.343573 12175 ts_tablet_manager.cc:1905] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.344025 12167 tablet_bootstrap.cc:492] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.344111 12167 ts_tablet_manager.cc:1397] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20250625 14:01:57.344600 12167 raft_consensus.cc:357] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.344695 12167 raft_consensus.cc:383] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.344724 12167 raft_consensus.cc:738] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.344838 12167 consensus_queue.cc:260] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.345099 12167 ts_tablet_manager.cc:1428] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.345278 12167 tablet_bootstrap.cc:492] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:57.346010 11717 consensus_peers.cc:487] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:57.341140 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7cc7e962e4b146bc88a06fde969eb99d (table default.Table_0b3cb311c8ff42a6a5488448051f33a8 [id=c8d56c06b27f4a54ae3a23126f7d04a9]) successfully deleted
I20250625 14:01:57.346480 12172 tablet_bootstrap.cc:492] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.346565 12172 ts_tablet_manager.cc:1397] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20250625 14:01:57.347031 12172 raft_consensus.cc:357] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.347160 12172 raft_consensus.cc:383] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.347177 12167 tablet_bootstrap.cc:654] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.347198 12172 raft_consensus.cc:738] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.347329 12172 consensus_queue.cc:260] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.347638 12172 ts_tablet_manager.cc:1428] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:57.348366 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ebac6abf36f44fb93f556b59b2dd022" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.348469 11782 raft_consensus.cc:2466] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:57.343654 12166 ts_tablet_manager.cc:1428] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:57.349160 12166 tablet_bootstrap.cc:492] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.350358 12166 tablet_bootstrap.cc:654] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.343762 11855 leader_election.cc:343] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.352787 11858 leader_election.cc:304] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.353125 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]). Expected version 1 got 0
I20250625 14:01:57.353240 12172 tablet_bootstrap.cc:492] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.353343 12265 raft_consensus.cc:2802] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.353397 12265 raft_consensus.cc:491] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.353435 12265 raft_consensus.cc:3058] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.354580 12265 raft_consensus.cc:513] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.354928 12265 leader_election.cc:290] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.354295 12172 tablet_bootstrap.cc:654] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.355409 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ebac6abf36f44fb93f556b59b2dd022" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.355762 11782 raft_consensus.cc:1273] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 14:01:57.356132 11855 consensus_peers.cc:487] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250625 14:01:57.356264 11855 leader_election.cc:343] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.356611 12265 consensus_queue.cc:1035] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.357074 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7ebac6abf36f44fb93f556b59b2dd022" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:57.357206 11782 raft_consensus.cc:3058] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.358289 11782 raft_consensus.cc:2466] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:57.359081 11858 leader_election.cc:304] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.359385 12265 raft_consensus.cc:2802] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.359481 12265 raft_consensus.cc:695] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:57.359618 12265 consensus_queue.cc:237] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.360543 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_af79ed183b6647f6a50aea9885a847b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.361578 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af79ed183b6647f6a50aea9885a847b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.362413 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_eea10ee786c54ea6b76157e09be2b818"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.362797 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eea10ee786c54ea6b76157e09be2b818 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.363714 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:57.365257 12861 tablet.cc:1717] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:57.366254 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_32b14f38ef524c96a29e322dea10e327"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.366688 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32b14f38ef524c96a29e322dea10e327 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.366874 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:57.367089 11530 catalog_manager.cc:5582] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:57.367345 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 54f0be19f9134fa3a88ae867b108c7e8 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:01:57.368129 12166 tablet_bootstrap.cc:492] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.368374 12166 ts_tablet_manager.cc:1397] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:01:57.368911 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9b659d9df8f54c3b9d61bd3eb73083be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.368935 12166 raft_consensus.cc:357] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.369036 12166 raft_consensus.cc:383] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.369063 12166 raft_consensus.cc:738] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.369181 12166 consensus_queue.cc:260] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:57.369297 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b659d9df8f54c3b9d61bd3eb73083be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.369604 12166 ts_tablet_manager.cc:1428] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.370563 12166 tablet_bootstrap.cc:492] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.370577 11899 tablet_service.cc:1468] Processing CreateTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 (DEFAULT_TABLE table=default.Table_06e8bc49777a442bbce90e7f4312b059 [id=336fd4d44f664c92b37b98b4f9198459]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.370869 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce1b63ad2924626972ce7a42a4fdb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.371091 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.188:43359
--webserver_interface=127.11.39.188
--webserver_port=37561
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250625 14:01:57.371989 11519 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 3e56586f5cd745a397bf6ed1a63d070e (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3e56586f5cd745a397bf6ed1a63d070e consensus state has no leader
I20250625 14:01:57.372587 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5489ee768c384fc0a1c8b6bed25b3a26
I20250625 14:01:57.372853 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 5489ee768c384fc0a1c8b6bed25b3a26 deleted and replaced by tablet 8d99e27063554845bea98bbe70eba3b9
I20250625 14:01:57.373492 12034 tablet_service.cc:1468] Processing CreateTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 (DEFAULT_TABLE table=default.Table_06e8bc49777a442bbce90e7f4312b059 [id=336fd4d44f664c92b37b98b4f9198459]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.373803 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce1b63ad2924626972ce7a42a4fdb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.373999 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d99e27063554845bea98bbe70eba3b9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.375228 12166 tablet_bootstrap.cc:654] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.375501 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ec9c0bd54e0e441186096c7e11ccc198"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.375883 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec9c0bd54e0e441186096c7e11ccc198 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.377243 11717 consensus_peers.cc:487] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:57.377478 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]). Expected version 1 got 0
W20250625 14:01:57.378419 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 5489ee768c384fc0a1c8b6bed25b3a26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5489ee768c384fc0a1c8b6bed25b3a26 already in progress: creating tablet
I20250625 14:01:57.378926 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_461a2c8f9109463899162260bcdb8f07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.379254 12953 tablet.cc:1722] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:01:57.379312 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_461a2c8f9109463899162260bcdb8f07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.382294 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d99e27063554845bea98bbe70eba3b9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.382467 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d99e27063554845bea98bbe70eba3b9) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:57.382972 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5489ee768c384fc0a1c8b6bed25b3a26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5489ee768c384fc0a1c8b6bed25b3a26 already in progress: creating tablet
I20250625 14:01:57.384436 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c2307a7c00204e8fa1a14b5112659d91
I20250625 14:01:57.384776 11532 catalog_manager.cc:6652] ReplaceTablet: tablet c2307a7c00204e8fa1a14b5112659d91 deleted and replaced by tablet 7491e070e86346b681817fb19d4608f9
I20250625 14:01:57.385948 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet c2307a7c00204e8fa1a14b5112659d91 with delete_type TABLET_DATA_DELETED (replaced by tablet 7491e070e86346b681817fb19d4608f9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.387307 12233 tablet.cc:1722] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.387995 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 801fae4d88114ff29eacde80365b84a0
I20250625 14:01:57.388839 12166 tablet_bootstrap.cc:492] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.388953 12166 ts_tablet_manager.cc:1397] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:01:57.389614 12166 raft_consensus.cc:357] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.389739 12166 raft_consensus.cc:383] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.389779 12166 raft_consensus.cc:738] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.389935 12166 consensus_queue.cc:260] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.390758 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet c2307a7c00204e8fa1a14b5112659d91 with delete_type TABLET_DATA_DELETED (replaced by tablet 7491e070e86346b681817fb19d4608f9) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:57.391532 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c2307a7c00204e8fa1a14b5112659d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2307a7c00204e8fa1a14b5112659d91 already in progress: creating tablet
I20250625 14:01:57.392549 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 801fae4d88114ff29eacde80365b84a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.392598 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]). Expected version 1 got 0
I20250625 14:01:57.390276 12166 ts_tablet_manager.cc:1428] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:57.393530 12166 tablet_bootstrap.cc:492] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:57.393585 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 801fae4d88114ff29eacde80365b84a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 801fae4d88114ff29eacde80365b84a0 already in progress: creating tablet
I20250625 14:01:57.393127 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 801fae4d88114ff29eacde80365b84a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.394541 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet c2307a7c00204e8fa1a14b5112659d91 with delete_type TABLET_DATA_DELETED (replaced by tablet 7491e070e86346b681817fb19d4608f9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.394587 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3a4c3cc5db934840bc6467d6478d117e" } modify_external_catalogs: true
I20250625 14:01:57.394696 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3a4c3cc5db934840bc6467d6478d117e" } modify_external_catalogs: true
I20250625 14:01:57.394707 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_94bdbb1851e54749bf15e9804ea45471" } new_table_name: "default.Table_d169eb7ba7584f76b2a6ab70495e4855" modify_external_catalogs: true
I20250625 14:01:57.395090 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8e7e773b96234beabd12191f60e2c981" } new_table_name: "default.Table_5f4cfca1a111436d9a80d3b64d0cfe0f" modify_external_catalogs: true
I20250625 14:01:57.395411 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 801fae4d88114ff29eacde80365b84a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.396054 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f4b53c4642624cbfa6a08f50289641f0" } new_table_name: "default.Table_d2eeb21d15424aa0a2f57b108f2028f3" modify_external_catalogs: true
I20250625 14:01:57.397478 12953 tablet.cc:1722] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:01:57.398487 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c2307a7c00204e8fa1a14b5112659d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2307a7c00204e8fa1a14b5112659d91 already in progress: creating tablet
W20250625 14:01:57.398658 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 801fae4d88114ff29eacde80365b84a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 801fae4d88114ff29eacde80365b84a0 already in progress: creating tablet
I20250625 14:01:57.400070 12233 tablet.cc:1722] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.403810 12166 tablet_bootstrap.cc:654] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.404186 11754 tablet_service.cc:1468] Processing CreateTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 (DEFAULT_TABLE table=default.Table_06e8bc49777a442bbce90e7f4312b059 [id=336fd4d44f664c92b37b98b4f9198459]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.404477 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce1b63ad2924626972ce7a42a4fdb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.404516 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 305009f335144f40b8a2dae61edb3801 (DEFAULT_TABLE table=default.Table_195a649075684f668a243215a37a93e0 [id=73eeb2af70b44421bffcf46be789f6e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.404791 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305009f335144f40b8a2dae61edb3801. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.406250 12984 tablet.cc:1722] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:01:57.407092 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0833d0e013f48f78cb6c616481b5dce has no consensus state
W20250625 14:01:57.407344 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5e271b27ac349d6bb8cf47aa8b9668a consensus state has no leader
I20250625 14:01:57.407788 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet fa2ccf77288144e5b81513dede9d4302
I20250625 14:01:57.408317 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet fa2ccf77288144e5b81513dede9d4302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:57.408860 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet fa2ccf77288144e5b81513dede9d4302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa2ccf77288144e5b81513dede9d4302 already in progress: creating tablet
I20250625 14:01:57.409102 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet fa2ccf77288144e5b81513dede9d4302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.409253 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd] alter complete (version 1)
I20250625 14:01:57.410450 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.412115 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet fa2ccf77288144e5b81513dede9d4302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.414602 12233 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:01:57.415321 12984 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:01:57.415490 12953 tablet.cc:1722] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:01:57.417091 12208 raft_consensus.cc:491] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.417217 12208 raft_consensus.cc:513] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.417538 12208 leader_election.cc:290] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.417819 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0547992986704a949305e7c5d014b965" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.418136 12558 raft_consensus.cc:491] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.418223 12558 raft_consensus.cc:513] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.418592 12558 leader_election.cc:290] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:01:57.418823 11717 leader_election.cc:343] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.419122 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0547992986704a949305e7c5d014b965" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:57.419531 11858 leader_election.cc:343] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 5872bfb53bd04ac79d02f8d87a4ea090
W20250625 14:01:57.419618 11717 leader_election.cc:343] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.419689 11717 leader_election.cc:304] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:57.419824 12208 raft_consensus.cc:2747] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.420367 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5872bfb53bd04ac79d02f8d87a4ea090" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:57.420710 11855 leader_election.cc:343] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.420672 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 305009f335144f40b8a2dae61edb3801 (DEFAULT_TABLE table=default.Table_195a649075684f668a243215a37a93e0 [id=73eeb2af70b44421bffcf46be789f6e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.420787 11855 leader_election.cc:304] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.420909 12558 raft_consensus.cc:2747] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.413190 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 8615e96c59474da5ae6214402aba4a46 (table default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]). Expected version 1 got 0
I20250625 14:01:57.421633 12026 tablet_service.cc:1468] Processing CreateTablet for tablet b5c6c654c5704a41987a8d2016ab32b4 (DEFAULT_TABLE table=default.Table_9616d3e97f6e49b9b75d91cf6df7490f [id=0097a7baa8914ac9bdeb01dcc78fccf0]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:57.413298 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet fa2ccf77288144e5b81513dede9d4302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa2ccf77288144e5b81513dede9d4302 already in progress: creating tablet
I20250625 14:01:57.421936 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c6c654c5704a41987a8d2016ab32b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.422618 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 305009f335144f40b8a2dae61edb3801 (DEFAULT_TABLE table=default.Table_195a649075684f668a243215a37a93e0 [id=73eeb2af70b44421bffcf46be789f6e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.422853 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305009f335144f40b8a2dae61edb3801. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.425568 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305009f335144f40b8a2dae61edb3801. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.426381 11920 raft_consensus.cc:1273] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:57.426694 12166 tablet_bootstrap.cc:492] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.426803 12166 ts_tablet_manager.cc:1397] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.001s
I20250625 14:01:57.426851 12894 consensus_queue.cc:1035] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.427088 12175 ts_tablet_manager.cc:1918] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.427145 12175 log.cc:1199] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f6116f7e64ae4e19863629a0e88a7265
I20250625 14:01:57.427358 12175 ts_tablet_manager.cc:1939] T f6116f7e64ae4e19863629a0e88a7265 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.427316 12166 raft_consensus.cc:357] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.427410 12166 raft_consensus.cc:383] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.427448 12166 raft_consensus.cc:738] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.427564 12166 consensus_queue.cc:260] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.427896 12166 ts_tablet_manager.cc:1428] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:57.428077 12166 tablet_bootstrap.cc:492] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.428617 12167 tablet_bootstrap.cc:492] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.428704 12167 ts_tablet_manager.cc:1397] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.083s user 0.001s sys 0.000s
I20250625 14:01:57.429032 12166 tablet_bootstrap.cc:654] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.429240 12167 raft_consensus.cc:357] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.429345 12167 raft_consensus.cc:383] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.429378 12167 raft_consensus.cc:738] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.429415 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8a19bb755ba242b59b812cd643e79646" } modify_external_catalogs: true
I20250625 14:01:57.429518 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8a19bb755ba242b59b812cd643e79646" } modify_external_catalogs: true
I20250625 14:01:57.429497 12167 consensus_queue.cc:260] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.429801 12167 ts_tablet_manager.cc:1428] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.429980 12167 tablet_bootstrap.cc:492] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.431169 12167 tablet_bootstrap.cc:654] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.431725 11754 tablet_service.cc:1468] Processing CreateTablet for tablet b5c6c654c5704a41987a8d2016ab32b4 (DEFAULT_TABLE table=default.Table_9616d3e97f6e49b9b75d91cf6df7490f [id=0097a7baa8914ac9bdeb01dcc78fccf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.431970 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c6c654c5704a41987a8d2016ab32b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.432035 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a3683a01c05249f7a1e658d430e0edd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.432430 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3683a01c05249f7a1e658d430e0edd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.432536 11756 tablet_service.cc:1468] Processing CreateTablet for tablet dff05950ded34f4bb554badc4ccd3e0f (DEFAULT_TABLE table=default.Table_8a19bb755ba242b59b812cd643e79646 [id=bc90345f034447a4b5220f58c4b52cf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.432737 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff05950ded34f4bb554badc4ccd3e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.434855 11762 tablet_service.cc:1468] Processing CreateTablet for tablet df475b9c0f62419a9df86d4e0097dcba (DEFAULT_TABLE table=default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d [id=d35a23a319d44785bff52098cd7247e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.435065 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df475b9c0f62419a9df86d4e0097dcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.435420 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 714bb5a28ec648f990fa1525a1b50129 (DEFAULT_TABLE table=default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.435649 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714bb5a28ec648f990fa1525a1b50129. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.435950 11754 tablet_service.cc:1468] Processing CreateTablet for tablet c4a906afbc504981942d57221742e822 (DEFAULT_TABLE table=default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb [id=4f157d4de29f4618937525f9293e5049]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.436194 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a906afbc504981942d57221742e822. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.436458 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 6c8c667108694caab967bd91f74759b6 (DEFAULT_TABLE table=default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.436681 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c8c667108694caab967bd91f74759b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.437211 11764 tablet_service.cc:1468] Processing CreateTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f (DEFAULT_TABLE table=default.Table_2037e3cc66de4c68bc580a95e021e860 [id=46617722da444cc58422a5ce1d383cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.437407 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3819dec2c834c40846dcb3a11fa4f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.439486 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 (DEFAULT_TABLE table=default.Table_3d8fdaed60c54eb6a0587add293c3e61 [id=da18d76cf3bc4ae79e0b3a779454d907]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.439702 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128dab7ad46048cc91fc20ddc1431d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.440016 12953 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.440469 12672 mvcc.cc:204] Tried to move back new op lower bound from 7171523040972259328 to 7171523039182651392. Current Snapshot: MvccSnapshot[applied={T|T < 7171523040972259328}]
I20250625 14:01:57.440675 12233 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.443411 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_57f7d205bb304fd8982fcd30bb558c54" } modify_external_catalogs: true
I20250625 14:01:57.443547 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_57f7d205bb304fd8982fcd30bb558c54" } modify_external_catalogs: true
I20250625 14:01:57.446642 11897 tablet_service.cc:1468] Processing CreateTablet for tablet df475b9c0f62419a9df86d4e0097dcba (DEFAULT_TABLE table=default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d [id=d35a23a319d44785bff52098cd7247e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.446949 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df475b9c0f62419a9df86d4e0097dcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.446992 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 6c8c667108694caab967bd91f74759b6 (DEFAULT_TABLE table=default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.447208 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c8c667108694caab967bd91f74759b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.446642 11901 tablet_service.cc:1468] Processing CreateTablet for tablet dff05950ded34f4bb554badc4ccd3e0f (DEFAULT_TABLE table=default.Table_8a19bb755ba242b59b812cd643e79646 [id=bc90345f034447a4b5220f58c4b52cf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.448040 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff05950ded34f4bb554badc4ccd3e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.449323 11892 tablet_service.cc:1468] Processing CreateTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f (DEFAULT_TABLE table=default.Table_2037e3cc66de4c68bc580a95e021e860 [id=46617722da444cc58422a5ce1d383cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.449517 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3819dec2c834c40846dcb3a11fa4f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.449466 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 674b6cd0ec374505a340cfefb6df63bb (DEFAULT_TABLE table=default.Table_b5bb34897dbe408eb18a7210d5178009 [id=163afb6ad61f460eacc876d8d0e95c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.449734 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674b6cd0ec374505a340cfefb6df63bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.451296 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 (DEFAULT_TABLE table=default.Table_3d8fdaed60c54eb6a0587add293c3e61 [id=da18d76cf3bc4ae79e0b3a779454d907]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.451552 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128dab7ad46048cc91fc20ddc1431d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.451709 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 (DEFAULT_TABLE table=default.Table_3d8fdaed60c54eb6a0587add293c3e61 [id=da18d76cf3bc4ae79e0b3a779454d907]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.451704 12035 tablet_service.cc:1468] Processing CreateTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f (DEFAULT_TABLE table=default.Table_2037e3cc66de4c68bc580a95e021e860 [id=46617722da444cc58422a5ce1d383cb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.451928 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128dab7ad46048cc91fc20ddc1431d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.451928 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3819dec2c834c40846dcb3a11fa4f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.453915 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 714bb5a28ec648f990fa1525a1b50129 (DEFAULT_TABLE table=default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.453997 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 714bb5a28ec648f990fa1525a1b50129 (DEFAULT_TABLE table=default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.454133 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714bb5a28ec648f990fa1525a1b50129. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.454216 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714bb5a28ec648f990fa1525a1b50129. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.454440 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f6116f7e64ae4e19863629a0e88a7265 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]) successfully deleted
I20250625 14:01:57.454514 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 674b6cd0ec374505a340cfefb6df63bb (DEFAULT_TABLE table=default.Table_b5bb34897dbe408eb18a7210d5178009 [id=163afb6ad61f460eacc876d8d0e95c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.454707 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674b6cd0ec374505a340cfefb6df63bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.455395 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a05b09a3225f45db841978b7b9b1fe51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a05b09a3225f45db841978b7b9b1fe51 already in progress: creating tablet
I20250625 14:01:57.456385 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 674b6cd0ec374505a340cfefb6df63bb (DEFAULT_TABLE table=default.Table_b5bb34897dbe408eb18a7210d5178009 [id=163afb6ad61f460eacc876d8d0e95c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.456621 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674b6cd0ec374505a340cfefb6df63bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.456668 12036 tablet_service.cc:1468] Processing CreateTablet for tablet c4a906afbc504981942d57221742e822 (DEFAULT_TABLE table=default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb [id=4f157d4de29f4618937525f9293e5049]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:57.456792 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c751d05cac1d4d65965e0aca2a94c14a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c751d05cac1d4d65965e0aca2a94c14a already in progress: creating tablet
I20250625 14:01:57.456880 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a906afbc504981942d57221742e822. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.457269 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 5489ee768c384fc0a1c8b6bed25b3a26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5489ee768c384fc0a1c8b6bed25b3a26 already in progress: creating tablet
W20250625 14:01:57.457620 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c2307a7c00204e8fa1a14b5112659d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2307a7c00204e8fa1a14b5112659d91 already in progress: creating tablet
W20250625 14:01:57.458001 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 801fae4d88114ff29eacde80365b84a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 801fae4d88114ff29eacde80365b84a0 already in progress: creating tablet
W20250625 14:01:57.458396 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet fa2ccf77288144e5b81513dede9d4302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa2ccf77288144e5b81513dede9d4302 already in progress: creating tablet
I20250625 14:01:57.458710 11895 tablet_service.cc:1468] Processing CreateTablet for tablet c4a906afbc504981942d57221742e822 (DEFAULT_TABLE table=default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb [id=4f157d4de29f4618937525f9293e5049]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.458931 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a906afbc504981942d57221742e822. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.459079 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 6c8c667108694caab967bd91f74759b6 (DEFAULT_TABLE table=default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.459280 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c8c667108694caab967bd91f74759b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.461167 12175 tablet_replica.cc:331] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.461349 12175 raft_consensus.cc:2241] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.461483 12175 raft_consensus.cc:2270] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.461604 12034 tablet_service.cc:1468] Processing CreateTablet for tablet dff05950ded34f4bb554badc4ccd3e0f (DEFAULT_TABLE table=default.Table_8a19bb755ba242b59b812cd643e79646 [id=bc90345f034447a4b5220f58c4b52cf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.461831 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff05950ded34f4bb554badc4ccd3e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.462117 12894 raft_consensus.cc:491] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.462226 12894 raft_consensus.cc:513] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.462507 12026 tablet_service.cc:1468] Processing CreateTablet for tablet df475b9c0f62419a9df86d4e0097dcba (DEFAULT_TABLE table=default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d [id=d35a23a319d44785bff52098cd7247e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.462661 12894 leader_election.cc:290] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.462747 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df475b9c0f62419a9df86d4e0097dcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.462893 12175 ts_tablet_manager.cc:1905] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.463798 11899 tablet_service.cc:1468] Processing CreateTablet for tablet b5c6c654c5704a41987a8d2016ab32b4 (DEFAULT_TABLE table=default.Table_9616d3e97f6e49b9b75d91cf6df7490f [id=0097a7baa8914ac9bdeb01dcc78fccf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.464031 12166 tablet_bootstrap.cc:492] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.464118 12166 ts_tablet_manager.cc:1397] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.000s
I20250625 14:01:57.464653 12166 raft_consensus.cc:357] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.464767 12166 raft_consensus.cc:383] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.464798 12166 raft_consensus.cc:738] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.464932 12166 consensus_queue.cc:260] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.464036 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c6c654c5704a41987a8d2016ab32b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.465227 12166 ts_tablet_manager.cc:1428] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.465420 12166 tablet_bootstrap.cc:492] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.465422 12238 raft_consensus.cc:491] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.465495 12238 raft_consensus.cc:513] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.465833 12238 leader_election.cc:290] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.467258 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "339813cd0c194f07bfc4edefd6a05ef3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.467485 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "339813cd0c194f07bfc4edefd6a05ef3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.467607 11920 raft_consensus.cc:2466] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:57.468138 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet b949191f6218463192890e13ccf6b17e from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.469154 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f41c7ed5d5c64d7196b15168dc43ccab" } modify_external_catalogs: true
I20250625 14:01:57.469273 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f41c7ed5d5c64d7196b15168dc43ccab" } modify_external_catalogs: true
W20250625 14:01:57.469308 11717 leader_election.cc:343] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.469434 11717 leader_election.cc:304] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.469604 12208 raft_consensus.cc:2802] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.469664 12208 raft_consensus.cc:491] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.469702 12208 raft_consensus.cc:3058] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.469990 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a25ceea16cbb4e339c2ebcc580c47270" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.470062 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3d8fdaed60c54eb6a0587add293c3e61" } new_table_name: "default.Table_712e366118ea4a03a6e8a0f811b4a27d" modify_external_catalogs: true
I20250625 14:01:57.470121 11921 raft_consensus.cc:2466] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:57.470295 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a25ceea16cbb4e339c2ebcc580c47270" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.470947 12208 raft_consensus.cc:513] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.471259 12166 tablet_bootstrap.cc:654] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.471314 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 562187f6db8a4883a5bb2d939a31b769 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.471379 12208 leader_election.cc:290] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.475567 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5] alter complete (version 1)
I20250625 14:01:57.478245 12175 ts_tablet_manager.cc:1918] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.478492 12175 log.cc:1199] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/5872bfb53bd04ac79d02f8d87a4ea090
I20250625 14:01:57.479035 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet dff05950ded34f4bb554badc4ccd3e0f
I20250625 14:01:57.479534 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet fe7e0145fb2f48c29259afafcbe29599
I20250625 14:01:57.479852 12167 tablet_bootstrap.cc:492] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.479952 12167 ts_tablet_manager.cc:1397] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.002s
I20250625 14:01:57.480268 12172 tablet_bootstrap.cc:492] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.480309 12175 ts_tablet_manager.cc:1939] T 5872bfb53bd04ac79d02f8d87a4ea090 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.480357 12172 ts_tablet_manager.cc:1397] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.127s user 0.002s sys 0.001s
I20250625 14:01:57.480526 12167 raft_consensus.cc:357] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.480635 12167 raft_consensus.cc:383] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.480667 12167 raft_consensus.cc:738] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.480795 12167 consensus_queue.cc:260] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.480821 12172 raft_consensus.cc:357] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.480938 12172 raft_consensus.cc:383] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.480949 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 67002721ac274619b435e8bf16fc149a
I20250625 14:01:57.480980 12172 raft_consensus.cc:738] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.481105 12172 consensus_queue.cc:260] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.481385 12172 ts_tablet_manager.cc:1428] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.481565 12172 tablet_bootstrap.cc:492] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:57.481989 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 128dab7ad46048cc91fc20ddc1431d57 consensus state has no leader
I20250625 14:01:57.484313 12167 ts_tablet_manager.cc:1428] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250625 14:01:57.485180 12167 tablet_bootstrap.cc:492] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.486333 12167 tablet_bootstrap.cc:654] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.486670 11528 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a25ceea16cbb4e339c2ebcc580c47270 (table default.Table_d6d78f7d158248f6a25dc311131eed4d [id=ffe2f2ab5919440396e245783c966fd3]). Expected version 1 got 0
I20250625 14:01:57.491616 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b949191f6218463192890e13ccf6b17e
I20250625 14:01:57.491875 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_d169eb7ba7584f76b2a6ab70495e4855 [id=d60959d1e4b14c1d820f04d9bfedfe11] alter complete (version 5)
I20250625 14:01:57.491932 11529 catalog_manager.cc:6652] ReplaceTablet: tablet b949191f6218463192890e13ccf6b17e deleted and replaced by tablet 3faa8782ba0d45dbbd89437685a64aef
I20250625 14:01:57.492619 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "339813cd0c194f07bfc4edefd6a05ef3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.492902 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet dff05950ded34f4bb554badc4ccd3e0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.493016 11717 leader_election.cc:304] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.493080 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet fe7e0145fb2f48c29259afafcbe29599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.493176 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 67002721ac274619b435e8bf16fc149a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:57.493271 11717 leader_election.cc:343] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:57.493709 11717 leader_election.cc:343] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:57.493708 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet dff05950ded34f4bb554badc4ccd3e0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff05950ded34f4bb554badc4ccd3e0f already in progress: creating tablet
W20250625 14:01:57.493868 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet fe7e0145fb2f48c29259afafcbe29599 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe7e0145fb2f48c29259afafcbe29599 already in progress: creating tablet
W20250625 14:01:57.494010 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 67002721ac274619b435e8bf16fc149a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67002721ac274619b435e8bf16fc149a already in progress: creating tablet
I20250625 14:01:57.494079 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet b949191f6218463192890e13ccf6b17e with delete_type TABLET_DATA_DELETED (replaced by tablet 3faa8782ba0d45dbbd89437685a64aef) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.493296 12238 raft_consensus.cc:2802] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.494203 12238 raft_consensus.cc:491] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.494264 12238 raft_consensus.cc:3058] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.494359 12855 consensus_queue.cc:1035] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.494771 12166 tablet_bootstrap.cc:492] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.494866 12166 ts_tablet_manager.cc:1397] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.002s
I20250625 14:01:57.495292 12238 raft_consensus.cc:513] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.495368 12166 raft_consensus.cc:357] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.495481 12166 raft_consensus.cc:383] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.495510 12166 raft_consensus.cc:738] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.495602 12238 leader_election.cc:290] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.495626 12166 consensus_queue.cc:260] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.495965 12166 ts_tablet_manager.cc:1428] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:57.496068 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "339813cd0c194f07bfc4edefd6a05ef3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:57.496171 12166 tablet_bootstrap.cc:492] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.496869 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_096fdb53835b4885953dbe0f68c7faaa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.497213 12166 tablet_bootstrap.cc:654] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.497292 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_096fdb53835b4885953dbe0f68c7faaa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.497642 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet edfce8c80bb341a48fb1b59def057571 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.499557 12172 tablet_bootstrap.cc:654] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.496177 11919 raft_consensus.cc:3058] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.500633 11919 raft_consensus.cc:2466] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:57.502230 11717 leader_election.cc:304] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.502341 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_6c025a609dc74d37a082a5050f756463 [id=62132df62b3a42fb9886592b9b885d31] alter complete (version 1)
W20250625 14:01:57.502662 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b949191f6218463192890e13ccf6b17e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b949191f6218463192890e13ccf6b17e already in progress: creating tablet
I20250625 14:01:57.502693 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a25ceea16cbb4e339c2ebcc580c47270" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:57.502796 11920 raft_consensus.cc:3058] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.503502 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a25ceea16cbb4e339c2ebcc580c47270" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.503824 11920 raft_consensus.cc:2466] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:57.505703 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet edfce8c80bb341a48fb1b59def057571
I20250625 14:01:57.505980 11529 catalog_manager.cc:6652] ReplaceTablet: tablet edfce8c80bb341a48fb1b59def057571 deleted and replaced by tablet 8578d07c9b4a44f887b5a30e92c1ede9
I20250625 14:01:57.507660 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_47a020733f644c45b54865bbd14ff779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.508044 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]). Expected version 1 got 0
W20250625 14:01:57.508078 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47a020733f644c45b54865bbd14ff779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.509429 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e43289a5fa434695a866d39a58d5c776" } new_table_name: "default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1" modify_external_catalogs: true
I20250625 14:01:57.510030 12167 tablet_bootstrap.cc:492] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.510126 12167 ts_tablet_manager.cc:1397] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20250625 14:01:57.510680 12167 raft_consensus.cc:357] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.510818 12167 raft_consensus.cc:383] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.510851 12167 raft_consensus.cc:738] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.510987 12167 consensus_queue.cc:260] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.512255 12167 ts_tablet_manager.cc:1428] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:57.512459 12855 raft_consensus.cc:2802] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.512583 12855 raft_consensus.cc:695] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:57.512609 12167 tablet_bootstrap.cc:492] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.512742 12855 consensus_queue.cc:237] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.512912 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_31edada7a2d04160be101b2220c0ef52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.513305 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31edada7a2d04160be101b2220c0ef52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.514276 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet dff05950ded34f4bb554badc4ccd3e0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.514834 12167 tablet_bootstrap.cc:654] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.515450 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet dff05950ded34f4bb554badc4ccd3e0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.515646 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet fe7e0145fb2f48c29259afafcbe29599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.515785 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 67002721ac274619b435e8bf16fc149a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.516546 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet edfce8c80bb341a48fb1b59def057571 with delete_type TABLET_DATA_DELETED (replaced by tablet 8578d07c9b4a44f887b5a30e92c1ede9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.516999 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 5872bfb53bd04ac79d02f8d87a4ea090 (table default.Table_9aa153abf09346f4a92998fa6a4c1cb0 [id=f7e3bef19fc644cf89f008469f969c03]) successfully deleted
W20250625 14:01:57.517143 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet dff05950ded34f4bb554badc4ccd3e0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff05950ded34f4bb554badc4ccd3e0f already in progress: creating tablet
I20250625 14:01:57.518006 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet b949191f6218463192890e13ccf6b17e with delete_type TABLET_DATA_DELETED (replaced by tablet 3faa8782ba0d45dbbd89437685a64aef) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.518141 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet edfce8c80bb341a48fb1b59def057571 with delete_type TABLET_DATA_DELETED (replaced by tablet 8578d07c9b4a44f887b5a30e92c1ede9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.518076 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet edfce8c80bb341a48fb1b59def057571 with delete_type TABLET_DATA_DELETED (replaced by tablet 8578d07c9b4a44f887b5a30e92c1ede9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.518276 12894 raft_consensus.cc:491] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.518389 12894 raft_consensus.cc:513] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.518734 12894 leader_election.cc:290] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.519199 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 67002721ac274619b435e8bf16fc149a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.519369 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.519513 12175 tablet_replica.cc:331] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.519652 12175 raft_consensus.cc:2241] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.519771 12175 raft_consensus.cc:2270] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.520156 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet b949191f6218463192890e13ccf6b17e with delete_type TABLET_DATA_DELETED (replaced by tablet 3faa8782ba0d45dbbd89437685a64aef) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.520287 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet db4a9e4dfdd145bab965004ee5562e2b with delete_type TABLET_DATA_DELETED (replaced by tablet 140c1810e98741479c3754729409b46c) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:57.517268 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet fe7e0145fb2f48c29259afafcbe29599 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe7e0145fb2f48c29259afafcbe29599 already in progress: creating tablet
W20250625 14:01:57.520705 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 67002721ac274619b435e8bf16fc149a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67002721ac274619b435e8bf16fc149a already in progress: creating tablet
I20250625 14:01:57.521083 12166 tablet_bootstrap.cc:492] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.521167 12166 ts_tablet_manager.cc:1397] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
W20250625 14:01:57.521556 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4ca3d5203a64d99912765b83af97c09 consensus state has no leader
I20250625 14:01:57.521632 12166 raft_consensus.cc:357] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.521729 12166 raft_consensus.cc:383] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.521759 12166 raft_consensus.cc:738] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.521871 12166 consensus_queue.cc:260] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:57.520823 11517 catalog_manager.cc:5001] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): alter failed for tablet 882da47c1f5a496f8df2ba2d3501b453 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]),no further retry: Not found: Tablet not found: 882da47c1f5a496f8df2ba2d3501b453
I20250625 14:01:57.522207 12166 ts_tablet_manager.cc:1428] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.522389 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet fe7e0145fb2f48c29259afafcbe29599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.522421 12166 tablet_bootstrap.cc:492] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.523363 12175 ts_tablet_manager.cc:1905] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.523480 12166 tablet_bootstrap.cc:654] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.526229 12167 tablet_bootstrap.cc:492] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.526428 12167 ts_tablet_manager.cc:1397] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20250625 14:01:57.526937 12175 ts_tablet_manager.cc:1918] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.526962 12167 raft_consensus.cc:357] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.527078 12175 log.cc:1199] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7cd1672cf1164e469a862c5b43ec6f12
I20250625 14:01:57.527202 12167 raft_consensus.cc:383] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.527307 12175 ts_tablet_manager.cc:1939] T 7cd1672cf1164e469a862c5b43ec6f12 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.527311 12167 raft_consensus.cc:738] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.527562 12167 consensus_queue.cc:260] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.529471 12175 tablet_replica.cc:331] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.529717 12167 ts_tablet_manager.cc:1428] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:57.530295 12666 raft_consensus.cc:491] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.530422 12666 raft_consensus.cc:513] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:57.530679 11717 leader_election.cc:343] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.530777 12666 leader_election.cc:290] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.530809 11717 leader_election.cc:304] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.530953 12238 raft_consensus.cc:2802] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.531051 12238 raft_consensus.cc:695] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:57.531189 12238 consensus_queue.cc:237] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.531471 12167 tablet_bootstrap.cc:492] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.532915 12167 tablet_bootstrap.cc:654] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.533245 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet edfce8c80bb341a48fb1b59def057571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edfce8c80bb341a48fb1b59def057571 already in progress: creating tablet
I20250625 14:01:57.533818 12054 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "35ece361f92a4c9a9df5ad3355f87db9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:57.533967 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet edfce8c80bb341a48fb1b59def057571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edfce8c80bb341a48fb1b59def057571 already in progress: creating tablet
W20250625 14:01:57.533989 11990 leader_election.cc:343] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 7cc7e962e4b146bc88a06fde969eb99d
I20250625 14:01:57.535364 12172 tablet_bootstrap.cc:492] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
W20250625 14:01:57.535352 11993 leader_election.cc:343] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 7cc7e962e4b146bc88a06fde969eb99d
I20250625 14:01:57.535426 11993 leader_election.cc:304] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.535653 12172 ts_tablet_manager.cc:1397] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20250625 14:01:57.535683 12666 raft_consensus.cc:2747] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.536260 12172 raft_consensus.cc:357] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.536492 12172 raft_consensus.cc:383] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.536576 12172 raft_consensus.cc:738] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.536813 12172 consensus_queue.cc:260] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:57.537220 11717 leader_election.cc:343] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.537242 12172 ts_tablet_manager.cc:1428] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:57.537384 11717 consensus_peers.cc:487] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:57.538607 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 96ec205b0f31484a91054fedf619b9ab (table default.Table_6c025a609dc74d37a082a5050f756463 [id=62132df62b3a42fb9886592b9b885d31]). Expected version 1 got 0
I20250625 14:01:57.539693 12172 tablet_bootstrap.cc:492] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.541118 12172 tablet_bootstrap.cc:654] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.541771 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet dff05950ded34f4bb554badc4ccd3e0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff05950ded34f4bb554badc4ccd3e0f already in progress: creating tablet
W20250625 14:01:57.541971 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b949191f6218463192890e13ccf6b17e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b949191f6218463192890e13ccf6b17e already in progress: creating tablet
W20250625 14:01:57.542097 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet edfce8c80bb341a48fb1b59def057571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edfce8c80bb341a48fb1b59def057571 already in progress: creating tablet
W20250625 14:01:57.542208 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 67002721ac274619b435e8bf16fc149a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67002721ac274619b435e8bf16fc149a already in progress: creating tablet
W20250625 14:01:57.543530 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet fe7e0145fb2f48c29259afafcbe29599 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe7e0145fb2f48c29259afafcbe29599 already in progress: creating tablet
I20250625 14:01:57.543666 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7cd1672cf1164e469a862c5b43ec6f12 (table default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]) successfully deleted
W20250625 14:01:57.543764 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b949191f6218463192890e13ccf6b17e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b949191f6218463192890e13ccf6b17e already in progress: creating tablet
I20250625 14:01:57.544150 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cc7e962e4b146bc88a06fde969eb99d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.544358 12173 tablet_replica.cc:331] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.544487 12173 raft_consensus.cc:2241] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.544593 12173 raft_consensus.cc:2270] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.532370 12166 tablet_bootstrap.cc:492] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.545446 12166 ts_tablet_manager.cc:1397] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:57.545694 12173 ts_tablet_manager.cc:1905] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.535017 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "35ece361f92a4c9a9df5ad3355f87db9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.546438 12166 raft_consensus.cc:357] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.546561 12166 raft_consensus.cc:383] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.546590 12166 raft_consensus.cc:738] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.546708 12166 consensus_queue.cc:260] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.546984 12166 ts_tablet_manager.cc:1428] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.547168 12166 tablet_bootstrap.cc:492] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:57.547668 11717 leader_election.cc:343] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.547752 11717 leader_election.cc:304] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:57.547919 12894 raft_consensus.cc:2747] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.548215 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]). Expected version 1 got 0
I20250625 14:01:57.548326 12166 tablet_bootstrap.cc:654] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.548689 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 87974ef08b3b4cc299ae643c0cb5d694 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.549065 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet a7e0385d1c584c2d9560cbe138686565 with delete_type TABLET_DATA_DELETED (replaced by tablet a4ca3d5203a64d99912765b83af97c09) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.545447 12175 raft_consensus.cc:2241] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.549660 12175 raft_consensus.cc:2270] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.549701 12173 ts_tablet_manager.cc:1918] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.549799 12173 log.cc:1199] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7cc7e962e4b146bc88a06fde969eb99d
I20250625 14:01:57.550027 12173 ts_tablet_manager.cc:1939] T 7cc7e962e4b146bc88a06fde969eb99d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.550161 12175 ts_tablet_manager.cc:1905] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.551764 12167 tablet_bootstrap.cc:492] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.552052 12167 ts_tablet_manager.cc:1397] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20250625 14:01:57.552589 12167 raft_consensus.cc:357] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.552711 12167 raft_consensus.cc:383] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.552749 12167 raft_consensus.cc:738] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.552924 12167 consensus_queue.cc:260] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.554153 12167 ts_tablet_manager.cc:1428] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:01:57.554661 12167 tablet_bootstrap.cc:492] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.555011 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]). Expected version 1 got 0
I20250625 14:01:57.555943 12167 tablet_bootstrap.cc:654] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.558521 12172 tablet_bootstrap.cc:492] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.558714 12172 ts_tablet_manager.cc:1397] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:01:57.559463 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_5f7bec805c5d4182a130bf45d09b3b35 [id=42eadc1269e249168e58ec0f122956bd]). Expected version 1 got 0
I20250625 14:01:57.559455 12172 raft_consensus.cc:357] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.559584 12172 raft_consensus.cc:383] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.559636 12172 raft_consensus.cc:738] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.559814 12175 ts_tablet_manager.cc:1918] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.559801 12172 consensus_queue.cc:260] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.560004 12175 log.cc:1199] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/db4a9e4dfdd145bab965004ee5562e2b
I20250625 14:01:57.560251 12172 ts_tablet_manager.cc:1428] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.560537 12172 tablet_bootstrap.cc:492] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.560534 12175 ts_tablet_manager.cc:1939] T db4a9e4dfdd145bab965004ee5562e2b P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.560671 12173 tablet_replica.cc:331] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.560820 12173 raft_consensus.cc:2241] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.560943 12173 raft_consensus.cc:2270] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.561480 12173 ts_tablet_manager.cc:1905] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.562568 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet db4a9e4dfdd145bab965004ee5562e2b (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
I20250625 14:01:57.562711 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7cc7e962e4b146bc88a06fde969eb99d (table default.Table_0b3cb311c8ff42a6a5488448051f33a8 [id=c8d56c06b27f4a54ae3a23126f7d04a9]) successfully deleted
I20250625 14:01:57.565475 12172 tablet_bootstrap.cc:654] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.566417 12173 ts_tablet_manager.cc:1918] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.566571 12173 log.cc:1199] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/87974ef08b3b4cc299ae643c0cb5d694
I20250625 14:01:57.566833 12173 ts_tablet_manager.cc:1939] T 87974ef08b3b4cc299ae643c0cb5d694 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.566898 12166 tablet_bootstrap.cc:492] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.567018 12166 ts_tablet_manager.cc:1397] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250625 14:01:57.567502 12173 tablet_replica.cc:331] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.567631 12173 raft_consensus.cc:2241] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.567574 12166 raft_consensus.cc:357] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.567696 12166 raft_consensus.cc:383] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.567718 12173 raft_consensus.cc:2270] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.567739 12166 raft_consensus.cc:738] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.567915 12166 consensus_queue.cc:260] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.568212 12166 ts_tablet_manager.cc:1428] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.568432 12166 tablet_bootstrap.cc:492] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.569555 12166 tablet_bootstrap.cc:654] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.570076 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 87974ef08b3b4cc299ae643c0cb5d694 (table default.Table_ac9132782f574ad8a5d69192e7168e79 [id=17b5121798724007bf54de2b4f029fb3]) successfully deleted
I20250625 14:01:57.573940 11528 catalog_manager.cc:5582] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.574184 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:57.576561 12173 ts_tablet_manager.cc:1905] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.579222 12173 ts_tablet_manager.cc:1918] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.579800 12894 raft_consensus.cc:491] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.579955 12166 tablet_bootstrap.cc:492] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.579916 12894 raft_consensus.cc:513] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.579955 12167 tablet_bootstrap.cc:492] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.580060 12166 ts_tablet_manager.cc:1397] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:57.580123 12167 ts_tablet_manager.cc:1397] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.002s
I20250625 14:01:57.580354 12894 leader_election.cc:290] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.580593 12166 raft_consensus.cc:357] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.580621 12167 raft_consensus.cc:357] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.580721 12166 raft_consensus.cc:383] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.580727 12167 raft_consensus.cc:383] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.580756 12167 raft_consensus.cc:738] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.580755 12166 raft_consensus.cc:738] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.580879 12166 consensus_queue.cc:260] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.580978 12167 consensus_queue.cc:260] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.581174 12166 ts_tablet_manager.cc:1428] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.582381 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb1d6934ab98482c9ae6b6cafc1ee9a6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.582650 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb1d6934ab98482c9ae6b6cafc1ee9a6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.582762 11920 raft_consensus.cc:2466] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:57.583429 12166 tablet_bootstrap.cc:492] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.583621 12167 ts_tablet_manager.cc:1428] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:57.583982 12167 tablet_bootstrap.cc:492] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.584685 11717 leader_election.cc:304] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:57.584877 11717 leader_election.cc:343] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.585299 12894 raft_consensus.cc:2802] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.585361 12894 raft_consensus.cc:491] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.585400 12894 raft_consensus.cc:3058] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.585690 12166 tablet_bootstrap.cc:654] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.586511 12167 tablet_bootstrap.cc:654] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.586596 12894 raft_consensus.cc:513] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.586993 12894 leader_election.cc:290] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.587424 12173 log.cc:1199] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a7e0385d1c584c2d9560cbe138686565
I20250625 14:01:57.587705 12173 ts_tablet_manager.cc:1939] T a7e0385d1c584c2d9560cbe138686565 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.589357 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dab2b89c092c432f989c600f2f724b87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.589774 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dab2b89c092c432f989c600f2f724b87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.591198 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb1d6934ab98482c9ae6b6cafc1ee9a6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:57.591320 11920 raft_consensus.cc:3058] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.592367 11920 raft_consensus.cc:2466] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:57.593495 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (DEFAULT_TABLE table=default.Table_ec9c0bd54e0e441186096c7e11ccc198 [id=416264ede8644650b07f6c60ffb3cc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.594380 11717 leader_election.cc:304] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.594678 12894 raft_consensus.cc:2802] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.594766 12894 raft_consensus.cc:695] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:57.594899 12894 consensus_queue.cc:237] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.595778 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 8615e96c59474da5ae6214402aba4a46 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.595831 12600 raft_consensus.cc:491] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.595930 12600 raft_consensus.cc:513] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.596275 12600 leader_election.cc:290] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.596827 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ac54984290b448d798b8dc1483e17753"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.596853 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb" } modify_external_catalogs: true
I20250625 14:01:57.596961 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb" } modify_external_catalogs: true
W20250625 14:01:57.597239 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac54984290b448d798b8dc1483e17753 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.597538 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb1d6934ab98482c9ae6b6cafc1ee9a6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.597770 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d74f27d998b14ee890272812b718e468" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.598008 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_26cf2e4d1ba540b29a77b71d12a03688"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.598361 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26cf2e4d1ba540b29a77b71d12a03688 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.599128 11855 leader_election.cc:343] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.599861 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d74f27d998b14ee890272812b718e468" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.599997 11782 raft_consensus.cc:2466] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:57.601047 12167 tablet_bootstrap.cc:492] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.601145 12167 ts_tablet_manager.cc:1397] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:57.601168 11858 leader_election.cc:304] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.601421 12600 raft_consensus.cc:2802] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.601444 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet d74f27d998b14ee890272812b718e468 (table default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]). Expected version 1 got 0
I20250625 14:01:57.601473 12600 raft_consensus.cc:491] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.601511 12600 raft_consensus.cc:3058] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.601648 12167 raft_consensus.cc:357] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.601747 12167 raft_consensus.cc:383] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.601774 12167 raft_consensus.cc:738] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.601886 12167 consensus_queue.cc:260] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.602170 12167 ts_tablet_manager.cc:1428] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.602630 12600 raft_consensus.cc:513] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.602984 12600 leader_election.cc:290] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.604239 12666 raft_consensus.cc:491] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.604323 12666 raft_consensus.cc:513] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.604373 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d74f27d998b14ee890272812b718e468" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:57.604496 11782 raft_consensus.cc:3058] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.604653 12666 leader_election.cc:290] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.605535 11782 raft_consensus.cc:2466] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:57.606477 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 with delete_type TABLET_DATA_DELETED (replaced by tablet fae1eddf1156499aa346502f7a200125) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.606679 12175 tablet_replica.cc:331] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.606819 12175 raft_consensus.cc:2241] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.606921 12175 raft_consensus.cc:2270] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.607185 11529 catalog_manager.cc:5582] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.607407 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a25ceea16cbb4e339c2ebcc580c47270 (table default.Table_d6d78f7d158248f6a25dc311131eed4d [id=ffe2f2ab5919440396e245783c966fd3]). Expected version 1 got 0
I20250625 14:01:57.607566 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]). Expected version 1 got 0
I20250625 14:01:57.607656 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet d74f27d998b14ee890272812b718e468 (table default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]). Expected version 1 got 0
I20250625 14:01:57.607731 11529 catalog_manager.cc:5582] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:57.608457 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a868c6d7d31c43a49e263018f45db372"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.608644 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_02b107aff218434e8b66fde53ea34376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.608850 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a868c6d7d31c43a49e263018f45db372 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.608871 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02b107aff218434e8b66fde53ea34376 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.609705 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2eb9e374034c42209d4317d0232bc806"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.610030 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2eb9e374034c42209d4317d0232bc806 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.610127 12175 ts_tablet_manager.cc:1905] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.611022 11858 leader_election.cc:304] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.612751 12175 ts_tablet_manager.cc:1918] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.613039 12175 log.cc:1199] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/35ece361f92a4c9a9df5ad3355f87db9
I20250625 14:01:57.613385 12175 ts_tablet_manager.cc:1939] T 35ece361f92a4c9a9df5ad3355f87db9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.614225 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 35ece361f92a4c9a9df5ad3355f87db9 (table default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]) successfully deleted
I20250625 14:01:57.614763 12666 raft_consensus.cc:491] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.614876 12666 raft_consensus.cc:513] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.615332 12666 leader_election.cc:290] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.615870 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96ec205b0f31484a91054fedf619b9ab" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.616138 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49c8487f502b4f5299387daa9e89604b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.616461 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96ec205b0f31484a91054fedf619b9ab" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:57.616550 11717 leader_election.cc:343] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.616634 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "49c8487f502b4f5299387daa9e89604b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.616861 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 with delete_type TABLET_DATA_DELETED (replaced by tablet fae1eddf1156499aa346502f7a200125) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.617049 12177 tablet_replica.cc:331] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.617149 12600 raft_consensus.cc:2802] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.617206 12177 raft_consensus.cc:2241] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.617244 12600 raft_consensus.cc:695] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:57.617311 12177 raft_consensus.cc:2270] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.617365 12600 consensus_queue.cc:237] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.617899 12177 ts_tablet_manager.cc:1905] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.618784 11990 leader_election.cc:304] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.619187 12666 raft_consensus.cc:2747] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.619601 11993 leader_election.cc:304] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.620293 12233 tablet.cc:1722] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.620375 12666 raft_consensus.cc:2747] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.621192 12177 ts_tablet_manager.cc:1918] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.621261 12177 log.cc:1199] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/35ece361f92a4c9a9df5ad3355f87db9
I20250625 14:01:57.621482 12177 ts_tablet_manager.cc:1939] T 35ece361f92a4c9a9df5ad3355f87db9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.623407 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e1af8c7d5a544d4e9cd1e8d68fe71eee" } new_table_name: "default.Table_43bcd95133e249cc987155fe5045e4ea" modify_external_catalogs: true
I20250625 14:01:57.623821 12953 tablet.cc:1722] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.628314 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c4a906afbc504981942d57221742e822
I20250625 14:01:57.628790 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_68da0f72df6e43e799a678a4f7211cef" } new_table_name: "default.Table_17d82633b136412b84fe29a827c8bd5f" modify_external_catalogs: true
I20250625 14:01:57.629070 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0d953c5d6072467bab1a7d797eb13dc6" } modify_external_catalogs: true
I20250625 14:01:57.629189 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0d953c5d6072467bab1a7d797eb13dc6" } modify_external_catalogs: true
I20250625 14:01:57.629544 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8615e96c59474da5ae6214402aba4a46
I20250625 14:01:57.629820 11526 catalog_manager.cc:6652] ReplaceTablet: tablet 8615e96c59474da5ae6214402aba4a46 deleted and replaced by tablet 54a59027aef04a12a0bf1fbece3c3161
I20250625 14:01:57.629864 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet c4a906afbc504981942d57221742e822 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.629988 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 8615e96c59474da5ae6214402aba4a46 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a59027aef04a12a0bf1fbece3c3161) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.630029 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7b4c7577bd6b43bca23e1ed2d10fb086" } new_table_name: "default.Table_d5005083292a472ab6b1824e5dfb65f7" modify_external_catalogs: true
I20250625 14:01:57.630065 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet c4a906afbc504981942d57221742e822 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.630227 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 8615e96c59474da5ae6214402aba4a46 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a59027aef04a12a0bf1fbece3c3161) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.630414 12175 tablet_replica.cc:331] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.630554 12175 raft_consensus.cc:2241] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.630666 12175 raft_consensus.cc:2270] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.631036 11531 catalog_manager.cc:5582] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.631242 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet d74f27d998b14ee890272812b718e468 (table default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]). Expected version 1 got 0
I20250625 14:01:57.631393 12175 ts_tablet_manager.cc:1905] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:57.631749 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c4a906afbc504981942d57221742e822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4a906afbc504981942d57221742e822 already in progress: creating tablet
I20250625 14:01:57.633352 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 35ece361f92a4c9a9df5ad3355f87db9 (table default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]) successfully deleted
I20250625 14:01:57.633630 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet c4a906afbc504981942d57221742e822 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.633801 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 8615e96c59474da5ae6214402aba4a46 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a59027aef04a12a0bf1fbece3c3161) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.633904 12175 ts_tablet_manager.cc:1918] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.633966 12175 log.cc:1199] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8615e96c59474da5ae6214402aba4a46
I20250625 14:01:57.634189 12175 ts_tablet_manager.cc:1939] T 8615e96c59474da5ae6214402aba4a46 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.635269 11919 raft_consensus.cc:1273] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:57.636283 12177 tablet_replica.cc:331] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.636433 12177 raft_consensus.cc:2241] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.636543 12177 raft_consensus.cc:2270] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:57.636786 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c4a906afbc504981942d57221742e822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4a906afbc504981942d57221742e822 already in progress: creating tablet
I20250625 14:01:57.636940 12894 consensus_queue.cc:1035] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.636947 12177 ts_tablet_manager.cc:1905] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.637933 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8615e96c59474da5ae6214402aba4a46 (table default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]) successfully deleted
I20250625 14:01:57.639820 12177 ts_tablet_manager.cc:1918] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.641034 12177 log.cc:1199] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8615e96c59474da5ae6214402aba4a46
I20250625 14:01:57.641362 12177 ts_tablet_manager.cc:1939] T 8615e96c59474da5ae6214402aba4a46 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.643290 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (DEFAULT_TABLE table=default.Table_ec9c0bd54e0e441186096c7e11ccc198 [id=416264ede8644650b07f6c60ffb3cc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.643580 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e4cdf8f78d14c7d8ba3bda009d33719. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.643573 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 628edde0bd0840c6a11c79f8ab810977 (DEFAULT_TABLE table=default.Table_eea10ee786c54ea6b76157e09be2b818 [id=f71426341d4c4fe0bd0342ea293e0110]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.645044 12558 raft_consensus.cc:491] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.645129 12558 raft_consensus.cc:513] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.645479 12558 leader_election.cc:290] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.646528 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54f0be19f9134fa3a88ae867b108c7e8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.646687 11780 raft_consensus.cc:2466] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:57.647020 11858 leader_election.cc:304] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.647208 12558 raft_consensus.cc:2802] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.647255 12558 raft_consensus.cc:491] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.647294 12558 raft_consensus.cc:3058] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.648257 12558 raft_consensus.cc:513] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.648609 12558 leader_election.cc:290] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.649163 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54f0be19f9134fa3a88ae867b108c7e8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:57.649298 11780 raft_consensus.cc:3058] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.650363 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 628edde0bd0840c6a11c79f8ab810977 (DEFAULT_TABLE table=default.Table_eea10ee786c54ea6b76157e09be2b818 [id=f71426341d4c4fe0bd0342ea293e0110]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.650444 11780 raft_consensus.cc:2466] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:57.650641 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628edde0bd0840c6a11c79f8ab810977. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.651192 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 (DEFAULT_TABLE table=default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.653402 11858 leader_election.cc:304] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.653645 12558 raft_consensus.cc:2802] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.653717 12558 raft_consensus.cc:695] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:57.653837 12558 consensus_queue.cc:237] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.655818 12055 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54f0be19f9134fa3a88ae867b108c7e8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.655997 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d74f27d998b14ee890272812b718e468" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.656311 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54f0be19f9134fa3a88ae867b108c7e8" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.656432 12233 tablet.cc:1722] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.656592 12053 raft_consensus.cc:3058] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.656689 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628edde0bd0840c6a11c79f8ab810977. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.657720 11855 leader_election.cc:343] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:57.657950 11855 leader_election.cc:343] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:57.658114 11855 leader_election.cc:343] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.659231 12213 mvcc.cc:204] Tried to move back new op lower bound from 7171523040671834112 to 7171523039338639360. Current Snapshot: MvccSnapshot[applied={T|T < 7171523040671834112}]
I20250625 14:01:57.659439 12984 tablet.cc:1722] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.659572 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e4cdf8f78d14c7d8ba3bda009d33719. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.660604 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet deee7c3fb5204c63a6618f628848bc81 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.661865 12167 tablet_bootstrap.cc:492] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.663014 12167 tablet_bootstrap.cc:654] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.663122 12173 tablet_replica.cc:331] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.663269 12173 raft_consensus.cc:2241] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.663381 12173 raft_consensus.cc:2270] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.663790 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a7e0385d1c584c2d9560cbe138686565 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]) successfully deleted
I20250625 14:01:57.663997 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c5e71b4a4f4efc81f822bdf95d0f99. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.663995 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c4a906afbc504981942d57221742e822 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4a906afbc504981942d57221742e822 already in progress: creating tablet
W20250625 14:01:57.664127 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8615e96c59474da5ae6214402aba4a46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8615e96c59474da5ae6214402aba4a46 already in progress: creating tablet
W20250625 14:01:57.664494 11717 consensus_peers.cc:487] T a25ceea16cbb4e339c2ebcc580c47270 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:57.664995 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8615e96c59474da5ae6214402aba4a46 (table default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]) successfully deleted
W20250625 14:01:57.667629 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 93d666f4b403435287f4157bda971193 consensus state has no leader
W20250625 14:01:57.671458 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 consensus state has no leader
I20250625 14:01:57.671924 12167 tablet_bootstrap.cc:492] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.671977 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet da5ed5d8d3ca4342980c893a8653d4a0
I20250625 14:01:57.672044 12167 ts_tablet_manager.cc:1397] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
W20250625 14:01:57.672461 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1c05e534c804eb69e0c249a03418941 consensus state has no leader
I20250625 14:01:57.672828 12167 raft_consensus.cc:357] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.672945 12167 raft_consensus.cc:383] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.672981 12167 raft_consensus.cc:738] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.673096 12167 consensus_queue.cc:260] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.673408 12167 ts_tablet_manager.cc:1428] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:57.673645 12167 tablet_bootstrap.cc:492] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.676028 12167 tablet_bootstrap.cc:654] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.677186 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.677731 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.678738 12167 tablet_bootstrap.cc:492] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.678840 12167 ts_tablet_manager.cc:1397] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20250625 14:01:57.679374 12167 raft_consensus.cc:357] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.679502 12167 raft_consensus.cc:383] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.679538 12167 raft_consensus.cc:738] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.679646 12167 consensus_queue.cc:260] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.679922 12167 ts_tablet_manager.cc:1428] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:57.680117 12167 tablet_bootstrap.cc:492] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.681138 12167 tablet_bootstrap.cc:654] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.682085 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet da5ed5d8d3ca4342980c893a8653d4a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5ed5d8d3ca4342980c893a8653d4a0 already in progress: creating tablet
I20250625 14:01:57.682121 12953 tablet.cc:1722] T a25ceea16cbb4e339c2ebcc580c47270 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.683037 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (DEFAULT_TABLE table=default.Table_ec9c0bd54e0e441186096c7e11ccc198 [id=416264ede8644650b07f6c60ffb3cc52]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.683355 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e4cdf8f78d14c7d8ba3bda009d33719. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.686431 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.686746 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 628edde0bd0840c6a11c79f8ab810977 (DEFAULT_TABLE table=default.Table_eea10ee786c54ea6b76157e09be2b818 [id=f71426341d4c4fe0bd0342ea293e0110]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.687019 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628edde0bd0840c6a11c79f8ab810977. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.689267 11780 raft_consensus.cc:1273] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:57.689664 12052 raft_consensus.cc:1273] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:57.689894 12600 consensus_queue.cc:1035] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.690624 12600 consensus_queue.cc:1035] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.690893 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 07497399a6cd463f8d20d33d9db1d46b from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:57.691239 12985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:01:57.691577 12985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:01:57.691716 12985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250625 14:01:57.696592 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet da5ed5d8d3ca4342980c893a8653d4a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5ed5d8d3ca4342980c893a8653d4a0 already in progress: creating tablet
I20250625 14:01:57.697563 13023 tablet.cc:1722] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:01:57.698194 12985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20250625 14:01:57.698441 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 (DEFAULT_TABLE table=default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.698730 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c5e71b4a4f4efc81f822bdf95d0f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.699899 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 7491e070e86346b681817fb19d4608f9 (DEFAULT_TABLE table=default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.700162 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7491e070e86346b681817fb19d4608f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.700325 12985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:01:57.700379 12985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250625 14:01:57.700408 12985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250625 14:01:57.701079 11759 tablet_service.cc:1468] Processing CreateTablet for tablet f0833d0e013f48f78cb6c616481b5dce (DEFAULT_TABLE table=default.Table_d2eeb21d15424aa0a2f57b108f2028f3 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.701224 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 268638793ff44216aa0663b0a3568940 (DEFAULT_TABLE table=default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.701347 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0833d0e013f48f78cb6c616481b5dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.701495 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268638793ff44216aa0663b0a3568940. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.702523 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 268638793ff44216aa0663b0a3568940 (DEFAULT_TABLE table=default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.702793 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268638793ff44216aa0663b0a3568940. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.703467 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 7491e070e86346b681817fb19d4608f9 (DEFAULT_TABLE table=default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.703725 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7491e070e86346b681817fb19d4608f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.704003 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 7491e070e86346b681817fb19d4608f9 (DEFAULT_TABLE table=default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.704259 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7491e070e86346b681817fb19d4608f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.704274 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 (DEFAULT_TABLE table=default.Table_9b659d9df8f54c3b9d61bd3eb73083be [id=45522461146c457ebfe600569a8c8524]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.704491 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f651f79ee034dd28e44092b7de29bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.705068 12034 tablet_service.cc:1468] Processing CreateTablet for tablet f0833d0e013f48f78cb6c616481b5dce (DEFAULT_TABLE table=default.Table_d2eeb21d15424aa0a2f57b108f2028f3 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.705339 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0833d0e013f48f78cb6c616481b5dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.706184 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 (DEFAULT_TABLE table=default.Table_9b659d9df8f54c3b9d61bd3eb73083be [id=45522461146c457ebfe600569a8c8524]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.706445 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f651f79ee034dd28e44092b7de29bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.706605 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 5df4b218df7d4e4e9e634d3cd4f17633 (DEFAULT_TABLE table=default.Table_461a2c8f9109463899162260bcdb8f07 [id=6adcb3bc8e144f59bfe4d4f185b13a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.706846 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df4b218df7d4e4e9e634d3cd4f17633. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.707603 11893 tablet_service.cc:1468] Processing CreateTablet for tablet f0833d0e013f48f78cb6c616481b5dce (DEFAULT_TABLE table=default.Table_d2eeb21d15424aa0a2f57b108f2028f3 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.707913 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0833d0e013f48f78cb6c616481b5dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.708678 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 5df4b218df7d4e4e9e634d3cd4f17633 (DEFAULT_TABLE table=default.Table_461a2c8f9109463899162260bcdb8f07 [id=6adcb3bc8e144f59bfe4d4f185b13a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.708891 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df4b218df7d4e4e9e634d3cd4f17633. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.709568 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 (DEFAULT_TABLE table=default.Table_9b659d9df8f54c3b9d61bd3eb73083be [id=45522461146c457ebfe600569a8c8524]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.709795 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f651f79ee034dd28e44092b7de29bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.710193 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 268638793ff44216aa0663b0a3568940 (DEFAULT_TABLE table=default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.712143 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 (DEFAULT_TABLE table=default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.712399 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268638793ff44216aa0663b0a3568940. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.712714 12233 tablet.cc:1722] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.712815 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c5e71b4a4f4efc81f822bdf95d0f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.716138 12173 ts_tablet_manager.cc:1905] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.717900 12985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.188:43359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.39.188
--webserver_port=37561
--never_fsync=true
--heap_profile_path=/tmp/kudu.12985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:01:57.719691 12985 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:01:57.719695 12173 ts_tablet_manager.cc:1918] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.719774 12173 log.cc:1199] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/deee7c3fb5204c63a6618f628848bc81
I20250625 14:01:57.720017 12173 ts_tablet_manager.cc:1939] T deee7c3fb5204c63a6618f628848bc81 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.720798 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet deee7c3fb5204c63a6618f628848bc81 (table default.Table_e97f0540e97b415fa28869e09d50620e [id=ae16a007c35f4784b80230d2eb49b42c]) successfully deleted
I20250625 14:01:57.721428 12984 tablet.cc:1722] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.722219 12985 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250625 14:01:57.722679 12167 tablet_bootstrap.cc:492] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.722780 12167 ts_tablet_manager.cc:1397] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.002s
I20250625 14:01:57.723233 12167 raft_consensus.cc:357] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.723335 12167 raft_consensus.cc:383] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.723366 12167 raft_consensus.cc:738] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.723470 12167 consensus_queue.cc:260] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.723748 12167 ts_tablet_manager.cc:1428] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:57.723944 12167 tablet_bootstrap.cc:492] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.724589 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 5df4b218df7d4e4e9e634d3cd4f17633 (DEFAULT_TABLE table=default.Table_461a2c8f9109463899162260bcdb8f07 [id=6adcb3bc8e144f59bfe4d4f185b13a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.724884 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df4b218df7d4e4e9e634d3cd4f17633. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.724979 12167 tablet_bootstrap.cc:654] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.725255 12978 raft_consensus.cc:491] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.725332 12978 raft_consensus.cc:513] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.725683 12978 leader_election.cc:290] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.725907 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_12a1e16f6b284bbca04f3f1c10950265" } new_table_name: "default.Table_20ecabab91ef4823a1c5d7bebb38f37e" modify_external_catalogs: true
I20250625 14:01:57.726815 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5" } modify_external_catalogs: true
I20250625 14:01:57.726907 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5" } modify_external_catalogs: true
I20250625 14:01:57.727630 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_675a9837739b463fbb71d870eda3a3c2" } modify_external_catalogs: true
I20250625 14:01:57.727741 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_675a9837739b463fbb71d870eda3a3c2" } modify_external_catalogs: true
I20250625 14:01:57.727777 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d05b0f5a4b254c48b534779262ad0ac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.728214 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d05b0f5a4b254c48b534779262ad0ac4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.728516 11531 catalog_manager.cc:5582] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.728710 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 54f0be19f9134fa3a88ae867b108c7e8 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:01:57.728824 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a25ceea16cbb4e339c2ebcc580c47270 (table default.Table_d6d78f7d158248f6a25dc311131eed4d [id=ffe2f2ab5919440396e245783c966fd3]). Expected version 1 got 0
I20250625 14:01:57.729001 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6913356853b04dcdbb871b449e350ffb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.729324 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6913356853b04dcdbb871b449e350ffb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.732172 11993 leader_election.cc:343] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 5872bfb53bd04ac79d02f8d87a4ea090
W20250625 14:01:57.732779 11990 leader_election.cc:343] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 5872bfb53bd04ac79d02f8d87a4ea090
I20250625 14:01:57.732851 11990 leader_election.cc:304] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.732992 12666 raft_consensus.cc:2747] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.733337 12855 consensus_queue.cc:1035] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.734479 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b8bd92761b75460a9dbcf41b3a2a9a4b" } new_table_name: "default.Table_bb1104be50d8484ab10c1efe62b44b88" modify_external_catalogs: true
W20250625 14:01:57.736280 13027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:57.736757 13026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:01:57.737129 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.727640 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6e519c7cc312409181ac8bca5e400b80" } modify_external_catalogs: true
I20250625 14:01:57.737358 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6e519c7cc312409181ac8bca5e400b80" } modify_external_catalogs: true
I20250625 14:01:57.739948 11532 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1] alter complete (version 1)
I20250625 14:01:57.746834 12172 tablet_bootstrap.cc:492] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.746945 12172 ts_tablet_manager.cc:1397] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.186s user 0.003s sys 0.000s
I20250625 14:01:57.747457 12172 raft_consensus.cc:357] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.747592 12172 raft_consensus.cc:383] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.747634 12172 raft_consensus.cc:738] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.747764 12172 consensus_queue.cc:260] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.748066 12172 ts_tablet_manager.cc:1428] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.748271 12172 tablet_bootstrap.cc:492] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.749334 12172 tablet_bootstrap.cc:654] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.749876 12167 tablet_bootstrap.cc:492] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.750000 12167 ts_tablet_manager.cc:1397] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.002s
I20250625 14:01:57.750671 12167 raft_consensus.cc:357] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.750782 12167 raft_consensus.cc:383] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.750813 12167 raft_consensus.cc:738] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.750876 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 3a5c9b1852a847188bb7e2f08a37fded (DEFAULT_TABLE table=default.Table_af79ed183b6647f6a50aea9885a847b5 [id=5a145d86c3f740b2ab6d415ecddf5c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.750954 12167 consensus_queue.cc:260] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.751152 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5c9b1852a847188bb7e2f08a37fded. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.751226 12167 ts_tablet_manager.cc:1428] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.751407 12167 tablet_bootstrap.cc:492] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.752369 12167 tablet_bootstrap.cc:654] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.753520 12036 tablet_service.cc:1468] Processing CreateTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f (DEFAULT_TABLE table=default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.753775 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4eb86621bba4f3a897d4331ef30dc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.753769 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 3a5c9b1852a847188bb7e2f08a37fded (DEFAULT_TABLE table=default.Table_af79ed183b6647f6a50aea9885a847b5 [id=5a145d86c3f740b2ab6d415ecddf5c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.753825 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 07497399a6cd463f8d20d33d9db1d46b
I20250625 14:01:57.754066 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5c9b1852a847188bb7e2f08a37fded. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.754108 11528 catalog_manager.cc:6652] ReplaceTablet: tablet 07497399a6cd463f8d20d33d9db1d46b deleted and replaced by tablet ce6e907d627f4f3e8219eaabe4373c6e
I20250625 14:01:57.755082 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 07497399a6cd463f8d20d33d9db1d46b with delete_type TABLET_DATA_DELETED (replaced by tablet ce6e907d627f4f3e8219eaabe4373c6e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.756069 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 8d99e27063554845bea98bbe70eba3b9 (DEFAULT_TABLE table=default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.756345 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d99e27063554845bea98bbe70eba3b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.756495 11893 tablet_service.cc:1468] Processing CreateTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f (DEFAULT_TABLE table=default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.756696 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4eb86621bba4f3a897d4331ef30dc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.757688 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 8d99e27063554845bea98bbe70eba3b9 (DEFAULT_TABLE table=default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.757922 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d99e27063554845bea98bbe70eba3b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.758875 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet da5ed5d8d3ca4342980c893a8653d4a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5ed5d8d3ca4342980c893a8653d4a0 already in progress: creating tablet
W20250625 14:01:57.759093 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 07497399a6cd463f8d20d33d9db1d46b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07497399a6cd463f8d20d33d9db1d46b already in progress: creating tablet
I20250625 14:01:57.759110 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 288e0c1644a34b8dabc06ccdda9f0fa9 (DEFAULT_TABLE table=default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.759356 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 07497399a6cd463f8d20d33d9db1d46b with delete_type TABLET_DATA_DELETED (replaced by tablet ce6e907d627f4f3e8219eaabe4373c6e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.759575 12173 tablet_replica.cc:331] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.759630 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288e0c1644a34b8dabc06ccdda9f0fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.759794 12173 raft_consensus.cc:2241] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.759953 12173 raft_consensus.cc:2270] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.760918 12166 tablet_bootstrap.cc:492] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.761029 12166 ts_tablet_manager.cc:1397] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.178s user 0.002s sys 0.000s
I20250625 14:01:57.761546 12166 raft_consensus.cc:357] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.761653 12166 raft_consensus.cc:383] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.761689 12166 raft_consensus.cc:738] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.761690 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 3a5c9b1852a847188bb7e2f08a37fded (DEFAULT_TABLE table=default.Table_af79ed183b6647f6a50aea9885a847b5 [id=5a145d86c3f740b2ab6d415ecddf5c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.761813 12166 consensus_queue.cc:260] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.761922 12167 tablet_bootstrap.cc:492] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.761890 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 288e0c1644a34b8dabc06ccdda9f0fa9 (DEFAULT_TABLE table=default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.761986 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5c9b1852a847188bb7e2f08a37fded. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.762001 12167 ts_tablet_manager.cc:1397] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250625 14:01:57.762127 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288e0c1644a34b8dabc06ccdda9f0fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.762120 12166 ts_tablet_manager.cc:1428] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.762352 12166 tablet_bootstrap.cc:492] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.762516 12167 raft_consensus.cc:357] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.762612 12167 raft_consensus.cc:383] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.762640 12167 raft_consensus.cc:738] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.762751 12167 consensus_queue.cc:260] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.763010 12167 ts_tablet_manager.cc:1428] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.763203 12167 tablet_bootstrap.cc:492] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.763376 12166 tablet_bootstrap.cc:654] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.764199 12167 tablet_bootstrap.cc:654] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.764269 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 07497399a6cd463f8d20d33d9db1d46b with delete_type TABLET_DATA_DELETED (replaced by tablet ce6e907d627f4f3e8219eaabe4373c6e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.764381 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 8d99e27063554845bea98bbe70eba3b9 (DEFAULT_TABLE table=default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.764619 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d99e27063554845bea98bbe70eba3b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:57.764994 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 07497399a6cd463f8d20d33d9db1d46b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07497399a6cd463f8d20d33d9db1d46b already in progress: creating tablet
I20250625 14:01:57.765044 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 288e0c1644a34b8dabc06ccdda9f0fa9 (DEFAULT_TABLE table=default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.765285 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288e0c1644a34b8dabc06ccdda9f0fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.767076 12173 ts_tablet_manager.cc:1905] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.770287 12172 tablet_bootstrap.cc:492] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.770429 12172 ts_tablet_manager.cc:1397] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20250625 14:01:57.770913 12172 raft_consensus.cc:357] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.771030 12172 raft_consensus.cc:383] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.771070 12172 raft_consensus.cc:738] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.771198 12172 consensus_queue.cc:260] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.771507 12172 ts_tablet_manager.cc:1428] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:57.771687 12172 tablet_bootstrap.cc:492] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.772156 11759 tablet_service.cc:1468] Processing CreateTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f (DEFAULT_TABLE table=default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.772442 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4eb86621bba4f3a897d4331ef30dc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.773466 12173 ts_tablet_manager.cc:1918] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.773599 12173 log.cc:1199] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/5872bfb53bd04ac79d02f8d87a4ea090
I20250625 14:01:57.773865 12173 ts_tablet_manager.cc:1939] T 5872bfb53bd04ac79d02f8d87a4ea090 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.776460 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 5872bfb53bd04ac79d02f8d87a4ea090 (table default.Table_9aa153abf09346f4a92998fa6a4c1cb0 [id=f7e3bef19fc644cf89f008469f969c03]) successfully deleted
W20250625 14:01:57.776886 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e98a2085fe67479db141b2675f69a2d9 consensus state has no leader
I20250625 14:01:57.777204 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5f225879b77a4d1f8083b0a7f1929e36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.777602 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f225879b77a4d1f8083b0a7f1929e36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.778246 12172 tablet_bootstrap.cc:654] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.778498 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e1ad291ba0da4f3fa70aa9548ef71d01
I20250625 14:01:57.778890 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 1d596792632e4e32be161450f46b4168 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.778949 12166 tablet_bootstrap.cc:492] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.779060 12166 ts_tablet_manager.cc:1397] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:57.779117 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet fae1eddf1156499aa346502f7a200125
I20250625 14:01:57.779503 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a2e1af99f48646d3802559469c28096f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.779619 12166 raft_consensus.cc:357] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.779731 12166 raft_consensus.cc:383] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.779765 12166 raft_consensus.cc:738] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:57.779863 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2e1af99f48646d3802559469c28096f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.779886 12166 consensus_queue.cc:260] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.779960 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet f2f40caafd5e4557af321454d28fa2ab from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.780227 12166 ts_tablet_manager.cc:1428] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.780373 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 54f0be19f9134fa3a88ae867b108c7e8 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.780424 12166 tablet_bootstrap.cc:492] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.781421 12166 tablet_bootstrap.cc:654] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.781435 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet fae1eddf1156499aa346502f7a200125 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.781388 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.781705 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.783388 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet fae1eddf1156499aa346502f7a200125 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:57.783474 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet e1ad291ba0da4f3fa70aa9548ef71d01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1ad291ba0da4f3fa70aa9548ef71d01 already in progress: creating tablet
W20250625 14:01:57.783818 13029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:01:57.784451 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet fae1eddf1156499aa346502f7a200125 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae1eddf1156499aa346502f7a200125 already in progress: creating tablet
I20250625 14:01:57.786054 12052 raft_consensus.cc:3058] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:57.786554 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 07497399a6cd463f8d20d33d9db1d46b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07497399a6cd463f8d20d33d9db1d46b already in progress: creating tablet
I20250625 14:01:57.786891 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:57.786995 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet fae1eddf1156499aa346502f7a200125 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae1eddf1156499aa346502f7a200125 already in progress: creating tablet
I20250625 14:01:57.787560 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet fae1eddf1156499aa346502f7a200125 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.787636 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1df220bf9c8447c5ac4ad35a145a8796
W20250625 14:01:57.787892 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2f40caafd5e4557af321454d28fa2ab consensus state has no leader
W20250625 14:01:57.787957 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet e1ad291ba0da4f3fa70aa9548ef71d01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1ad291ba0da4f3fa70aa9548ef71d01 already in progress: creating tablet
I20250625 14:01:57.788035 12265 consensus_queue.cc:1035] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.788379 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.788641 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:57.789032 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1df220bf9c8447c5ac4ad35a145a8796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1df220bf9c8447c5ac4ad35a145a8796 already in progress: creating tablet
W20250625 14:01:57.789264 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet e1ad291ba0da4f3fa70aa9548ef71d01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1ad291ba0da4f3fa70aa9548ef71d01 already in progress: creating tablet
W20250625 14:01:57.789378 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet fae1eddf1156499aa346502f7a200125 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae1eddf1156499aa346502f7a200125 already in progress: creating tablet
I20250625 14:01:57.789835 12166 tablet_bootstrap.cc:492] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.789922 12166 ts_tablet_manager.cc:1397] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:57.789955 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:57.790459 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1df220bf9c8447c5ac4ad35a145a8796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1df220bf9c8447c5ac4ad35a145a8796 already in progress: creating tablet
I20250625 14:01:57.790470 12166 raft_consensus.cc:357] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.790570 12166 raft_consensus.cc:383] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.790602 12166 raft_consensus.cc:738] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.790717 12166 consensus_queue.cc:260] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:01:57.791602 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1df220bf9c8447c5ac4ad35a145a8796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1df220bf9c8447c5ac4ad35a145a8796 already in progress: creating tablet
I20250625 14:01:57.792346 12166 ts_tablet_manager.cc:1428] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:57.792583 12166 tablet_bootstrap.cc:492] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.794231 12600 consensus_queue.cc:1035] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.794652 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f2f40caafd5e4557af321454d28fa2ab
I20250625 14:01:57.794974 11527 catalog_manager.cc:6652] ReplaceTablet: tablet f2f40caafd5e4557af321454d28fa2ab deleted and replaced by tablet dfbf6959677547a6a2582b73b2be4c03
I20250625 14:01:57.795576 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 54f0be19f9134fa3a88ae867b108c7e8
I20250625 14:01:57.795851 11531 catalog_manager.cc:6652] ReplaceTablet: tablet 54f0be19f9134fa3a88ae867b108c7e8 deleted and replaced by tablet 7160c6353e2d48d8a5d5a71563797051
I20250625 14:01:57.796370 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f40caafd5e4557af321454d28fa2ab with delete_type TABLET_DATA_DELETED (replaced by tablet dfbf6959677547a6a2582b73b2be4c03) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.796756 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 54f0be19f9134fa3a88ae867b108c7e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7160c6353e2d48d8a5d5a71563797051) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.797128 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 54f0be19f9134fa3a88ae867b108c7e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7160c6353e2d48d8a5d5a71563797051) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.797863 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f40caafd5e4557af321454d28fa2ab with delete_type TABLET_DATA_DELETED (replaced by tablet dfbf6959677547a6a2582b73b2be4c03) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.798283 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f40caafd5e4557af321454d28fa2ab with delete_type TABLET_DATA_DELETED (replaced by tablet dfbf6959677547a6a2582b73b2be4c03) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.798890 12166 tablet_bootstrap.cc:654] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.799008 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f2f40caafd5e4557af321454d28fa2ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f40caafd5e4557af321454d28fa2ab already in progress: creating tablet
I20250625 14:01:57.799098 12175 tablet_replica.cc:331] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.799275 12175 raft_consensus.cc:2241] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:57.799468 12175 pending_rounds.cc:70] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:57.799515 12175 pending_rounds.cc:77] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523041911599104 op_type: NO_OP noop_request { }
I20250625 14:01:57.799592 12175 raft_consensus.cc:2887] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:57.799669 12175 raft_consensus.cc:2270] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.799736 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 54f0be19f9134fa3a88ae867b108c7e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7160c6353e2d48d8a5d5a71563797051) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.799914 12177 tablet_replica.cc:331] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.800051 12177 raft_consensus.cc:2241] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.800158 12177 raft_consensus.cc:2270] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.800545 12177 ts_tablet_manager.cc:1905] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.800769 12175 ts_tablet_manager.cc:1905] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.803506 12175 ts_tablet_manager.cc:1918] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:57.803558 12172 tablet_bootstrap.cc:492] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.803730 12172 ts_tablet_manager.cc:1397] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.001s
W20250625 14:01:57.803990 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f2f40caafd5e4557af321454d28fa2ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f40caafd5e4557af321454d28fa2ab already in progress: creating tablet
I20250625 14:01:57.803737 12177 ts_tablet_manager.cc:1918] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.804119 12985 server_base.cc:1048] running on GCE node
I20250625 14:01:57.804080 12175 log.cc:1199] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/54f0be19f9134fa3a88ae867b108c7e8
I20250625 14:01:57.804229 12177 log.cc:1199] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/54f0be19f9134fa3a88ae867b108c7e8
I20250625 14:01:57.804461 12177 ts_tablet_manager.cc:1939] T 54f0be19f9134fa3a88ae867b108c7e8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.804502 12175 ts_tablet_manager.cc:1939] T 54f0be19f9134fa3a88ae867b108c7e8 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.804922 12985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:01:57.805148 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 54f0be19f9134fa3a88ae867b108c7e8 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:57.805473 12172 raft_consensus.cc:357] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.805645 12172 raft_consensus.cc:383] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.805717 12172 raft_consensus.cc:738] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.805698 12173 tablet_replica.cc:331] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.805912 12172 consensus_queue.cc:260] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.806087 12173 raft_consensus.cc:2241] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.806211 12985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250625 14:01:57.806356 12173 raft_consensus.cc:2270] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.807513 12985 hybrid_clock.cc:648] HybridClock initialized: now 1750860117807458 us; error 74 us; skew 500 ppm
I20250625 14:01:57.808007 12172 ts_tablet_manager.cc:1428] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:01:57.808413 12172 tablet_bootstrap.cc:492] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.810019 12985 webserver.cc:469] Webserver started at http://127.11.39.188:37561/ using document root <none> and password file <none>
I20250625 14:01:57.810930 12985 fs_manager.cc:362] Metadata directory not provided
I20250625 14:01:57.811004 12985 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:01:57.811254 12172 tablet_bootstrap.cc:654] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.811686 12173 ts_tablet_manager.cc:1905] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.814043 12173 ts_tablet_manager.cc:1918] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.814108 12173 log.cc:1199] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/54f0be19f9134fa3a88ae867b108c7e8
I20250625 14:01:57.814301 12173 ts_tablet_manager.cc:1939] T 54f0be19f9134fa3a88ae867b108c7e8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.814390 12238 raft_consensus.cc:491] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.814503 12238 raft_consensus.cc:513] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.814875 12238 leader_election.cc:290] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.815379 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "975a71cb743443dc97228472e00b8c5c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.815433 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "975a71cb743443dc97228472e00b8c5c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.815547 11919 raft_consensus.cc:2466] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:57.815891 12208 raft_consensus.cc:491] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.815974 12208 raft_consensus.cc:513] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.816260 12208 leader_election.cc:290] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:57.816938 11717 leader_election.cc:343] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.817068 11717 leader_election.cc:304] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.817058 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e952a2f63ab4ff3bdebd62848e0c1b6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.817263 12208 raft_consensus.cc:2802] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.817312 12208 raft_consensus.cc:491] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.817348 12208 raft_consensus.cc:3058] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.817058 12167 tablet_bootstrap.cc:492] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.817476 12167 ts_tablet_manager.cc:1397] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.054s user 0.000s sys 0.002s
I20250625 14:01:57.817968 12167 raft_consensus.cc:357] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.818045 12167 raft_consensus.cc:383] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.818065 12167 raft_consensus.cc:738] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.818078 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e952a2f63ab4ff3bdebd62848e0c1b6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.818173 12167 consensus_queue.cc:260] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.818202 11920 raft_consensus.cc:2466] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:57.818464 12167 ts_tablet_manager.cc:1428] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.818452 12208 raft_consensus.cc:513] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.818620 12167 tablet_bootstrap.cc:492] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.818771 12208 leader_election.cc:290] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.805423 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 54f0be19f9134fa3a88ae867b108c7e8 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
I20250625 14:01:57.819070 11717 leader_election.cc:304] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.819083 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 54f0be19f9134fa3a88ae867b108c7e8 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]) successfully deleted
W20250625 14:01:57.819259 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f2f40caafd5e4557af321454d28fa2ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f40caafd5e4557af321454d28fa2ab already in progress: creating tablet
W20250625 14:01:57.819283 11717 leader_election.cc:343] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.819401 12238 raft_consensus.cc:2802] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.819445 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "975a71cb743443dc97228472e00b8c5c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.819478 12238 raft_consensus.cc:491] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.819528 12238 raft_consensus.cc:3058] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.819700 12167 tablet_bootstrap.cc:654] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.820258 11717 leader_election.cc:343] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.820521 12238 raft_consensus.cc:513] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.820868 12238 leader_election.cc:290] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.821310 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e952a2f63ab4ff3bdebd62848e0c1b6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:57.821429 11920 raft_consensus.cc:3058] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.821434 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9e952a2f63ab4ff3bdebd62848e0c1b6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:57.821729 11717 leader_election.cc:343] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.822481 11920 raft_consensus.cc:2466] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:57.822685 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "975a71cb743443dc97228472e00b8c5c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:57.822780 11919 raft_consensus.cc:3058] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.823446 12172 tablet_bootstrap.cc:492] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.823573 12172 ts_tablet_manager.cc:1397] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:57.823740 11919 raft_consensus.cc:2466] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:57.824045 11717 leader_election.cc:304] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.824234 12238 raft_consensus.cc:2802] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.824301 11717 leader_election.cc:304] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.824323 12238 raft_consensus.cc:695] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:57.824514 12238 consensus_queue.cc:237] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.824589 12894 raft_consensus.cc:2802] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.824678 12894 raft_consensus.cc:695] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:57.824817 12894 consensus_queue.cc:237] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.825248 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:57.825590 11532 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_892620871def4b818f36f2c0b4f1cbed [id=e1d9126672684e808d499d3902fc371b] alter complete (version 1)
I20250625 14:01:57.826165 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_d6d78f7d158248f6a25dc311131eed4d [id=ffe2f2ab5919440396e245783c966fd3] alter complete (version 1)
I20250625 14:01:57.826551 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 5872bfb53bd04ac79d02f8d87a4ea090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.826699 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f6116f7e64ae4e19863629a0e88a7265 with delete_type TABLET_DATA_DELETED (replaced by tablet 21f88f43067643dd80ec8a2f5fb370c1) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.827625 12985 fs_manager.cc:714] Time spent opening directory manager: real 0.015s user 0.003s sys 0.000s
I20250625 14:01:57.828320 12666 raft_consensus.cc:491] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.828410 12666 raft_consensus.cc:513] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.828758 12666 leader_election.cc:290] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.828799 12173 tablet_replica.cc:331] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.828926 12173 raft_consensus.cc:2241] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:01:57.829452 11517 catalog_manager.cc:4895] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5872bfb53bd04ac79d02f8d87a4ea090 because the tablet was not found. No further retry: Not found: Tablet not found: 5872bfb53bd04ac79d02f8d87a4ea090
I20250625 14:01:57.829815 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "339813cd0c194f07bfc4edefd6a05ef3" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.829972 11919 raft_consensus.cc:2391] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:57.830657 11528 catalog_manager.cc:5582] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:57.830814 12166 tablet_bootstrap.cc:492] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.829036 12173 raft_consensus.cc:2270] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.830902 12166 ts_tablet_manager.cc:1397] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20250625 14:01:57.830891 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (table default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]). Expected version 2 got 0
I20250625 14:01:57.831001 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]). Expected version 1 got 0
I20250625 14:01:57.831100 11528 catalog_manager.cc:5582] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:57.831187 12172 raft_consensus.cc:357] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.831282 12172 raft_consensus.cc:383] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.831315 12172 raft_consensus.cc:738] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.831343 12166 raft_consensus.cc:357] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.831434 12166 raft_consensus.cc:383] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.831465 12166 raft_consensus.cc:738] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.831439 12172 consensus_queue.cc:260] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.831584 12166 consensus_queue.cc:260] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.831851 12166 ts_tablet_manager.cc:1428] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.832046 12166 tablet_bootstrap.cc:492] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.833014 12166 tablet_bootstrap.cc:654] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.833178 13049 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:01:57.834476 12985 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:57.834508 12172 ts_tablet_manager.cc:1428] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20250625 14:01:57.834550 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_89bc204107184f1aae8f924ca65ecd16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.834586 12985 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99"
format_stamp: "Formatted at 2025-06-25 14:01:51 on dist-test-slave-b81v"
I20250625 14:01:57.835076 12985 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:01:57.835604 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_21b55de037b74cc69101bc65ec02bb76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.836043 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d996cc697ed246c7b1118cdd14e3450c" } modify_external_catalogs: true
I20250625 14:01:57.836144 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d996cc697ed246c7b1118cdd14e3450c" } modify_external_catalogs: true
I20250625 14:01:57.837342 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a2678af522f74fa496589e5ff1f44a52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.837735 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_75eefac2950f498d963162a9e06305c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.838014 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75eefac2950f498d963162a9e06305c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.838153 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21b55de037b74cc69101bc65ec02bb76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.838421 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89bc204107184f1aae8f924ca65ecd16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.840039 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2678af522f74fa496589e5ff1f44a52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.841739 12173 ts_tablet_manager.cc:1905] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.842135 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1d596792632e4e32be161450f46b4168
I20250625 14:01:57.842820 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d596792632e4e32be161450f46b4168 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fd261d824c34864a7b15e4736254062) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.843601 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 1d596792632e4e32be161450f46b4168 deleted and replaced by tablet 1fd261d824c34864a7b15e4736254062
I20250625 14:01:57.844875 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "339813cd0c194f07bfc4edefd6a05ef3" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.845352 12172 tablet_bootstrap.cc:492] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:57.846390 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d596792632e4e32be161450f46b4168 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fd261d824c34864a7b15e4736254062) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:57.847162 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1d596792632e4e32be161450f46b4168 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d596792632e4e32be161450f46b4168 already in progress: creating tablet
I20250625 14:01:57.847307 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d596792632e4e32be161450f46b4168 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fd261d824c34864a7b15e4736254062) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.847574 12172 tablet_bootstrap.cc:654] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:57.849104 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1d596792632e4e32be161450f46b4168 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d596792632e4e32be161450f46b4168 already in progress: creating tablet
I20250625 14:01:57.850474 11993 leader_election.cc:304] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.850849 12666 raft_consensus.cc:3058] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.851989 12666 raft_consensus.cc:2747] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.853073 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a4199634a8be4e359cc9707d4754cac9
I20250625 14:01:57.853756 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet a4199634a8be4e359cc9707d4754cac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.853928 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet a4199634a8be4e359cc9707d4754cac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.854288 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet a4199634a8be4e359cc9707d4754cac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:57.854489 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a4199634a8be4e359cc9707d4754cac9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4199634a8be4e359cc9707d4754cac9 already in progress: creating tablet
W20250625 14:01:57.854863 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a4199634a8be4e359cc9707d4754cac9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4199634a8be4e359cc9707d4754cac9 already in progress: creating tablet
I20250625 14:01:57.855683 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:57.856709 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (table default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]). Expected version 2 got 0
I20250625 14:01:57.856807 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]). Expected version 1 got 0
I20250625 14:01:57.857873 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 8615e96c59474da5ae6214402aba4a46 with delete_type TABLET_DATA_DELETED (replaced by tablet 54a59027aef04a12a0bf1fbece3c3161) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:57.858131 11717 consensus_peers.cc:487] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:57.858232 11919 raft_consensus.cc:1273] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:57.858760 12855 consensus_queue.cc:1035] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.860169 12173 ts_tablet_manager.cc:1918] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.860265 12173 log.cc:1199] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f6116f7e64ae4e19863629a0e88a7265
I20250625 14:01:57.860517 12173 ts_tablet_manager.cc:1939] T f6116f7e64ae4e19863629a0e88a7265 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.860888 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]). Expected version 1 got 0
W20250625 14:01:57.861220 11517 catalog_manager.cc:5001] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): alter failed for tablet 54f0be19f9134fa3a88ae867b108c7e8 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]),no further retry: Not found: Tablet not found: 54f0be19f9134fa3a88ae867b108c7e8
I20250625 14:01:57.862715 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 9cb56a7e714d45038feaf1132a5e06af (DEFAULT_TABLE table=default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.863003 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb56a7e714d45038feaf1132a5e06af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.864912 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (table default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]). Expected version 2 got 0
I20250625 14:01:57.865401 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 9cb56a7e714d45038feaf1132a5e06af (DEFAULT_TABLE table=default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.865674 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb56a7e714d45038feaf1132a5e06af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.867024 12173 tablet_replica.cc:331] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:57.867204 12173 raft_consensus.cc:2241] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.867357 12173 raft_consensus.cc:2270] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.868952 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f6116f7e64ae4e19863629a0e88a7265 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]) successfully deleted
W20250625 14:01:57.869122 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1d596792632e4e32be161450f46b4168 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d596792632e4e32be161450f46b4168 already in progress: creating tablet
W20250625 14:01:57.869235 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a4199634a8be4e359cc9707d4754cac9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4199634a8be4e359cc9707d4754cac9 already in progress: creating tablet
I20250625 14:01:57.870165 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 7ff70668bede407c816db9779ce5221d (DEFAULT_TABLE table=default.Table_dab2b89c092c432f989c600f2f724b87 [id=f35c972d51bd4a3b9ea74dd70cad5913]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.870018 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 8578d07c9b4a44f887b5a30e92c1ede9 (DEFAULT_TABLE table=default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.870225 12034 tablet_service.cc:1468] Processing CreateTablet for tablet f2576ff766494c37b316552a66a5ff31 (DEFAULT_TABLE table=default.Table_47a020733f644c45b54865bbd14ff779 [id=4ca78651d63b411b83d97f628dbf849d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.870325 12030 tablet_service.cc:1468] Processing CreateTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 (DEFAULT_TABLE table=default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.869992 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (DEFAULT_TABLE table=default.Table_31edada7a2d04160be101b2220c0ef52 [id=e7ebeba1d0f34f71a4ef5a47014496fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.870165 12027 tablet_service.cc:1468] Processing CreateTablet for tablet e2f30f99bdda41dba6960ffdeb69226b (DEFAULT_TABLE table=default.Table_ac54984290b448d798b8dc1483e17753 [id=b4161fc469f44b44bd91470950c06cd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.870558 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff70668bede407c816db9779ce5221d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.870672 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f30f99bdda41dba6960ffdeb69226b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.870769 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.870925 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd (DEFAULT_TABLE table=default.Table_02b107aff218434e8b66fde53ea34376 [id=db5d1d3ff141472b901e2930ccc829df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.871129 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4317c3460f664f32aeb9b25ffb57d5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.871913 12167 tablet_bootstrap.cc:492] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.871999 12167 ts_tablet_manager.cc:1397] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20250625 14:01:57.872522 12167 raft_consensus.cc:357] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.872627 12167 raft_consensus.cc:383] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.872668 12167 raft_consensus.cc:738] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.872805 12167 consensus_queue.cc:260] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.873106 12167 ts_tablet_manager.cc:1428] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.873063 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 806e5502a95e4a0396c008267e16f2d5 (DEFAULT_TABLE table=default.Table_2eb9e374034c42209d4317d0232bc806 [id=2b820ab8a4944bdd9b3e272975715817]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.873077 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8578d07c9b4a44f887b5a30e92c1ede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.873296 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 806e5502a95e4a0396c008267e16f2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.873319 12167 tablet_bootstrap.cc:492] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.873412 12033 tablet_service.cc:1468] Processing CreateTablet for tablet b08135db764c4eb286d5f67ccba94ed5 (DEFAULT_TABLE table=default.Table_a3683a01c05249f7a1e658d430e0edd7 [id=44f2f74bfee54c72b3dee93db46b35e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.873606 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08135db764c4eb286d5f67ccba94ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.875384 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2576ff766494c37b316552a66a5ff31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.873322 12029 tablet_service.cc:1468] Processing CreateTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e (DEFAULT_TABLE table=default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.875555 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6e907d627f4f3e8219eaabe4373c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.875857 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6318e27fb194a209c1c80ffcaf24a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.881610 11899 tablet_service.cc:1468] Processing CreateTablet for tablet dff6358de0e4446e8dfc9465180ba395 (DEFAULT_TABLE table=default.Table_26cf2e4d1ba540b29a77b71d12a03688 [id=fd3941c6a70a48ac98571ef67bd9c5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.881749 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (DEFAULT_TABLE table=default.Table_31edada7a2d04160be101b2220c0ef52 [id=e7ebeba1d0f34f71a4ef5a47014496fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.881793 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 8578d07c9b4a44f887b5a30e92c1ede9 (DEFAULT_TABLE table=default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.881960 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 9cb56a7e714d45038feaf1132a5e06af (DEFAULT_TABLE table=default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.882071 11900 tablet_service.cc:1468] Processing CreateTablet for tablet f2576ff766494c37b316552a66a5ff31 (DEFAULT_TABLE table=default.Table_47a020733f644c45b54865bbd14ff779 [id=4ca78651d63b411b83d97f628dbf849d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.881969 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff6358de0e4446e8dfc9465180ba395. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.882203 11896 tablet_service.cc:1468] Processing CreateTablet for tablet e2f30f99bdda41dba6960ffdeb69226b (DEFAULT_TABLE table=default.Table_ac54984290b448d798b8dc1483e17753 [id=b4161fc469f44b44bd91470950c06cd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.882436 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f30f99bdda41dba6960ffdeb69226b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.882413 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd (DEFAULT_TABLE table=default.Table_02b107aff218434e8b66fde53ea34376 [id=db5d1d3ff141472b901e2930ccc829df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.882572 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb56a7e714d45038feaf1132a5e06af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.882685 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8578d07c9b4a44f887b5a30e92c1ede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.882714 11897 tablet_service.cc:1468] Processing CreateTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e (DEFAULT_TABLE table=default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.882736 11890 tablet_service.cc:1468] Processing CreateTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 (DEFAULT_TABLE table=default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.882086 11901 tablet_service.cc:1468] Processing CreateTablet for tablet b08135db764c4eb286d5f67ccba94ed5 (DEFAULT_TABLE table=default.Table_a3683a01c05249f7a1e658d430e0edd7 [id=44f2f74bfee54c72b3dee93db46b35e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.882954 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6318e27fb194a209c1c80ffcaf24a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.881629 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 7ff70668bede407c816db9779ce5221d (DEFAULT_TABLE table=default.Table_dab2b89c092c432f989c600f2f724b87 [id=f35c972d51bd4a3b9ea74dd70cad5913]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.883206 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff70668bede407c816db9779ce5221d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.885061 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 806e5502a95e4a0396c008267e16f2d5 (DEFAULT_TABLE table=default.Table_2eb9e374034c42209d4317d0232bc806 [id=2b820ab8a4944bdd9b3e272975715817]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.885071 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.885313 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 806e5502a95e4a0396c008267e16f2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.885412 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4317c3460f664f32aeb9b25ffb57d5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.885743 12666 raft_consensus.cc:491] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.885833 12666 raft_consensus.cc:513] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.886256 12666 leader_election.cc:290] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.887373 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb0b1a9a04ca4911b5f6e441d0239977" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.887657 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08135db764c4eb286d5f67ccba94ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.889467 11754 tablet_service.cc:1468] Processing CreateTablet for tablet f2576ff766494c37b316552a66a5ff31 (DEFAULT_TABLE table=default.Table_47a020733f644c45b54865bbd14ff779 [id=4ca78651d63b411b83d97f628dbf849d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.889786 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2576ff766494c37b316552a66a5ff31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.889880 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2576ff766494c37b316552a66a5ff31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.890108 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_31edada7a2d04160be101b2220c0ef52" } new_table_name: "default.Table_0f91da2014a744bcafd6f43bd719b371" modify_external_catalogs: true
I20250625 14:01:57.889467 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 7ff70668bede407c816db9779ce5221d (DEFAULT_TABLE table=default.Table_dab2b89c092c432f989c600f2f724b87 [id=f35c972d51bd4a3b9ea74dd70cad5913]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.890583 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff70668bede407c816db9779ce5221d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.891151 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_900afa9784ef451eaa2d34e700b4276b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.891534 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_900afa9784ef451eaa2d34e700b4276b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.889736 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (DEFAULT_TABLE table=default.Table_31edada7a2d04160be101b2220c0ef52 [id=e7ebeba1d0f34f71a4ef5a47014496fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.891866 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.892310 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_37908936fde84cea9245460dac5d2283" } modify_external_catalogs: true
I20250625 14:01:57.892393 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_37908936fde84cea9245460dac5d2283" } modify_external_catalogs: true
I20250625 14:01:57.893097 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2eb9e374034c42209d4317d0232bc806" } new_table_name: "default.Table_5f35471d262d448ea3ab37e9d47ecc88" modify_external_catalogs: true
I20250625 14:01:57.893932 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_eea10ee786c54ea6b76157e09be2b818" } new_table_name: "default.Table_522af79c54de47dca6f8f5b92399167d" modify_external_catalogs: true
I20250625 14:01:57.893965 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6e907d627f4f3e8219eaabe4373c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.894011 12037 tablet_service.cc:1468] Processing CreateTablet for tablet dff6358de0e4446e8dfc9465180ba395 (DEFAULT_TABLE table=default.Table_26cf2e4d1ba540b29a77b71d12a03688 [id=fd3941c6a70a48ac98571ef67bd9c5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.894294 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff6358de0e4446e8dfc9465180ba395. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.895016 11762 tablet_service.cc:1468] Processing CreateTablet for tablet e2f30f99bdda41dba6960ffdeb69226b (DEFAULT_TABLE table=default.Table_ac54984290b448d798b8dc1483e17753 [id=b4161fc469f44b44bd91470950c06cd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.895210 11754 tablet_service.cc:1468] Processing CreateTablet for tablet b08135db764c4eb286d5f67ccba94ed5 (DEFAULT_TABLE table=default.Table_a3683a01c05249f7a1e658d430e0edd7 [id=44f2f74bfee54c72b3dee93db46b35e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.895241 11757 tablet_service.cc:1468] Processing CreateTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e (DEFAULT_TABLE table=default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.895390 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 806e5502a95e4a0396c008267e16f2d5 (DEFAULT_TABLE table=default.Table_2eb9e374034c42209d4317d0232bc806 [id=2b820ab8a4944bdd9b3e272975715817]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.895249 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f30f99bdda41dba6960ffdeb69226b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.895605 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.895718 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6e907d627f4f3e8219eaabe4373c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.895805 12177 tablet_replica.cc:331] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.895879 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 806e5502a95e4a0396c008267e16f2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.895938 12177 raft_consensus.cc:2241] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.896034 12177 raft_consensus.cc:2270] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.896045 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a0513f1c1050428aafc99329d1115a93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.896191 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 8578d07c9b4a44f887b5a30e92c1ede9 (DEFAULT_TABLE table=default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:57.896386 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0513f1c1050428aafc99329d1115a93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.896411 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8578d07c9b4a44f887b5a30e92c1ede9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.895531 11759 tablet_service.cc:1468] Processing CreateTablet for tablet dff6358de0e4446e8dfc9465180ba395 (DEFAULT_TABLE table=default.Table_26cf2e4d1ba540b29a77b71d12a03688 [id=fd3941c6a70a48ac98571ef67bd9c5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.898253 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff6358de0e4446e8dfc9465180ba395. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.898468 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cb0b1a9a04ca4911b5f6e441d0239977" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.898814 11755 tablet_service.cc:1468] Processing CreateTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 (DEFAULT_TABLE table=default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.899022 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6318e27fb194a209c1c80ffcaf24a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.899631 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet b949191f6218463192890e13ccf6b17e from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.900386 12166 tablet_bootstrap.cc:492] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.900377 12177 ts_tablet_manager.cc:1905] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.900472 12166 ts_tablet_manager.cc:1397] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.068s user 0.001s sys 0.000s
I20250625 14:01:57.900952 12166 raft_consensus.cc:357] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.901068 12166 raft_consensus.cc:383] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.901098 12166 raft_consensus.cc:738] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.901219 12166 consensus_queue.cc:260] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.901531 12166 ts_tablet_manager.cc:1428] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:57.901767 12166 tablet_bootstrap.cc:492] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.902830 12166 tablet_bootstrap.cc:654] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.902846 11990 leader_election.cc:304] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:57.903131 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b08135db764c4eb286d5f67ccba94ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.904541 12666 raft_consensus.cc:2747] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:57.905236 12177 ts_tablet_manager.cc:1918] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.905304 12177 log.cc:1199] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8feddd83af08466ea11c4a15a08d3c8b
I20250625 14:01:57.905524 12177 ts_tablet_manager.cc:1939] T 8feddd83af08466ea11c4a15a08d3c8b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.907239 12167 tablet_bootstrap.cc:654] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.907740 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a25ceea16cbb4e339c2ebcc580c47270 (table default.Table_d6d78f7d158248f6a25dc311131eed4d [id=ffe2f2ab5919440396e245783c966fd3]). Expected version 1 got 0
I20250625 14:01:57.907763 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8feddd83af08466ea11c4a15a08d3c8b (table default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]) successfully deleted
I20250625 14:01:57.910192 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd (DEFAULT_TABLE table=default.Table_02b107aff218434e8b66fde53ea34376 [id=db5d1d3ff141472b901e2930ccc829df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.910703 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4317c3460f664f32aeb9b25ffb57d5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.915095 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 (DEFAULT_TABLE table=default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.915691 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 (DEFAULT_TABLE table=default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.915962 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a59027aef04a12a0bf1fbece3c3161. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.916448 12166 tablet_bootstrap.cc:492] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.916602 12166 ts_tablet_manager.cc:1397] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:57.917511 12166 raft_consensus.cc:357] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.917837 12166 raft_consensus.cc:383] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.917977 12166 raft_consensus.cc:738] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.918371 12166 consensus_queue.cc:260] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.918792 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a59027aef04a12a0bf1fbece3c3161. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.919826 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 3faa8782ba0d45dbbd89437685a64aef (DEFAULT_TABLE table=default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 [id=492a3d0d7a8e44a9a4e12606ef07a9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.920117 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faa8782ba0d45dbbd89437685a64aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.921838 12167 tablet_bootstrap.cc:492] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.921924 12167 ts_tablet_manager.cc:1397] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20250625 14:01:57.922405 12167 raft_consensus.cc:357] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.922501 12167 raft_consensus.cc:383] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.922533 12167 raft_consensus.cc:738] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.922653 12167 consensus_queue.cc:260] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.922706 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 3faa8782ba0d45dbbd89437685a64aef (DEFAULT_TABLE table=default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 [id=492a3d0d7a8e44a9a4e12606ef07a9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.922930 12167 ts_tablet_manager.cc:1428] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:57.923012 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faa8782ba0d45dbbd89437685a64aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.923357 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 3faa8782ba0d45dbbd89437685a64aef (DEFAULT_TABLE table=default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 [id=492a3d0d7a8e44a9a4e12606ef07a9fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.923625 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faa8782ba0d45dbbd89437685a64aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.925062 12166 ts_tablet_manager.cc:1428] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:01:57.926092 12167 tablet_bootstrap.cc:492] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.925856 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 (DEFAULT_TABLE table=default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:57.927001 12167 tablet_bootstrap.cc:654] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.928103 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a59027aef04a12a0bf1fbece3c3161. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:57.933606 12166 tablet_bootstrap.cc:492] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:57.933782 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cfcb08ddbdd43dd92472dcbdc772a2d consensus state has no leader
I20250625 14:01:57.937456 12052 raft_consensus.cc:3058] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.938731 12166 tablet_bootstrap.cc:654] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.940397 12984 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:57.942175 12166 tablet_bootstrap.cc:492] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:57.942449 12166 ts_tablet_manager.cc:1397] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
I20250625 14:01:57.943322 12166 raft_consensus.cc:357] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.943596 12166 raft_consensus.cc:383] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.943713 12166 raft_consensus.cc:738] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.944005 12166 consensus_queue.cc:260] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.944047 11533 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 96ec205b0f31484a91054fedf619b9ab (table default.Table_6c025a609dc74d37a082a5050f756463 [id=62132df62b3a42fb9886592b9b885d31]). Expected version 1 got 0
I20250625 14:01:57.948181 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc443822d504733b5d67e212020df0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.949852 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet cb0b1a9a04ca4911b5f6e441d0239977
W20250625 14:01:57.950428 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 806e5502a95e4a0396c008267e16f2d5 consensus state has no leader
W20250625 14:01:57.950695 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 628edde0bd0840c6a11c79f8ab810977 consensus state has no leader
I20250625 14:01:57.951503 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet cb0b1a9a04ca4911b5f6e441d0239977 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:57.951732 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1dc443822d504733b5d67e212020df0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1dc443822d504733b5d67e212020df0e already in progress: creating tablet
I20250625 14:01:57.951926 12166 ts_tablet_manager.cc:1428] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20250625 14:01:57.952198 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet cb0b1a9a04ca4911b5f6e441d0239977 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.952389 12175 tablet_replica.cc:331] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.952528 12175 raft_consensus.cc:2241] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.952636 12175 raft_consensus.cc:2270] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.952996 12855 raft_consensus.cc:491] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.953094 12855 raft_consensus.cc:513] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.953420 12175 ts_tablet_manager.cc:1905] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.953497 12855 leader_election.cc:290] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.954921 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet cb0b1a9a04ca4911b5f6e441d0239977 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:57.955113 12177 tablet_replica.cc:331] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:57.955237 12177 raft_consensus.cc:2241] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:57.955215 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9ed251f36e34e33b35489e9c0c45f9d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.955439 12177 raft_consensus.cc:2270] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.955562 12053 raft_consensus.cc:3058] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.955788 12233 tablet.cc:1722] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:57.956436 12177 ts_tablet_manager.cc:1905] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.956454 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9ed251f36e34e33b35489e9c0c45f9d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.956570 11919 raft_consensus.cc:2466] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:57.957113 12175 ts_tablet_manager.cc:1918] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:57.957177 12175 log.cc:1199] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/cb0b1a9a04ca4911b5f6e441d0239977
I20250625 14:01:57.958890 12177 ts_tablet_manager.cc:1918] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:57.958973 12177 log.cc:1199] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/cb0b1a9a04ca4911b5f6e441d0239977
I20250625 14:01:57.959226 12177 ts_tablet_manager.cc:1939] T cb0b1a9a04ca4911b5f6e441d0239977 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:57.959671 12558 raft_consensus.cc:491] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.959761 12558 raft_consensus.cc:513] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.960141 12558 leader_election.cc:290] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.960299 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.960422 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0547992986704a949305e7c5d014b965" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.960462 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0547992986704a949305e7c5d014b965" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.960570 12175 ts_tablet_manager.cc:1939] T cb0b1a9a04ca4911b5f6e441d0239977 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.960577 11780 raft_consensus.cc:2466] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:57.960783 12953 tablet.cc:1722] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:57.960927 11858 leader_election.cc:304] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:57.961325 11855 leader_election.cc:343] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:57.961458 11717 leader_election.cc:343] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.961593 11717 leader_election.cc:304] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:57.961741 12894 raft_consensus.cc:2802] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.961789 12894 raft_consensus.cc:491] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.961833 12894 raft_consensus.cc:3058] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.962386 12558 raft_consensus.cc:2802] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.962443 12558 raft_consensus.cc:491] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.962486 12558 raft_consensus.cc:3058] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.962740 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a25ceea16cbb4e339c2ebcc580c47270 (table default.Table_d6d78f7d158248f6a25dc311131eed4d [id=ffe2f2ab5919440396e245783c966fd3]). Expected version 1 got 0
I20250625 14:01:57.962884 12894 raft_consensus.cc:513] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.963217 12894 leader_election.cc:290] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:57.963500 12558 raft_consensus.cc:513] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.963881 12558 leader_election.cc:290] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.964355 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0547992986704a949305e7c5d014b965" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:57.964463 11780 raft_consensus.cc:3058] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.965430 11780 raft_consensus.cc:2466] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:57.966559 11858 leader_election.cc:304] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.966681 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0547992986704a949305e7c5d014b965" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:57.967068 11855 leader_election.cc:343] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.967234 12175 tablet_replica.cc:331] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.967381 12175 raft_consensus.cc:2241] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.967473 12175 raft_consensus.cc:2270] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:57.967586 12558 raft_consensus.cc:2802] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.967649 12558 raft_consensus.cc:695] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:57.967762 12558 consensus_queue.cc:237] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:57.969355 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9ed251f36e34e33b35489e9c0c45f9d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:57.969470 11921 raft_consensus.cc:3058] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.970557 11921 raft_consensus.cc:2466] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:57.971050 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d9ed251f36e34e33b35489e9c0c45f9d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.972972 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet cb0b1a9a04ca4911b5f6e441d0239977 (table default.Table_37908936fde84cea9245460dac5d2283 [id=7ebc2c88eb074eb598b2cfda5e4e81bc]) successfully deleted
I20250625 14:01:57.972961 12600 raft_consensus.cc:491] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.973110 12600 raft_consensus.cc:513] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.973526 12600 leader_election.cc:290] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.975310 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "21f88f43067643dd80ec8a2f5fb370c1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:57.975451 11780 raft_consensus.cc:2466] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:57.976238 11858 leader_election.cc:304] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.976307 12985 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250625 14:01:57.976428 12600 raft_consensus.cc:2802] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:57.976415 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "21f88f43067643dd80ec8a2f5fb370c1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:57.976475 12600 raft_consensus.cc:491] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:57.976509 12600 raft_consensus.cc:3058] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:57.976800 11855 leader_election.cc:343] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.977522 12600 raft_consensus.cc:513] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.977869 12600 leader_election.cc:290] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:57.977960 12167 tablet_bootstrap.cc:492] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:57.978055 12167 ts_tablet_manager.cc:1397] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.000s
I20250625 14:01:57.978641 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet ee3cc1074818466a97d04f0136eaea92 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:57.978668 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet cb0b1a9a04ca4911b5f6e441d0239977 (table default.Table_37908936fde84cea9245460dac5d2283 [id=7ebc2c88eb074eb598b2cfda5e4e81bc]) successfully deleted
I20250625 14:01:57.978735 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a3683a01c05249f7a1e658d430e0edd7" } new_table_name: "default.Table_8450608283364602aa9455be1d9e58fd" modify_external_catalogs: true
I20250625 14:01:57.979354 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "21f88f43067643dd80ec8a2f5fb370c1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:57.979404 12985 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:01:57.979475 11780 raft_consensus.cc:3058] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:57.979586 12985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:01:57.978605 12167 raft_consensus.cc:357] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.979662 12167 raft_consensus.cc:383] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.979701 12167 raft_consensus.cc:738] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.979732 12175 ts_tablet_manager.cc:1905] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.979815 12167 consensus_queue.cc:260] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.980445 12978 raft_consensus.cc:491] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:57.980530 12978 raft_consensus.cc:513] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.980572 11780 raft_consensus.cc:2466] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:57.980818 12167 ts_tablet_manager.cc:1428] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:01:57.980881 12978 leader_election.cc:290] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:57.981020 12167 tablet_bootstrap.cc:492] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:57.981546 11858 leader_election.cc:304] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:57.981702 12600 raft_consensus.cc:2802] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:57.981762 12600 raft_consensus.cc:695] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:57.981882 12600 consensus_queue.cc:237] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:57.981973 12167 tablet_bootstrap.cc:654] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:57.984364 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b] alter complete (version 2)
I20250625 14:01:57.985350 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "21f88f43067643dd80ec8a2f5fb370c1" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:57.986670 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb1d6934ab98482c9ae6b6cafc1ee9a6" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:57.986958 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_26cf2e4d1ba540b29a77b71d12a03688" } modify_external_catalogs: true
I20250625 14:01:57.987020 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_11b1368ec2c3492eb0d0476a28bd925c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:57.987071 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_26cf2e4d1ba540b29a77b71d12a03688" } modify_external_catalogs: true
I20250625 14:01:57.987814 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_740cd4b264aa4d3baf5d5c296a06cd43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:57.988178 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_740cd4b264aa4d3baf5d5c296a06cd43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:57.988274 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11b1368ec2c3492eb0d0476a28bd925c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:57.986828 11921 raft_consensus.cc:2391] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:57.989118 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ac11fbf6c80047a78d8983642c8746dc" } modify_external_catalogs: true
I20250625 14:01:57.989212 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ac11fbf6c80047a78d8983642c8746dc" } modify_external_catalogs: true
W20250625 14:01:57.988071 11855 leader_election.cc:343] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:57.988847 12166 tablet_bootstrap.cc:492] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:57.991700 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8641654309e1491691b376a5cb7b52cc" } modify_external_catalogs: true
I20250625 14:01:57.991739 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e7750b507fd741bda3ad151860391100" } new_table_name: "default.Table_899a1eb5d58f478a87063fafb95aa819" modify_external_catalogs: true
I20250625 14:01:57.991804 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8641654309e1491691b376a5cb7b52cc" } modify_external_catalogs: true
I20250625 14:01:57.993417 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 7cd1672cf1164e469a862c5b43ec6f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:57.994417 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc443822d504733b5d67e212020df0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:57.995368 12173 ts_tablet_manager.cc:1905] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:57.995460 12600 consensus_queue.cc:1035] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:57.997917 12173 ts_tablet_manager.cc:1918] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.997994 12173 log.cc:1199] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8615e96c59474da5ae6214402aba4a46
I20250625 14:01:57.998239 12175 ts_tablet_manager.cc:1918] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:57.998355 12175 log.cc:1199] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8feddd83af08466ea11c4a15a08d3c8b
I20250625 14:01:57.998391 12172 tablet_bootstrap.cc:492] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:57.998493 12172 ts_tablet_manager.cc:1397] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.000s
I20250625 14:01:57.998592 12175 ts_tablet_manager.cc:1939] T 8feddd83af08466ea11c4a15a08d3c8b P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:57.998610 12173 ts_tablet_manager.cc:1939] T 8615e96c59474da5ae6214402aba4a46 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:57.999068 12172 raft_consensus.cc:357] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:57.999176 12172 raft_consensus.cc:383] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:57.999204 12172 raft_consensus.cc:738] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:57.999293 12175 tablet_replica.cc:331] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:57.999464 12175 raft_consensus.cc:2241] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:57.999565 12175 raft_consensus.cc:2270] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:57.999894 11855 consensus_peers.cc:487] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:58.000160 12173 tablet_replica.cc:331] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.000384 12173 raft_consensus.cc:2241] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.000464 12166 tablet_bootstrap.cc:654] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.000558 12173 raft_consensus.cc:2270] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.000792 12984 tablet.cc:1722] T a25ceea16cbb4e339c2ebcc580c47270 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.000890 12985 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.188:43359
I20250625 14:01:58.002013 12173 ts_tablet_manager.cc:1905] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.003526 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_aed5f4ab57624e84b4109fefaa440e45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.003997 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aed5f4ab57624e84b4109fefaa440e45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.004395 12173 ts_tablet_manager.cc:1918] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.004457 12173 log.cc:1199] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/cb0b1a9a04ca4911b5f6e441d0239977
I20250625 14:01:58.004662 12173 ts_tablet_manager.cc:1939] T cb0b1a9a04ca4911b5f6e441d0239977 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.004676 12175 ts_tablet_manager.cc:1905] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.004985 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8615e96c59474da5ae6214402aba4a46 (table default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]) successfully deleted
I20250625 14:01:58.005128 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8feddd83af08466ea11c4a15a08d3c8b (table default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]) successfully deleted
W20250625 14:01:58.006352 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b08135db764c4eb286d5f67ccba94ed5 consensus state has no leader
I20250625 14:01:58.006698 12172 consensus_queue.cc:260] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.007397 12172 ts_tablet_manager.cc:1428] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:58.008316 11530 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet d74f27d998b14ee890272812b718e468 (table default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]). Expected version 1 got 0
I20250625 14:01:58.008750 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3fc13d79731e4d07a486ac496fd081fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.009163 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fc13d79731e4d07a486ac496fd081fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.010612 12894 raft_consensus.cc:491] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.010708 12894 raft_consensus.cc:513] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.011368 12894 leader_election.cc:290] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.012158 12175 ts_tablet_manager.cc:1918] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.012382 12175 log.cc:1199] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/1dc443822d504733b5d67e212020df0e
I20250625 14:01:58.012661 12175 ts_tablet_manager.cc:1939] T 1dc443822d504733b5d67e212020df0e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.013430 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 1dc443822d504733b5d67e212020df0e (table default.Table_7854449269c249a3bce7ffeebec57005 [id=7e7a74b6fc62426db15b91037d400d42]) successfully deleted
I20250625 14:01:58.018098 12985 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-2/data/info.pb
W20250625 14:01:58.018591 11717 leader_election.cc:343] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.019881 12056 raft_consensus.cc:3058] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.019883 12894 raft_consensus.cc:491] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.019974 12894 raft_consensus.cc:513] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.020345 12894 leader_election.cc:290] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.020665 12167 tablet_bootstrap.cc:492] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.020805 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb1d6934ab98482c9ae6b6cafc1ee9a6" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:58.021039 12167 ts_tablet_manager.cc:1397] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250625 14:01:58.021131 11717 leader_election.cc:304] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.021291 12894 raft_consensus.cc:2802] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:58.021360 12894 raft_consensus.cc:695] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:58.021485 12894 consensus_queue.cc:237] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.021590 12167 raft_consensus.cc:357] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.021728 12167 raft_consensus.cc:383] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.021785 12167 raft_consensus.cc:738] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.021826 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 12985
I20250625 14:01:58.021971 12167 consensus_queue.cc:260] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.022329 12894 consensus_queue.cc:1035] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.022445 12167 ts_tablet_manager.cc:1428] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.022655 12167 tablet_bootstrap.cc:492] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.022964 12173 tablet_replica.cc:331] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.023089 12173 raft_consensus.cc:2241] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.023204 12173 raft_consensus.cc:2270] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.024068 12167 tablet_bootstrap.cc:654] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.024310 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1dc443822d504733b5d67e212020df0e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:58.024479 12984 tablet.cc:1722] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.025396 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet cb0b1a9a04ca4911b5f6e441d0239977 (table default.Table_37908936fde84cea9245460dac5d2283 [id=7ebc2c88eb074eb598b2cfda5e4e81bc]) successfully deleted
I20250625 14:01:58.025808 12172 tablet_bootstrap.cc:492] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.027122 12172 tablet_bootstrap.cc:654] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.028085 12173 ts_tablet_manager.cc:1905] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.029088 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ee3cc1074818466a97d04f0136eaea92
I20250625 14:01:58.029472 11532 catalog_manager.cc:6652] ReplaceTablet: tablet ee3cc1074818466a97d04f0136eaea92 deleted and replaced by tablet 292e9c27637d410ea487761f50bdee88
I20250625 14:01:58.029788 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet ee3cc1074818466a97d04f0136eaea92 with delete_type TABLET_DATA_DELETED (replaced by tablet 292e9c27637d410ea487761f50bdee88) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.030647 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet dff6358de0e4446e8dfc9465180ba395
I20250625 14:01:58.031109 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet dff6358de0e4446e8dfc9465180ba395 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.032013 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 9bd4226d952d4dc394c33acae7372347 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.032573 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 7c68ae7ecff34d34baaffe47c740bac6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.034157 12166 tablet_bootstrap.cc:492] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.034278 12166 ts_tablet_manager.cc:1397] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.000s
I20250625 14:01:58.034854 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet dff6358de0e4446e8dfc9465180ba395 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.034886 12166 raft_consensus.cc:357] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.035004 12166 raft_consensus.cc:383] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.035038 12166 raft_consensus.cc:738] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.035172 12166 consensus_queue.cc:260] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.035501 12166 ts_tablet_manager.cc:1428] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.035724 12166 tablet_bootstrap.cc:492] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.036803 12166 tablet_bootstrap.cc:654] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:58.038070 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet dff6358de0e4446e8dfc9465180ba395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff6358de0e4446e8dfc9465180ba395 already in progress: creating tablet
I20250625 14:01:58.039916 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet db4a9e4dfdd145bab965004ee5562e2b with delete_type TABLET_DATA_DELETED (replaced by tablet 140c1810e98741479c3754729409b46c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.040470 12173 ts_tablet_manager.cc:1918] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.040643 12173 log.cc:1199] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7cd1672cf1164e469a862c5b43ec6f12
I20250625 14:01:58.041009 12173 ts_tablet_manager.cc:1939] T 7cd1672cf1164e469a862c5b43ec6f12 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.041777 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7cd1672cf1164e469a862c5b43ec6f12 (table default.Table_090b46fb5d524097805d01616f53df78 [id=77e2beefd7da4b7db5f7e4134f88bb68]) successfully deleted
I20250625 14:01:58.045584 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet ee3cc1074818466a97d04f0136eaea92 with delete_type TABLET_DATA_DELETED (replaced by tablet 292e9c27637d410ea487761f50bdee88) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.046113 12175 tablet_replica.cc:331] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.046262 12175 raft_consensus.cc:2241] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.046432 12175 raft_consensus.cc:2270] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.047217 12175 ts_tablet_manager.cc:1905] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.048036 12233 tablet.cc:1717] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Skipping requested alter to schema version 2, tablet already version 2
W20250625 14:01:58.048091 11717 leader_election.cc:343] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 1dc443822d504733b5d67e212020df0e
I20250625 14:01:58.049444 11993 leader_election.cc:304] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:58.049564 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f61d1400161440e49365680085a3fe63" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:58.049695 11921 raft_consensus.cc:2466] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:58.049702 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f61d1400161440e49365680085a3fe63" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:58.049739 12666 raft_consensus.cc:3058] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.051247 12666 raft_consensus.cc:2747] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:58.051954 11717 leader_election.cc:343] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.052035 12238 consensus_queue.cc:1035] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.052119 11717 leader_election.cc:304] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:58.052269 12855 raft_consensus.cc:2747] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.052450 12953 tablet.cc:1717] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Skipping requested alter to schema version 2, tablet already version 2
W20250625 14:01:58.053022 11717 leader_election.cc:343] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.053264 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet ee3cc1074818466a97d04f0136eaea92 with delete_type TABLET_DATA_DELETED (replaced by tablet 292e9c27637d410ea487761f50bdee88) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.053432 12177 tablet_replica.cc:331] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.053568 12177 raft_consensus.cc:2241] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:58.053732 12177 raft_consensus.cc:2270] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.054128 12177 ts_tablet_manager.cc:1905] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.055300 12167 tablet_bootstrap.cc:492] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.055469 12167 ts_tablet_manager.cc:1397] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20250625 14:01:58.055712 12175 ts_tablet_manager.cc:1918] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:58.055874 12175 log.cc:1199] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/ee3cc1074818466a97d04f0136eaea92
I20250625 14:01:58.056308 12175 ts_tablet_manager.cc:1939] T ee3cc1074818466a97d04f0136eaea92 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.056113 12167 raft_consensus.cc:357] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.056423 12167 raft_consensus.cc:383] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.056459 12167 raft_consensus.cc:738] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.056500 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a7ee7d2dbb914c75916632f516ca4e25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.056648 12177 ts_tablet_manager.cc:1918] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:58.056680 12167 consensus_queue.cc:260] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.056725 12177 log.cc:1199] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/ee3cc1074818466a97d04f0136eaea92
W20250625 14:01:58.056949 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7ee7d2dbb914c75916632f516ca4e25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.056991 12167 ts_tablet_manager.cc:1428] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.058089 12177 ts_tablet_manager.cc:1939] T ee3cc1074818466a97d04f0136eaea92 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.058143 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f3a4b3350e8e41d7836f31c9067e19c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.058108 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_21815747326f4c0dbb326f558f1c7618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.058550 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3a4b3350e8e41d7836f31c9067e19c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:58.058725 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21815747326f4c0dbb326f558f1c7618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.058681 11533 catalog_manager.cc:5582] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:58.058888 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]). Expected version 1 got 0
I20250625 14:01:58.059013 11533 catalog_manager.cc:5582] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:58.059135 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.059486 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a38a4acaaaac4b67a46b3eb0eb079312"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.059774 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a38a4acaaaac4b67a46b3eb0eb079312 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.060658 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_02b107aff218434e8b66fde53ea34376" } modify_external_catalogs: true
I20250625 14:01:58.060750 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_02b107aff218434e8b66fde53ea34376" } modify_external_catalogs: true
I20250625 14:01:58.061954 11526 catalog_manager.cc:5582] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:58.070873 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (DEFAULT_TABLE table=default.Table_21b55de037b74cc69101bc65ec02bb76 [id=1f4a03c6bde742a581596005b19a818f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.071244 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d1b58fd1a9483b9ead08a55e3b1e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.071344 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (DEFAULT_TABLE table=default.Table_21b55de037b74cc69101bc65ec02bb76 [id=1f4a03c6bde742a581596005b19a818f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.071713 11895 tablet_service.cc:1468] Processing CreateTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f (DEFAULT_TABLE table=default.Table_75eefac2950f498d963162a9e06305c1 [id=249cebeb7f5b4990ad3776656f4586ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.071966 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36ed3e126ef4edfa69fcffb098d0e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.072304 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 3ae093ced6ff4255b75f634701ed259b (DEFAULT_TABLE table=default.Table_a2e1af99f48646d3802559469c28096f [id=7d654737393e4b17a7b587bf92569aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.072535 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae093ced6ff4255b75f634701ed259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.073099 11891 tablet_service.cc:1468] Processing CreateTablet for tablet d185c7be82b04fe2a30626a6fb082219 (DEFAULT_TABLE table=default.Table_d05b0f5a4b254c48b534779262ad0ac4 [id=2c5856c86f724fca9b7f2f52c6614392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.073328 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d185c7be82b04fe2a30626a6fb082219. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.073338 12034 tablet_service.cc:1468] Processing CreateTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b (DEFAULT_TABLE table=default.Table_5f225879b77a4d1f8083b0a7f1929e36 [id=3fb5b2ae009c4365812e750040fa0b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.073364 12036 tablet_service.cc:1468] Processing CreateTablet for tablet d185c7be82b04fe2a30626a6fb082219 (DEFAULT_TABLE table=default.Table_d05b0f5a4b254c48b534779262ad0ac4 [id=2c5856c86f724fca9b7f2f52c6614392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.073581 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a788be0b8640dc9d6d06fa86580f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.075665 11900 tablet_service.cc:1468] Processing CreateTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b (DEFAULT_TABLE table=default.Table_5f225879b77a4d1f8083b0a7f1929e36 [id=3fb5b2ae009c4365812e750040fa0b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.075937 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a788be0b8640dc9d6d06fa86580f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.076931 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 1fd261d824c34864a7b15e4736254062 (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.077067 11896 tablet_service.cc:1468] Processing CreateTablet for tablet dfbf6959677547a6a2582b73b2be4c03 (DEFAULT_TABLE table=default.Table_bb1104be50d8484ab10c1efe62b44b88 [id=70d3fc86e64847b9b7edd7945c195dc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.077288 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfbf6959677547a6a2582b73b2be4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.078217 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 1fd261d824c34864a7b15e4736254062 (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.078466 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fd261d824c34864a7b15e4736254062. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.078933 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1fd261d824c34864a7b15e4736254062
I20250625 14:01:58.079684 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 0f6c287461864f6dba5f47711eb69fae (DEFAULT_TABLE table=default.Table_6913356853b04dcdbb871b449e350ffb [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.079804 12033 tablet_service.cc:1468] Processing CreateTablet for tablet dfbf6959677547a6a2582b73b2be4c03 (DEFAULT_TABLE table=default.Table_bb1104be50d8484ab10c1efe62b44b88 [id=70d3fc86e64847b9b7edd7945c195dc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.080176 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 7160c6353e2d48d8a5d5a71563797051 (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.080235 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 3ae093ced6ff4255b75f634701ed259b (DEFAULT_TABLE table=default.Table_a2e1af99f48646d3802559469c28096f [id=7d654737393e4b17a7b587bf92569aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.080475 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae093ced6ff4255b75f634701ed259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.080765 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc (DEFAULT_TABLE table=default.Table_89bc204107184f1aae8f924ca65ecd16 [id=f3af928f08964073b0314bfc509bf634]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.080879 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
I20250625 14:01:58.081606 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 7160c6353e2d48d8a5d5a71563797051 (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.081647 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fd261d824c34864a7b15e4736254062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.081813 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7160c6353e2d48d8a5d5a71563797051. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.082504 12035 tablet_service.cc:1468] Processing CreateTablet for tablet e58bd9c8a0eb43b5aeedcca452fa7a98 (DEFAULT_TABLE table=default.Table_a2678af522f74fa496589e5ff1f44a52 [id=f815dd0b73b44432b4d0a6d57c9abe5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.082795 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc (DEFAULT_TABLE table=default.Table_89bc204107184f1aae8f924ca65ecd16 [id=f3af928f08964073b0314bfc509bf634]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.083016 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a1eb4471544de9afbb5b35d0071dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.083877 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 0f6c287461864f6dba5f47711eb69fae (DEFAULT_TABLE table=default.Table_6913356853b04dcdbb871b449e350ffb [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.084122 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6c287461864f6dba5f47711eb69fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.085763 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fd261d824c34864a7b15e4736254062. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.087983 12031 tablet_service.cc:1515] Processing DeleteTablet for tablet 35ece361f92a4c9a9df5ad3355f87db9 with delete_type TABLET_DATA_DELETED (replaced by tablet fae1eddf1156499aa346502f7a200125) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:58.088248 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1fd261d824c34864a7b15e4736254062 because the tablet was not found. No further retry: Not found: Tablet not found: 1fd261d824c34864a7b15e4736254062
I20250625 14:01:58.088310 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6c287461864f6dba5f47711eb69fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.088773 12167 tablet_bootstrap.cc:492] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.089857 12167 tablet_bootstrap.cc:654] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.090029 11900 tablet_service.cc:1468] Processing CreateTablet for tablet e58bd9c8a0eb43b5aeedcca452fa7a98 (DEFAULT_TABLE table=default.Table_a2678af522f74fa496589e5ff1f44a52 [id=f815dd0b73b44432b4d0a6d57c9abe5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.090298 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58bd9c8a0eb43b5aeedcca452fa7a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.090363 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfbf6959677547a6a2582b73b2be4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.091975 13114 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.188:43359 every 8 connection(s)
I20250625 14:01:58.092465 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d1b58fd1a9483b9ead08a55e3b1e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.092625 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7160c6353e2d48d8a5d5a71563797051. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.094573 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a1eb4471544de9afbb5b35d0071dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.094610 12026 tablet_service.cc:1468] Processing CreateTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f (DEFAULT_TABLE table=default.Table_75eefac2950f498d963162a9e06305c1 [id=249cebeb7f5b4990ad3776656f4586ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.094846 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36ed3e126ef4edfa69fcffb098d0e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.096580 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58bd9c8a0eb43b5aeedcca452fa7a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.097589 12166 tablet_bootstrap.cc:492] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.097688 12166 ts_tablet_manager.cc:1397] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.000s
I20250625 14:01:58.098361 12166 raft_consensus.cc:357] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.098484 12166 raft_consensus.cc:383] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.098515 12166 raft_consensus.cc:738] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.098677 12166 consensus_queue.cc:260] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.098987 12166 ts_tablet_manager.cc:1428] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:58.099236 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d185c7be82b04fe2a30626a6fb082219. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.099412 12166 tablet_bootstrap.cc:492] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.099799 12172 tablet_bootstrap.cc:492] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.099895 12172 ts_tablet_manager.cc:1397] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.000s
I20250625 14:01:58.100382 12172 raft_consensus.cc:357] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.100502 12172 raft_consensus.cc:383] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.100543 12172 raft_consensus.cc:738] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.100585 12166 tablet_bootstrap.cc:654] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.100668 12172 consensus_queue.cc:260] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.101117 12172 ts_tablet_manager.cc:1428] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.101326 12172 tablet_bootstrap.cc:492] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.101671 12173 tablet_replica.cc:331] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.101890 12173 raft_consensus.cc:2241] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.102113 12173 raft_consensus.cc:2270] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.102488 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fd261d824c34864a7b15e4736254062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.102957 12172 tablet_bootstrap.cc:654] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.103825 12167 tablet_bootstrap.cc:492] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.103992 12167 ts_tablet_manager.cc:1397] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:58.105286 12167 raft_consensus.cc:357] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.105414 12167 raft_consensus.cc:383] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.105449 12167 raft_consensus.cc:738] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.105623 12167 consensus_queue.cc:260] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.106017 12167 ts_tablet_manager.cc:1428] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:58.106568 12173 ts_tablet_manager.cc:1905] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.109241 12173 ts_tablet_manager.cc:1918] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:58.116868 12166 tablet_bootstrap.cc:492] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.117084 12166 ts_tablet_manager.cc:1397] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:01:58.117650 12166 raft_consensus.cc:357] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.117851 12166 raft_consensus.cc:383] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.117925 12166 raft_consensus.cc:738] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.118111 12166 consensus_queue.cc:260] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.118633 12166 ts_tablet_manager.cc:1428] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.119089 13117 sys_catalog.cc:263] Verifying existing consensus state
I20250625 14:01:58.120853 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 58eacad688d747118971f4c4ad163871
I20250625 14:01:58.121268 13117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Bootstrap starting.
I20250625 14:01:58.121311 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9bd4226d952d4dc394c33acae7372347
I20250625 14:01:58.121500 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 9bd4226d952d4dc394c33acae7372347 deleted and replaced by tablet b215f2dc28604d1387e9847a5247564d
I20250625 14:01:58.123708 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:58.123891 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet d74f27d998b14ee890272812b718e468 (table default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]). Expected version 1 got 0
I20250625 14:01:58.125887 11532 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet d74f27d998b14ee890272812b718e468 (table default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]). Expected version 1 got 0
I20250625 14:01:58.126847 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4317c3460f664f32aeb9b25ffb57d5bd
I20250625 14:01:58.110415 12167 tablet_bootstrap.cc:492] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.121711 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 58eacad688d747118971f4c4ad163871 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.123972 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 9bd4226d952d4dc394c33acae7372347 with delete_type TABLET_DATA_DELETED (replaced by tablet b215f2dc28604d1387e9847a5247564d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.127562 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.134481 12167 tablet_bootstrap.cc:654] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.135177 12173 log.cc:1199] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/ee3cc1074818466a97d04f0136eaea92
I20250625 14:01:58.135272 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.135557 12173 ts_tablet_manager.cc:1939] T ee3cc1074818466a97d04f0136eaea92 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.136369 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
W20250625 14:01:58.136893 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet dff6358de0e4446e8dfc9465180ba395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff6358de0e4446e8dfc9465180ba395 already in progress: creating tablet
I20250625 14:01:58.137764 12173 tablet_replica.cc:331] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.137895 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.138768 12175 tablet_replica.cc:331] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.138929 12175 raft_consensus.cc:2241] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.139076 12175 raft_consensus.cc:2270] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.139453 12166 tablet_bootstrap.cc:492] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.140642 12166 tablet_bootstrap.cc:654] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:58.141345 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 4317c3460f664f32aeb9b25ffb57d5bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4317c3460f664f32aeb9b25ffb57d5bd already in progress: creating tablet
I20250625 14:01:58.142015 12175 ts_tablet_manager.cc:1905] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.144472 12175 ts_tablet_manager.cc:1918] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.144558 12175 log.cc:1199] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0752a7f1371e42d68d83afe41d2f1da9
I20250625 14:01:58.144774 12175 ts_tablet_manager.cc:1939] T 0752a7f1371e42d68d83afe41d2f1da9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.146595 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 9bd4226d952d4dc394c33acae7372347 with delete_type TABLET_DATA_DELETED (replaced by tablet b215f2dc28604d1387e9847a5247564d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.147533 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0752a7f1371e42d68d83afe41d2f1da9 (table default.Table_ba88e68554e349be85cfbc86283df3e7 [id=86457396dd0e41c59a0e4b3805825778]) successfully deleted
I20250625 14:01:58.148211 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet f0833d0e013f48f78cb6c616481b5dce from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:58.148391 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9bd4226d952d4dc394c33acae7372347 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd4226d952d4dc394c33acae7372347 already in progress: creating tablet
I20250625 14:01:58.148365 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2fcd7c144c704f17884e81b9884d604f" } new_table_name: "default.Table_c0aa8bb1b9b2417aa42dddc6bc8d31b0" modify_external_catalogs: true
I20250625 14:01:58.148633 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 58eacad688d747118971f4c4ad163871 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.148844 12175 tablet_replica.cc:331] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.149056 12175 raft_consensus.cc:2241] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.150135 11753 tablet_service.cc:1468] Processing CreateTablet for tablet dfbf6959677547a6a2582b73b2be4c03 (DEFAULT_TABLE table=default.Table_bb1104be50d8484ab10c1efe62b44b88 [id=70d3fc86e64847b9b7edd7945c195dc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.150223 11762 tablet_service.cc:1468] Processing CreateTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b (DEFAULT_TABLE table=default.Table_5f225879b77a4d1f8083b0a7f1929e36 [id=3fb5b2ae009c4365812e750040fa0b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.150688 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 7160c6353e2d48d8a5d5a71563797051 (DEFAULT_TABLE table=default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.150743 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fd261d824c34864a7b15e4736254062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.150918 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.151047 11752 tablet_service.cc:1468] Processing CreateTablet for tablet e58bd9c8a0eb43b5aeedcca452fa7a98 (DEFAULT_TABLE table=default.Table_a2678af522f74fa496589e5ff1f44a52 [id=f815dd0b73b44432b4d0a6d57c9abe5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.151178 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 0f6c287461864f6dba5f47711eb69fae (DEFAULT_TABLE table=default.Table_6913356853b04dcdbb871b449e350ffb [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.149484 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 3ae093ced6ff4255b75f634701ed259b (DEFAULT_TABLE table=default.Table_a2e1af99f48646d3802559469c28096f [id=7d654737393e4b17a7b587bf92569aab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.151404 11717 leader_election.cc:304] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.151539 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc (DEFAULT_TABLE table=default.Table_89bc204107184f1aae8f924ca65ecd16 [id=f3af928f08964073b0314bfc509bf634]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.151593 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 9bd4226d952d4dc394c33acae7372347 with delete_type TABLET_DATA_DELETED (replaced by tablet b215f2dc28604d1387e9847a5247564d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.151734 11748 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.152051 12177 tablet_replica.cc:331] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.152179 12177 raft_consensus.cc:2241] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.152287 12177 raft_consensus.cc:2270] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.152473 12166 tablet_bootstrap.cc:492] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.152571 12166 ts_tablet_manager.cc:1397] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:01:58.150923 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc443822d504733b5d67e212020df0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.149621 11755 tablet_service.cc:1468] Processing CreateTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f (DEFAULT_TABLE table=default.Table_75eefac2950f498d963162a9e06305c1 [id=249cebeb7f5b4990ad3776656f4586ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.151551 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 58eacad688d747118971f4c4ad163871 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.153147 12166 raft_consensus.cc:357] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.150492 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 1fd261d824c34864a7b15e4736254062 (DEFAULT_TABLE table=default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.153256 12166 raft_consensus.cc:383] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.153290 12166 raft_consensus.cc:738] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.151058 11763 tablet_service.cc:1468] Processing CreateTablet for tablet d185c7be82b04fe2a30626a6fb082219 (DEFAULT_TABLE table=default.Table_d05b0f5a4b254c48b534779262ad0ac4 [id=2c5856c86f724fca9b7f2f52c6614392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.153450 12166 consensus_queue.cc:260] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.153666 12177 ts_tablet_manager.cc:1905] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.149475 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (DEFAULT_TABLE table=default.Table_21b55de037b74cc69101bc65ec02bb76 [id=1f4a03c6bde742a581596005b19a818f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.150491 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfbf6959677547a6a2582b73b2be4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.154356 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a1eb4471544de9afbb5b35d0071dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.154597 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae093ced6ff4255b75f634701ed259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.154706 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6c287461864f6dba5f47711eb69fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.154860 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7160c6353e2d48d8a5d5a71563797051. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.154897 12166 ts_tablet_manager.cc:1428] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:58.155109 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36ed3e126ef4edfa69fcffb098d0e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.155243 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a788be0b8640dc9d6d06fa86580f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.155324 12166 tablet_bootstrap.cc:492] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.152298 12238 raft_consensus.cc:2802] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:58.155381 12238 raft_consensus.cc:491] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:58.155424 12238 raft_consensus.cc:3058] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.155472 12175 raft_consensus.cc:2270] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.156389 12166 tablet_bootstrap.cc:654] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.156471 12238 raft_consensus.cc:513] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.156881 12238 leader_election.cc:290] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.157032 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fd261d824c34864a7b15e4736254062. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.157308 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d185c7be82b04fe2a30626a6fb082219. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.157446 12172 tablet_bootstrap.cc:492] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.157526 12172 ts_tablet_manager.cc:1397] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.001s
I20250625 14:01:58.157570 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58bd9c8a0eb43b5aeedcca452fa7a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.157799 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d1b58fd1a9483b9ead08a55e3b1e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.157971 12172 raft_consensus.cc:357] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.158296 12172 raft_consensus.cc:383] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.158365 12172 raft_consensus.cc:738] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.158524 12172 consensus_queue.cc:260] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.158644 12175 ts_tablet_manager.cc:1905] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.158823 12172 ts_tablet_manager.cc:1428] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.159961 12172 tablet_bootstrap.cc:492] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.160888 12172 tablet_bootstrap.cc:654] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.162571 12175 ts_tablet_manager.cc:1918] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.162642 12175 log.cc:1199] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/58eacad688d747118971f4c4ad163871
I20250625 14:01:58.162838 12175 ts_tablet_manager.cc:1939] T 58eacad688d747118971f4c4ad163871 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.163585 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 58eacad688d747118971f4c4ad163871 (table default.Table_ac11fbf6c80047a78d8983642c8746dc [id=96c998c0c13e49aeaa4b3fff136f2e27]) successfully deleted
I20250625 14:01:58.164369 12177 ts_tablet_manager.cc:1918] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.164433 12177 log.cc:1199] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7b78fd0d543449bdb2e95fee6a53e93f
I20250625 14:01:58.164616 12177 ts_tablet_manager.cc:1939] T 7b78fd0d543449bdb2e95fee6a53e93f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.165680 12208 consensus_queue.cc:1035] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.166927 12053 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f61d1400161440e49365680085a3fe63" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:58.167646 11717 leader_election.cc:343] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.167639 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f61d1400161440e49365680085a3fe63" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:58.168126 11922 raft_consensus.cc:3058] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.169102 11922 raft_consensus.cc:2466] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:58.149256 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet dff6358de0e4446e8dfc9465180ba395 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.171195 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet ee3cc1074818466a97d04f0136eaea92 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
I20250625 14:01:58.171653 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ba6488926235441ea0f1a8d78706f1d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.172099 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba6488926235441ea0f1a8d78706f1d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.172232 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d1aa2dda09c84623a4377b2c4c4175a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.172597 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1aa2dda09c84623a4377b2c4c4175a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.174546 11782 raft_consensus.cc:1273] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:58.174615 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0f91da2014a744bcafd6f43bd719b371" } new_table_name: "default.Table_609fdabd07f24e4a8ab9be9b40b1b39e" modify_external_catalogs: true
I20250625 14:01:58.174872 13117 log.cc:826] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Log is configured to *not* fsync() on all Append() calls
W20250625 14:01:58.175020 11855 consensus_peers.cc:487] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:58.175351 11717 leader_election.cc:304] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:01:58.175630 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1fd261d824c34864a7b15e4736254062 because the tablet was not found. No further retry: Not found: Tablet not found: 1fd261d824c34864a7b15e4736254062
I20250625 14:01:58.175637 12558 consensus_queue.cc:1035] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:58.175793 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4317c3460f664f32aeb9b25ffb57d5bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4317c3460f664f32aeb9b25ffb57d5bd already in progress: creating tablet
W20250625 14:01:58.175899 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9bd4226d952d4dc394c33acae7372347 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd4226d952d4dc394c33acae7372347 already in progress: creating tablet
I20250625 14:01:58.176116 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_608373c028f24b7583710ee5df593160" } new_table_name: "default.Table_8f4cc0c04ab146eabd50c010b6986d53" modify_external_catalogs: true
I20250625 14:01:58.176429 13137 raft_consensus.cc:2802] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:58.176522 13137 raft_consensus.cc:695] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:58.176662 13137 consensus_queue.cc:237] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.178834 12233 tablet.cc:1722] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:58.179352 12173 raft_consensus.cc:2241] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.179495 12173 raft_consensus.cc:2270] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.180394 12167 tablet_bootstrap.cc:492] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.180485 12167 ts_tablet_manager.cc:1397] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.070s user 0.000s sys 0.002s
I20250625 14:01:58.181046 12167 raft_consensus.cc:357] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.181157 12167 raft_consensus.cc:383] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.181185 12167 raft_consensus.cc:738] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.181300 12167 consensus_queue.cc:260] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.181617 12167 ts_tablet_manager.cc:1428] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.181821 12167 tablet_bootstrap.cc:492] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.182621 11968 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:58.183426 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:58.183482 12167 tablet_bootstrap.cc:654] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.185370 12177 tablet_replica.cc:331] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.185518 12177 raft_consensus.cc:2241] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.185623 12177 raft_consensus.cc:2270] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.186757 12953 tablet.cc:1722] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:58.188848 12177 ts_tablet_manager.cc:1905] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.188849 12558 raft_consensus.cc:491] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.188947 12558 raft_consensus.cc:513] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.189352 12558 leader_election.cc:290] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:58.190956 12103 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:58.192669 12053 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7b78fd0d543449bdb2e95fee6a53e93f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:58.193197 11855 leader_election.cc:343] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:58.195457 11858 leader_election.cc:343] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 7b78fd0d543449bdb2e95fee6a53e93f
I20250625 14:01:58.195541 11858 leader_election.cc:304] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.195760 12600 raft_consensus.cc:2747] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.196485 12177 ts_tablet_manager.cc:1918] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.196569 12177 log.cc:1199] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/1dc443822d504733b5d67e212020df0e
I20250625 14:01:58.196780 12177 ts_tablet_manager.cc:1939] T 1dc443822d504733b5d67e212020df0e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.197722 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_de10db8210b34241a0e63aaa8702fb67" } modify_external_catalogs: true
I20250625 14:01:58.197854 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_de10db8210b34241a0e63aaa8702fb67" } modify_external_catalogs: true
I20250625 14:01:58.198844 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:58.198947 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.201140 12175 tablet_replica.cc:331] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.201326 12175 raft_consensus.cc:2241] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.201463 12175 raft_consensus.cc:2270] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.202086 12175 ts_tablet_manager.cc:1905] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.205277 12175 ts_tablet_manager.cc:1918] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.205442 12175 log.cc:1199] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7b78fd0d543449bdb2e95fee6a53e93f
I20250625 14:01:58.205724 12175 ts_tablet_manager.cc:1939] T 7b78fd0d543449bdb2e95fee6a53e93f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.208279 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 1df220bf9c8447c5ac4ad35a145a8796 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.208348 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7b78fd0d543449bdb2e95fee6a53e93f (table default.Table_3d82e197e7174db08e444c89b45c77be [id=1cf0251105444beca355668b5a0da27b]) successfully deleted
I20250625 14:01:58.209051 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9b659d9df8f54c3b9d61bd3eb73083be" } new_table_name: "default.Table_c055b1e8e56d4bd595e2312996eb6b5e" modify_external_catalogs: true
W20250625 14:01:58.210376 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be4378f7781541d7866e6d5c440b13e6 consensus state has no leader
W20250625 14:01:58.210915 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cfcb08ddbdd43dd92472dcbdc772a2d consensus state has no leader
I20250625 14:01:58.213477 12035 tablet_service.cc:1468] Processing CreateTablet for tablet edc5b7cc92564ba4ad04f68e18b56dfe (DEFAULT_TABLE table=default.Table_11b1368ec2c3492eb0d0476a28bd925c [id=205b876e2e7a4f54bbddec9150d67e0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.213814 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc5b7cc92564ba4ad04f68e18b56dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.214483 11900 tablet_service.cc:1468] Processing CreateTablet for tablet edc5b7cc92564ba4ad04f68e18b56dfe (DEFAULT_TABLE table=default.Table_11b1368ec2c3492eb0d0476a28bd925c [id=205b876e2e7a4f54bbddec9150d67e0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.214751 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc5b7cc92564ba4ad04f68e18b56dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.214969 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 7353ef647c3649d59fadbd240ccae7bb (DEFAULT_TABLE table=default.Table_740cd4b264aa4d3baf5d5c296a06cd43 [id=7ccef3951cff4328a6ba48bd01587a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.215184 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7353ef647c3649d59fadbd240ccae7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.216449 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 7353ef647c3649d59fadbd240ccae7bb (DEFAULT_TABLE table=default.Table_740cd4b264aa4d3baf5d5c296a06cd43 [id=7ccef3951cff4328a6ba48bd01587a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.216698 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7353ef647c3649d59fadbd240ccae7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.217901 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 (DEFAULT_TABLE table=default.Table_a0513f1c1050428aafc99329d1115a93 [id=fdd8850d9bb54b189508d389454a1ef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.218132 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.218895 12034 tablet_service.cc:1468] Processing CreateTablet for tablet f325061ce4bb4468886cfe0a0d752596 (DEFAULT_TABLE table=default.Table_900afa9784ef451eaa2d34e700b4276b [id=cd68b5ad9c1849298e961363e2e27608]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.219120 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f325061ce4bb4468886cfe0a0d752596. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.219439 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 292e9c27637d410ea487761f50bdee88 (DEFAULT_TABLE table=default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.219678 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292e9c27637d410ea487761f50bdee88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.219642 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 (DEFAULT_TABLE table=default.Table_a0513f1c1050428aafc99329d1115a93 [id=fdd8850d9bb54b189508d389454a1ef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.219821 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.221777 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 292e9c27637d410ea487761f50bdee88 (DEFAULT_TABLE table=default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.222039 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292e9c27637d410ea487761f50bdee88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.222543 12034 tablet_service.cc:1468] Processing CreateTablet for tablet f2f25aaee07242329014de1834ca881d (DEFAULT_TABLE table=default.Table_aed5f4ab57624e84b4109fefaa440e45 [id=61ec0a905c47494993d61449ae285e91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.222651 11895 tablet_service.cc:1468] Processing CreateTablet for tablet f2f25aaee07242329014de1834ca881d (DEFAULT_TABLE table=default.Table_aed5f4ab57624e84b4109fefaa440e45 [id=61ec0a905c47494993d61449ae285e91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.222759 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f25aaee07242329014de1834ca881d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.222880 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f25aaee07242329014de1834ca881d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.224944 12036 tablet_service.cc:1468] Processing CreateTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 (DEFAULT_TABLE table=default.Table_3fc13d79731e4d07a486ac496fd081fc [id=c3c11e126c464fdb8861f40571c798f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.225049 11897 tablet_service.cc:1468] Processing CreateTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 (DEFAULT_TABLE table=default.Table_3fc13d79731e4d07a486ac496fd081fc [id=c3c11e126c464fdb8861f40571c798f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.225188 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53e9ef9d5f64cb893a552ab0784c120. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.225368 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53e9ef9d5f64cb893a552ab0784c120. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.226819 12600 raft_consensus.cc:491] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.226909 12600 raft_consensus.cc:513] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.227304 12600 leader_election.cc:290] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.227160 12894 consensus_queue.cc:1035] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:58.228132 11855 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 082a46d213c545b18acbcac1b699d140
W20250625 14:01:58.228580 11858 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 082a46d213c545b18acbcac1b699d140
I20250625 14:01:58.228652 11858 leader_election.cc:304] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.228850 12600 raft_consensus.cc:2747] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.229287 11900 tablet_service.cc:1468] Processing CreateTablet for tablet f325061ce4bb4468886cfe0a0d752596 (DEFAULT_TABLE table=default.Table_900afa9784ef451eaa2d34e700b4276b [id=cd68b5ad9c1849298e961363e2e27608]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.229542 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f325061ce4bb4468886cfe0a0d752596. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.230268 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.230475 12177 tablet_replica.cc:331] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.230625 12177 raft_consensus.cc:2241] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.230624 12984 tablet.cc:1722] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:58.230729 12177 raft_consensus.cc:2270] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.231913 12177 ts_tablet_manager.cc:1905] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.234288 12177 ts_tablet_manager.cc:1918] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.236320 12177 log.cc:1199] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0752a7f1371e42d68d83afe41d2f1da9
I20250625 14:01:58.236544 12177 ts_tablet_manager.cc:1939] T 0752a7f1371e42d68d83afe41d2f1da9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.240288 12173 ts_tablet_manager.cc:1905] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.242609 12173 ts_tablet_manager.cc:1918] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.242687 12173 log.cc:1199] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/db4a9e4dfdd145bab965004ee5562e2b
I20250625 14:01:58.242879 12173 ts_tablet_manager.cc:1939] T db4a9e4dfdd145bab965004ee5562e2b P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.243453 12173 tablet_replica.cc:331] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.243593 12173 raft_consensus.cc:2241] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.243616 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet db4a9e4dfdd145bab965004ee5562e2b (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
I20250625 14:01:58.243705 12173 raft_consensus.cc:2270] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.245636 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a7ee7d2dbb914c75916632f516ca4e25" } modify_external_catalogs: true
I20250625 14:01:58.245689 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3fdd6c4a3751422b8f5f2d0a9c17a9ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.245769 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a7ee7d2dbb914c75916632f516ca4e25" } modify_external_catalogs: true
W20250625 14:01:58.246106 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fdd6c4a3751422b8f5f2d0a9c17a9ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.247175 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6dab46b8294a4cc1913268a5f6933b73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.247313 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 1dc443822d504733b5d67e212020df0e (table default.Table_7854449269c249a3bce7ffeebec57005 [id=7e7a74b6fc62426db15b91037d400d42]) successfully deleted
W20250625 14:01:58.247424 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 58eacad688d747118971f4c4ad163871 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58eacad688d747118971f4c4ad163871 already in progress: creating tablet
W20250625 14:01:58.247517 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet dff6358de0e4446e8dfc9465180ba395 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff6358de0e4446e8dfc9465180ba395 already in progress: creating tablet
W20250625 14:01:58.247538 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dab46b8294a4cc1913268a5f6933b73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.249723 11760 tablet_service.cc:1468] Processing CreateTablet for tablet edc5b7cc92564ba4ad04f68e18b56dfe (DEFAULT_TABLE table=default.Table_11b1368ec2c3492eb0d0476a28bd925c [id=205b876e2e7a4f54bbddec9150d67e0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.250026 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc5b7cc92564ba4ad04f68e18b56dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.250819 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0752a7f1371e42d68d83afe41d2f1da9 (table default.Table_ba88e68554e349be85cfbc86283df3e7 [id=86457396dd0e41c59a0e4b3805825778]) successfully deleted
I20250625 14:01:58.252240 12167 tablet_bootstrap.cc:492] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.252326 12167 ts_tablet_manager.cc:1397] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.000s
I20250625 14:01:58.252588 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 7353ef647c3649d59fadbd240ccae7bb (DEFAULT_TABLE table=default.Table_740cd4b264aa4d3baf5d5c296a06cd43 [id=7ccef3951cff4328a6ba48bd01587a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.252812 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7353ef647c3649d59fadbd240ccae7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.252815 12167 raft_consensus.cc:357] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.252911 12167 raft_consensus.cc:383] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.252954 12167 raft_consensus.cc:738] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.253079 12167 consensus_queue.cc:260] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.253346 12167 ts_tablet_manager.cc:1428] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.253531 12167 tablet_bootstrap.cc:492] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.254537 11752 tablet_service.cc:1468] Processing CreateTablet for tablet f325061ce4bb4468886cfe0a0d752596 (DEFAULT_TABLE table=default.Table_900afa9784ef451eaa2d34e700b4276b [id=cd68b5ad9c1849298e961363e2e27608]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.254746 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f325061ce4bb4468886cfe0a0d752596. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.256296 12167 tablet_bootstrap.cc:654] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.256954 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 292e9c27637d410ea487761f50bdee88 (DEFAULT_TABLE table=default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.257216 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292e9c27637d410ea487761f50bdee88. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.259341 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 (DEFAULT_TABLE table=default.Table_a0513f1c1050428aafc99329d1115a93 [id=fdd8850d9bb54b189508d389454a1ef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.259557 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.259649 12233 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:58.259927 12056 raft_consensus.cc:3058] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.261132 12166 tablet_bootstrap.cc:492] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.261102 12953 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:58.261226 12166 ts_tablet_manager.cc:1397] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.106s user 0.001s sys 0.000s
I20250625 14:01:58.261620 11755 tablet_service.cc:1468] Processing CreateTablet for tablet f2f25aaee07242329014de1834ca881d (DEFAULT_TABLE table=default.Table_aed5f4ab57624e84b4109fefaa440e45 [id=61ec0a905c47494993d61449ae285e91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.261714 12166 raft_consensus.cc:357] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.261818 12166 raft_consensus.cc:383] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.261847 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f25aaee07242329014de1834ca881d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.261850 12166 raft_consensus.cc:738] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.261991 12166 consensus_queue.cc:260] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.262283 12166 ts_tablet_manager.cc:1428] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.262498 12166 tablet_bootstrap.cc:492] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.262499 11757 tablet_service.cc:1468] Processing CreateTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 (DEFAULT_TABLE table=default.Table_3fc13d79731e4d07a486ac496fd081fc [id=c3c11e126c464fdb8861f40571c798f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.262698 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53e9ef9d5f64cb893a552ab0784c120. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.263389 12166 tablet_bootstrap.cc:654] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.264293 12894 consensus_queue.cc:1035] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.267961 12984 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:01:58.269609 12172 tablet_bootstrap.cc:492] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.269701 12172 ts_tablet_manager.cc:1397] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.110s user 0.002s sys 0.000s
I20250625 14:01:58.269798 11830 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:58.270171 12172 raft_consensus.cc:357] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.270273 12172 raft_consensus.cc:383] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.270328 12172 raft_consensus.cc:738] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.270463 12172 consensus_queue.cc:260] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.270761 12172 ts_tablet_manager.cc:1428] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.271462 12172 tablet_bootstrap.cc:492] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.271487 12953 tablet.cc:1722] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.272524 12172 tablet_bootstrap.cc:654] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.273561 12233 tablet.cc:1722] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.273846 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7b78fd0d543449bdb2e95fee6a53e93f (table default.Table_3d82e197e7174db08e444c89b45c77be [id=1cf0251105444beca355668b5a0da27b]) successfully deleted
I20250625 14:01:58.283628 12173 ts_tablet_manager.cc:1905] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:58.289395 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9ed052ae88e4b679ac55177a3bbab88 consensus state has no leader
I20250625 14:01:58.290787 11528 catalog_manager.cc:5582] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:58.291100 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 339813cd0c194f07bfc4edefd6a05ef3 (table default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83]). Expected version 4 got 0
I20250625 14:01:58.291210 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]). Expected version 1 got 0
I20250625 14:01:58.291972 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_11c5f28c7d9c4da59371b1ef5a1d0031" } new_table_name: "default.Table_fd4614a0de7d438f82751d3ed54210cd" modify_external_catalogs: true
I20250625 14:01:58.292565 11529 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet ab7ed4cf8fb44a959dd89e904a96533a
I20250625 14:01:58.292776 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a6705ab73c6b41b983cb216b9ecf344f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.292971 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f0833d0e013f48f78cb6c616481b5dce
W20250625 14:01:58.293135 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6705ab73c6b41b983cb216b9ecf344f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.293249 11530 catalog_manager.cc:6652] ReplaceTablet: tablet f0833d0e013f48f78cb6c616481b5dce deleted and replaced by tablet 6980c62d63b34c67ad095ad9ea18a3f1
I20250625 14:01:58.293429 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4e68cf1c61974d0aa5f1c4bfab1c9fcf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.293767 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e68cf1c61974d0aa5f1c4bfab1c9fcf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.294550 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 12c5e71b4a4f4efc81f822bdf95d0f99 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.294811 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 6c8c667108694caab967bd91f74759b6 from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:58.295396 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f651f79ee034dd28e44092b7de29bf3 consensus state has no leader
I20250625 14:01:58.295780 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_899a1eb5d58f478a87063fafb95aa819 [id=83f715a6270c49f7b0986d2b05d73b44] alter complete (version 2)
I20250625 14:01:58.296800 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8ebec65b7f6a475ab01359aab392d1cf
I20250625 14:01:58.298035 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.299256 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet f0833d0e013f48f78cb6c616481b5dce with delete_type TABLET_DATA_DELETED (replaced by tablet 6980c62d63b34c67ad095ad9ea18a3f1) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.299522 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet f0833d0e013f48f78cb6c616481b5dce with delete_type TABLET_DATA_DELETED (replaced by tablet 6980c62d63b34c67ad095ad9ea18a3f1) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.299858 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.301271 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_712e366118ea4a03a6e8a0f811b4a27d" } modify_external_catalogs: true
I20250625 14:01:58.301398 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_712e366118ea4a03a6e8a0f811b4a27d" } modify_external_catalogs: true
W20250625 14:01:58.302340 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f0833d0e013f48f78cb6c616481b5dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0833d0e013f48f78cb6c616481b5dce already in progress: creating tablet
W20250625 14:01:58.302601 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0542b05b9bd5489995ff972289d4b9c5 consensus state has no leader
W20250625 14:01:58.302912 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8ebec65b7f6a475ab01359aab392d1cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ebec65b7f6a475ab01359aab392d1cf already in progress: creating tablet
I20250625 14:01:58.304188 11533 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet d74f27d998b14ee890272812b718e468 (table default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]). Expected version 1 got 0
I20250625 14:01:58.309777 12894 consensus_queue.cc:1035] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.310365 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.310541 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.310649 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet f0833d0e013f48f78cb6c616481b5dce with delete_type TABLET_DATA_DELETED (replaced by tablet 6980c62d63b34c67ad095ad9ea18a3f1) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.314738 11532 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714] alter complete (version 1)
I20250625 14:01:58.314888 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_f58eef6273194f588541530127a796c2 [id=05ba3fb82ea74715a67dbefb3018db83] alter complete (version 4)
I20250625 14:01:58.317500 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 58eacad688d747118971f4c4ad163871 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.317715 12177 tablet_replica.cc:331] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.317850 12177 raft_consensus.cc:2241] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.317955 12177 raft_consensus.cc:2270] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.318461 12177 ts_tablet_manager.cc:1905] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.319047 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7b1b3da0207d4e2fa0a84a55707035c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.319464 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b1b3da0207d4e2fa0a84a55707035c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:58.320353 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 0752a7f1371e42d68d83afe41d2f1da9 because the tablet was not found. No further retry: Not found: Tablet not found: 0752a7f1371e42d68d83afe41d2f1da9
W20250625 14:01:58.320469 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8ebec65b7f6a475ab01359aab392d1cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ebec65b7f6a475ab01359aab392d1cf already in progress: creating tablet
W20250625 14:01:58.320561 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f0833d0e013f48f78cb6c616481b5dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0833d0e013f48f78cb6c616481b5dce already in progress: creating tablet
I20250625 14:01:58.321897 12177 ts_tablet_manager.cc:1918] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.322034 12177 log.cc:1199] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/58eacad688d747118971f4c4ad163871
I20250625 14:01:58.322371 12177 ts_tablet_manager.cc:1939] T 58eacad688d747118971f4c4ad163871 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.323948 12167 tablet_bootstrap.cc:492] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.324048 12167 ts_tablet_manager.cc:1397] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20250625 14:01:58.324586 12167 raft_consensus.cc:357] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.324695 12167 raft_consensus.cc:383] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.324726 12167 raft_consensus.cc:738] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.325017 12167 consensus_queue.cc:260] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.325729 12167 ts_tablet_manager.cc:1428] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:58.326267 12167 tablet_bootstrap.cc:492] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.328312 12167 tablet_bootstrap.cc:654] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.328323 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.329668 12167 tablet_bootstrap.cc:492] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.329758 12167 ts_tablet_manager.cc:1397] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:01:58.330229 12167 raft_consensus.cc:357] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.330385 12167 raft_consensus.cc:383] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.330430 12167 raft_consensus.cc:738] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.330574 12167 consensus_queue.cc:260] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.330961 12167 ts_tablet_manager.cc:1428] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250625 14:01:58.331236 12167 tablet_bootstrap.cc:492] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.331966 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.332854 12167 tablet_bootstrap.cc:654] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.333664 12265 raft_consensus.cc:491] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.333767 12265 raft_consensus.cc:513] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.334163 12167 tablet_bootstrap.cc:492] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.334167 12265 leader_election.cc:290] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.334242 12167 ts_tablet_manager.cc:1397] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:01:58.334474 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff4973a4d8ec46c7aa640fcaf40b5c87" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:58.334735 12167 raft_consensus.cc:357] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.334756 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff4973a4d8ec46c7aa640fcaf40b5c87" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:58.334831 12167 raft_consensus.cc:383] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.334862 12167 raft_consensus.cc:738] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.334976 12167 consensus_queue.cc:260] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:58.335155 11855 leader_election.cc:343] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.335283 12167 ts_tablet_manager.cc:1428] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.335459 12167 tablet_bootstrap.cc:492] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:58.335527 11858 leader_election.cc:343] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.335592 11858 leader_election.cc:304] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.335767 12265 raft_consensus.cc:2747] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.336647 12167 tablet_bootstrap.cc:654] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.337699 11533 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (table default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]). Expected version 2 got 0
I20250625 14:01:58.343254 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_78362853037e4817a825f5e2432d44bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.343662 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7e1ecfc40f504452a262b91cfdf23a1b" } modify_external_catalogs: true
I20250625 14:01:58.343776 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7e1ecfc40f504452a262b91cfdf23a1b" } modify_external_catalogs: true
W20250625 14:01:58.343972 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78362853037e4817a825f5e2432d44bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.343676 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_418c3536c18d47b6ba687faf26494aec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.344936 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_418c3536c18d47b6ba687faf26494aec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.347857 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 128dab7ad46048cc91fc20ddc1431d57
I20250625 14:01:58.349016 12103 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:58.349601 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ca18a9657ad246d1a95d953e4b2389c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.350009 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca18a9657ad246d1a95d953e4b2389c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.347126 11533 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]). Expected version 1 got 0
I20250625 14:01:58.354168 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 12c5e71b4a4f4efc81f822bdf95d0f99
I20250625 14:01:58.354533 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 12c5e71b4a4f4efc81f822bdf95d0f99 deleted and replaced by tablet 31f843108ecf440090c05255afa1687e
I20250625 14:01:58.354581 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.354776 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 54a59027aef04a12a0bf1fbece3c3161
I20250625 14:01:58.354789 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.356251 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.356316 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6c8c667108694caab967bd91f74759b6
I20250625 14:01:58.356789 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 6c8c667108694caab967bd91f74759b6 deleted and replaced by tablet cbe2dcd1fb924dcba5c12aaa8e141435
I20250625 14:01:58.356994 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 31f843108ecf440090c05255afa1687e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.357192 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 31f843108ecf440090c05255afa1687e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.357661 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 6c8c667108694caab967bd91f74759b6 with delete_type TABLET_DATA_DELETED (replaced by tablet cbe2dcd1fb924dcba5c12aaa8e141435) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.357844 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_06e8bc49777a442bbce90e7f4312b059" } modify_external_catalogs: true
I20250625 14:01:58.357968 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_06e8bc49777a442bbce90e7f4312b059" } modify_external_catalogs: true
I20250625 14:01:58.358067 12167 tablet_bootstrap.cc:492] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.358155 12167 ts_tablet_manager.cc:1397] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:01:58.358723 12167 raft_consensus.cc:357] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.358848 12167 raft_consensus.cc:383] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.358893 12167 raft_consensus.cc:738] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.359033 12167 consensus_queue.cc:260] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.359386 12167 ts_tablet_manager.cc:1428] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.359614 12167 tablet_bootstrap.cc:492] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:58.362876 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 128dab7ad46048cc91fc20ddc1431d57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 128dab7ad46048cc91fc20ddc1431d57 already in progress: creating tablet
I20250625 14:01:58.362679 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:58.363348 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12c5e71b4a4f4efc81f822bdf95d0f99 already in progress: creating tablet
I20250625 14:01:58.362243 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 6c8c667108694caab967bd91f74759b6 with delete_type TABLET_DATA_DELETED (replaced by tablet cbe2dcd1fb924dcba5c12aaa8e141435) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:58.364284 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6c8c667108694caab967bd91f74759b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c8c667108694caab967bd91f74759b6 already in progress: creating tablet
W20250625 14:01:58.364673 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 54a59027aef04a12a0bf1fbece3c3161 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54a59027aef04a12a0bf1fbece3c3161 already in progress: creating tablet
I20250625 14:01:58.367499 12167 tablet_bootstrap.cc:654] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.368841 12167 tablet_bootstrap.cc:492] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.368954 12167 ts_tablet_manager.cc:1397] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:58.368952 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 9cb56a7e714d45038feaf1132a5e06af from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.369510 12167 raft_consensus.cc:357] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.369625 12167 raft_consensus.cc:383] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.369659 12167 raft_consensus.cc:738] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.369802 12167 consensus_queue.cc:260] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.370157 12167 ts_tablet_manager.cc:1428] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.371397 12167 tablet_bootstrap.cc:492] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.372524 12167 tablet_bootstrap.cc:654] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:58.377280 11519 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef (table default.Table_06d43b44b02e415d81733ddc00e3d18b [id=d2c5d6b97745451cabb9a44a25c19b80], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef consensus state has no leader
I20250625 14:01:58.381464 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc443822d504733b5d67e212020df0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.382265 12166 tablet_bootstrap.cc:492] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.382396 12166 ts_tablet_manager.cc:1397] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.120s user 0.001s sys 0.001s
I20250625 14:01:58.382958 12166 raft_consensus.cc:357] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.383095 12166 raft_consensus.cc:383] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.383149 12166 raft_consensus.cc:738] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.383289 12166 consensus_queue.cc:260] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.383610 12166 ts_tablet_manager.cc:1428] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.383791 12166 tablet_bootstrap.cc:492] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.384853 12166 tablet_bootstrap.cc:654] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.385927 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 58eacad688d747118971f4c4ad163871 (table default.Table_ac11fbf6c80047a78d8983642c8746dc [id=96c998c0c13e49aeaa4b3fff136f2e27]) successfully deleted
I20250625 14:01:58.390443 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.390623 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 31f843108ecf440090c05255afa1687e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.390712 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.391173 12052 raft_consensus.cc:3058] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.393838 12984 tablet.cc:1722] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:58.394361 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 6c8c667108694caab967bd91f74759b6 with delete_type TABLET_DATA_DELETED (replaced by tablet cbe2dcd1fb924dcba5c12aaa8e141435) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:58.397022 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 128dab7ad46048cc91fc20ddc1431d57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 128dab7ad46048cc91fc20ddc1431d57 already in progress: creating tablet
W20250625 14:01:58.397351 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12c5e71b4a4f4efc81f822bdf95d0f99 already in progress: creating tablet
W20250625 14:01:58.397580 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 54a59027aef04a12a0bf1fbece3c3161 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54a59027aef04a12a0bf1fbece3c3161 already in progress: creating tablet
W20250625 14:01:58.398602 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6c8c667108694caab967bd91f74759b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c8c667108694caab967bd91f74759b6 already in progress: creating tablet
I20250625 14:01:58.406191 12053 raft_consensus.cc:3058] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.407176 12172 tablet_bootstrap.cc:492] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.407292 12172 ts_tablet_manager.cc:1397] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.136s user 0.000s sys 0.002s
I20250625 14:01:58.407830 12172 raft_consensus.cc:357] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.407990 12172 raft_consensus.cc:383] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.408037 12172 raft_consensus.cc:738] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.408192 12172 consensus_queue.cc:260] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.408771 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 6f26de29aebc46b49d863c02fe8b1776 (DEFAULT_TABLE table=default.Table_21815747326f4c0dbb326f558f1c7618 [id=498afd05db2b4afa913dbd8dcf00b245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.409067 13063 tablet.cc:1722] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.409940 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9cb56a7e714d45038feaf1132a5e06af
I20250625 14:01:58.410247 11531 catalog_manager.cc:6652] ReplaceTablet: tablet 9cb56a7e714d45038feaf1132a5e06af deleted and replaced by tablet 725a0db4c6374805903657f755ca1783
I20250625 14:01:58.408500 12172 ts_tablet_manager.cc:1428] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.412264 12172 tablet_bootstrap.cc:492] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.413436 12172 tablet_bootstrap.cc:654] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.413861 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cb56a7e714d45038feaf1132a5e06af with delete_type TABLET_DATA_DELETED (replaced by tablet 725a0db4c6374805903657f755ca1783) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.418285 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cb56a7e714d45038feaf1132a5e06af with delete_type TABLET_DATA_DELETED (replaced by tablet 725a0db4c6374805903657f755ca1783) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:58.419881 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9cb56a7e714d45038feaf1132a5e06af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb56a7e714d45038feaf1132a5e06af already in progress: creating tablet
I20250625 14:01:58.420511 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet dce1b63ad2924626972ce7a42a4fdb60
I20250625 14:01:58.421013 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.421113 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 6f26de29aebc46b49d863c02fe8b1776 (DEFAULT_TABLE table=default.Table_21815747326f4c0dbb326f558f1c7618 [id=498afd05db2b4afa913dbd8dcf00b245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.421422 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f26de29aebc46b49d863c02fe8b1776. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.421592 12173 ts_tablet_manager.cc:1918] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.421662 12173 log.cc:1199] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/35ece361f92a4c9a9df5ad3355f87db9
I20250625 14:01:58.421878 12173 ts_tablet_manager.cc:1939] T 35ece361f92a4c9a9df5ad3355f87db9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.422325 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f26de29aebc46b49d863c02fe8b1776. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.423782 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:58.425127 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet dce1b63ad2924626972ce7a42a4fdb60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dce1b63ad2924626972ce7a42a4fdb60 already in progress: creating tablet
I20250625 14:01:58.430612 12026 tablet_service.cc:1468] Processing CreateTablet for tablet b215f2dc28604d1387e9847a5247564d (DEFAULT_TABLE table=default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.430598 11900 tablet_service.cc:1468] Processing CreateTablet for tablet b215f2dc28604d1387e9847a5247564d (DEFAULT_TABLE table=default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.430899 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b215f2dc28604d1387e9847a5247564d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.430898 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b215f2dc28604d1387e9847a5247564d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.433116 12053 raft_consensus.cc:3058] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.436486 12166 tablet_bootstrap.cc:492] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.436594 12166 ts_tablet_manager.cc:1397] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.002s
I20250625 14:01:58.437098 12166 raft_consensus.cc:357] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.437283 12166 raft_consensus.cc:383] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.437320 12166 raft_consensus.cc:738] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.437439 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet d74f27d998b14ee890272812b718e468 (table default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]). Expected version 1 got 0
I20250625 14:01:58.437460 12166 consensus_queue.cc:260] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.437932 12166 ts_tablet_manager.cc:1428] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.439646 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff (DEFAULT_TABLE table=default.Table_ba6488926235441ea0f1a8d78706f1d6 [id=8a0d72a771cc4aea88a1e400245cb1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.440045 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ca3a1ea9b944a2a1830cad6cee3cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.441548 11968 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
I20250625 14:01:58.444308 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet edfce8c80bb341a48fb1b59def057571 with delete_type TABLET_DATA_DELETED (replaced by tablet 8578d07c9b4a44f887b5a30e92c1ede9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.444528 12175 tablet_replica.cc:331] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.444689 12175 raft_consensus.cc:2241] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.444808 12175 raft_consensus.cc:2270] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.445276 12175 ts_tablet_manager.cc:1905] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.446707 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_85edeb4b51284604b988da8b6dbd6a34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.447173 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85edeb4b51284604b988da8b6dbd6a34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.450109 12175 ts_tablet_manager.cc:1918] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.446720 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_461a2c8f9109463899162260bcdb8f07" } new_table_name: "default.Table_23ccd801edbc4c80afbeba211d60923a" modify_external_catalogs: true
I20250625 14:01:58.452492 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f58eef6273194f588541530127a796c2" } new_table_name: "default.Table_c984df852aa94d7ca7bd587f29837bda" modify_external_catalogs: true
I20250625 14:01:58.454535 12166 tablet_bootstrap.cc:492] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.458424 12053 raft_consensus.cc:3058] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.454816 12175 log.cc:1199] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/edfce8c80bb341a48fb1b59def057571
I20250625 14:01:58.459991 12175 ts_tablet_manager.cc:1939] T edfce8c80bb341a48fb1b59def057571 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.460809 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet edfce8c80bb341a48fb1b59def057571 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]) successfully deleted
I20250625 14:01:58.457666 12166 tablet_bootstrap.cc:654] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.462035 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 35ece361f92a4c9a9df5ad3355f87db9 (table default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]) successfully deleted
I20250625 14:01:58.465039 12026 tablet_service.cc:1468] Processing CreateTablet for tablet c06757067b3e465f8239b9ff38b68071 (DEFAULT_TABLE table=default.Table_f3a4b3350e8e41d7836f31c9067e19c1 [id=45e71fb25c9d4772b0a719a4211cbf37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.465041 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff (DEFAULT_TABLE table=default.Table_ba6488926235441ea0f1a8d78706f1d6 [id=8a0d72a771cc4aea88a1e400245cb1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.465567 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ca3a1ea9b944a2a1830cad6cee3cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.467170 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.467000 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cb56a7e714d45038feaf1132a5e06af with delete_type TABLET_DATA_DELETED (replaced by tablet 725a0db4c6374805903657f755ca1783) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.468132 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff (DEFAULT_TABLE table=default.Table_ba6488926235441ea0f1a8d78706f1d6 [id=8a0d72a771cc4aea88a1e400245cb1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.468094 11761 tablet_service.cc:1468] Processing CreateTablet for tablet b215f2dc28604d1387e9847a5247564d (DEFAULT_TABLE table=default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:58.468523 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1fd261d824c34864a7b15e4736254062 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fd261d824c34864a7b15e4736254062 already in progress: creating tablet
I20250625 14:01:58.468050 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 6f26de29aebc46b49d863c02fe8b1776 (DEFAULT_TABLE table=default.Table_21815747326f4c0dbb326f558f1c7618 [id=498afd05db2b4afa913dbd8dcf00b245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.469066 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f26de29aebc46b49d863c02fe8b1776. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.469305 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ca3a1ea9b944a2a1830cad6cee3cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.469465 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b215f2dc28604d1387e9847a5247564d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.470268 12984 tablet.cc:1717] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Skipping requested alter to schema version 2, tablet already version 2
I20250625 14:01:58.472177 13121 raft_consensus.cc:491] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.472267 13121 raft_consensus.cc:513] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.472668 13121 leader_election.cc:290] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.473089 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f61d1400161440e49365680085a3fe63" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:58.473245 11921 raft_consensus.cc:2391] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:01:58.478382 13121 raft_consensus.cc:491] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.478513 13121 raft_consensus.cc:513] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.478924 13121 leader_election.cc:290] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.479411 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0547992986704a949305e7c5d014b965" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:58.479712 12265 consensus_queue.cc:1035] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.480624 11890 tablet_service.cc:1468] Processing CreateTablet for tablet c06757067b3e465f8239b9ff38b68071 (DEFAULT_TABLE table=default.Table_f3a4b3350e8e41d7836f31c9067e19c1 [id=45e71fb25c9d4772b0a719a4211cbf37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.480823 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 13a2c2f498e24f47a12181a89dcbd769 (DEFAULT_TABLE table=default.Table_a38a4acaaaac4b67a46b3eb0eb079312 [id=21a50fe75ad14d07b605f238ce89ca09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.480926 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06757067b3e465f8239b9ff38b68071. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:58.482434 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 58eacad688d747118971f4c4ad163871 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58eacad688d747118971f4c4ad163871 already in progress: creating tablet
I20250625 14:01:58.483543 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 13a2c2f498e24f47a12181a89dcbd769 (DEFAULT_TABLE table=default.Table_a38a4acaaaac4b67a46b3eb0eb079312 [id=21a50fe75ad14d07b605f238ce89ca09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.483769 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a2c2f498e24f47a12181a89dcbd769. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.483806 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a2c2f498e24f47a12181a89dcbd769. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:58.483832 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9bd4226d952d4dc394c33acae7372347 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd4226d952d4dc394c33acae7372347 already in progress: creating tablet
W20250625 14:01:58.484274 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4317c3460f664f32aeb9b25ffb57d5bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4317c3460f664f32aeb9b25ffb57d5bd already in progress: creating tablet
W20250625 14:01:58.484709 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8ebec65b7f6a475ab01359aab392d1cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ebec65b7f6a475ab01359aab392d1cf already in progress: creating tablet
W20250625 14:01:58.485108 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f0833d0e013f48f78cb6c616481b5dce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0833d0e013f48f78cb6c616481b5dce already in progress: creating tablet
I20250625 14:01:58.485576 12238 consensus_queue.cc:1035] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.486119 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06757067b3e465f8239b9ff38b68071. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:58.486784 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 128dab7ad46048cc91fc20ddc1431d57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 128dab7ad46048cc91fc20ddc1431d57 already in progress: creating tablet
W20250625 14:01:58.489701 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5df4b218df7d4e4e9e634d3cd4f17633 consensus state has no leader
I20250625 14:01:58.490782 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 34ef10dc2de8460c90dc0cf3bb5fe234 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.491869 12265 raft_consensus.cc:491] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.491995 12265 raft_consensus.cc:513] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.492379 12265 leader_election.cc:290] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.492651 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1d7b4535b298478b82f91b4918344234" } new_table_name: "default.Table_7b8f1d6665bc48d7941de9d9f6f609d1" modify_external_catalogs: true
I20250625 14:01:58.492973 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a483b01a74c424db2a10c3215783411" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:58.493110 11782 raft_consensus.cc:2466] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:58.493528 11858 leader_election.cc:304] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:58.493774 12265 raft_consensus.cc:2802] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:58.493829 12265 raft_consensus.cc:491] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:58.493866 12265 raft_consensus.cc:3058] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.494911 12265 raft_consensus.cc:513] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.495276 12265 leader_election.cc:290] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.495854 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a483b01a74c424db2a10c3215783411" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:58.495996 11782 raft_consensus.cc:3058] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.496600 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_06d43b44b02e415d81733ddc00e3d18b" } modify_external_catalogs: true
I20250625 14:01:58.496702 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_06d43b44b02e415d81733ddc00e3d18b" } modify_external_catalogs: true
I20250625 14:01:58.497138 11782 raft_consensus.cc:2466] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:58.497892 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3a571013915f48b1846783c8681bcd48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.498052 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_16cb68f67e81452ab5be9b16c3e6f0ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.498257 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a571013915f48b1846783c8681bcd48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:58.498281 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16cb68f67e81452ab5be9b16c3e6f0ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.497865 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_adab8acd3bfa4278a0007fbcaa2a79c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.499296 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adab8acd3bfa4278a0007fbcaa2a79c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.500432 11858 leader_election.cc:304] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:58.501430 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_55126bbe64de49bb88e911c8dfa1d9b9" } new_table_name: "default.Table_99ef32b961ed4799869db0bddb6346de" modify_external_catalogs: true
I20250625 14:01:58.501520 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d169eb7ba7584f76b2a6ab70495e4855" } modify_external_catalogs: true
I20250625 14:01:58.501587 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d169eb7ba7584f76b2a6ab70495e4855" } modify_external_catalogs: true
I20250625 14:01:58.502399 12265 raft_consensus.cc:2802] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:58.502501 12265 raft_consensus.cc:695] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:58.502640 12265 consensus_queue.cc:237] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.502632 12166 tablet_bootstrap.cc:492] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.503523 12166 ts_tablet_manager.cc:1397] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20250625 14:01:58.504325 12166 raft_consensus.cc:357] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.504472 12166 raft_consensus.cc:383] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.504529 12166 raft_consensus.cc:738] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.504770 12166 consensus_queue.cc:260] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.505411 12166 ts_tablet_manager.cc:1428] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:58.505820 11526 catalog_manager.cc:5582] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:58.507722 12166 tablet_bootstrap.cc:492] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.510048 12166 tablet_bootstrap.cc:654] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.512441 12166 tablet_bootstrap.cc:492] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.512540 12166 ts_tablet_manager.cc:1397] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20250625 14:01:58.513031 12166 raft_consensus.cc:357] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.513142 12166 raft_consensus.cc:383] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.513182 12166 raft_consensus.cc:738] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.513290 12166 consensus_queue.cc:260] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.513558 12166 ts_tablet_manager.cc:1428] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.513733 12166 tablet_bootstrap.cc:492] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.514856 12166 tablet_bootstrap.cc:654] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.516283 12600 consensus_queue.cc:1035] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.518558 12166 tablet_bootstrap.cc:492] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.518651 12166 ts_tablet_manager.cc:1397] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20250625 14:01:58.519163 12166 raft_consensus.cc:357] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.519284 12166 raft_consensus.cc:383] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.519318 12166 raft_consensus.cc:738] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.519452 12166 consensus_queue.cc:260] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.519735 12166 ts_tablet_manager.cc:1428] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.519919 12166 tablet_bootstrap.cc:492] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.521957 12053 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a483b01a74c424db2a10c3215783411" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:58.523026 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a483b01a74c424db2a10c3215783411" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:58.523206 11855 leader_election.cc:343] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.523963 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 34ef10dc2de8460c90dc0cf3bb5fe234
I20250625 14:01:58.524291 11531 catalog_manager.cc:6652] ReplaceTablet: tablet 34ef10dc2de8460c90dc0cf3bb5fe234 deleted and replaced by tablet cdbebbb725564dc98c30ce4bbd3af8db
I20250625 14:01:58.525214 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.525734 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f61d1400161440e49365680085a3fe63" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:58.526106 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0547992986704a949305e7c5d014b965" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:58.526691 11761 tablet_service.cc:1468] Processing CreateTablet for tablet c06757067b3e465f8239b9ff38b68071 (DEFAULT_TABLE table=default.Table_f3a4b3350e8e41d7836f31c9067e19c1 [id=45e71fb25c9d4772b0a719a4211cbf37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.526990 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06757067b3e465f8239b9ff38b68071. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.527928 12173 tablet_replica.cc:331] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.528096 12173 raft_consensus.cc:2241] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.528211 12173 raft_consensus.cc:2270] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.528759 12173 ts_tablet_manager.cc:1905] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.529578 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 13a2c2f498e24f47a12181a89dcbd769 (DEFAULT_TABLE table=default.Table_a38a4acaaaac4b67a46b3eb0eb079312 [id=21a50fe75ad14d07b605f238ce89ca09]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.529826 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13a2c2f498e24f47a12181a89dcbd769. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:58.532864 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet dce1b63ad2924626972ce7a42a4fdb60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dce1b63ad2924626972ce7a42a4fdb60 already in progress: creating tablet
W20250625 14:01:58.533030 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9cb56a7e714d45038feaf1132a5e06af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb56a7e714d45038feaf1132a5e06af already in progress: creating tablet
I20250625 14:01:58.538586 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5f225879b77a4d1f8083b0a7f1929e36" } new_table_name: "default.Table_3ef297edd2b74ada8037c6bc3018ccb8" modify_external_catalogs: true
I20250625 14:01:58.539297 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b4d06384dfcc49e1b0cc55d392fe9f24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.539538 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4b76d36bac354543b8f7cef071aaa661
W20250625 14:01:58.539696 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4d06384dfcc49e1b0cc55d392fe9f24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.540103 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_40002fc3ebb64224b030b871c7a3dd5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.540495 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40002fc3ebb64224b030b871c7a3dd5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.540867 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 628edde0bd0840c6a11c79f8ab810977 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.541647 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef
I20250625 14:01:58.541620 11993 leader_election.cc:304] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:58.541878 11993 leader_election.cc:304] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:01:58.542143 11855 leader_election.cc:343] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.542409 12666 raft_consensus.cc:3058] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.543612 12666 raft_consensus.cc:2747] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.543748 12666 raft_consensus.cc:2747] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 14:01:58.544595 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_39dbe13f14dd4baa92a5256ab572973a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.545001 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39dbe13f14dd4baa92a5256ab572973a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:58.546067 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 44dd83c53b15400d94bb7b1a8784569a consensus state has no leader
I20250625 14:01:58.547271 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.552448 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e11dc32e96254d3489a8f9c7028feaca" } modify_external_catalogs: true
I20250625 14:01:58.552608 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e11dc32e96254d3489a8f9c7028feaca" } modify_external_catalogs: true
I20250625 14:01:58.555423 12167 tablet_bootstrap.cc:492] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.555534 12167 ts_tablet_manager.cc:1397] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.184s user 0.003s sys 0.000s
I20250625 14:01:58.555754 12166 tablet_bootstrap.cc:654] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.556080 12167 raft_consensus.cc:357] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.556190 12167 raft_consensus.cc:383] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.556221 12167 raft_consensus.cc:738] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.556392 12167 consensus_queue.cc:260] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.556438 12600 raft_consensus.cc:491] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.556529 12600 raft_consensus.cc:513] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.556696 12167 ts_tablet_manager.cc:1428] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.556892 12167 tablet_bootstrap.cc:492] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.556975 12600 leader_election.cc:290] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.557982 12167 tablet_bootstrap.cc:654] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.558225 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbf41efa64294f388894a9a57b45fdc2" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:58.558864 11855 leader_election.cc:343] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.559062 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fbf41efa64294f388894a9a57b45fdc2" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:58.559502 11858 leader_election.cc:343] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.559580 11858 leader_election.cc:304] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.559813 12600 raft_consensus.cc:2747] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.560274 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_677ffd0785754cb59fc1473d4fe7be22" } modify_external_catalogs: true
I20250625 14:01:58.560403 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_677ffd0785754cb59fc1473d4fe7be22" } modify_external_catalogs: true
I20250625 14:01:58.563894 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.566439 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_29210cfb24ec49caadf051016702660e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.566689 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 with delete_type TABLET_DATA_DELETED (replaced by tablet cdbebbb725564dc98c30ce4bbd3af8db) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:58.566906 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29210cfb24ec49caadf051016702660e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.566948 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_312ca07ca7b941c4a2dae1ae52c46b56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.567287 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_312ca07ca7b941c4a2dae1ae52c46b56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.568110 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b76d36bac354543b8f7cef071aaa661 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.570003 12177 tablet_replica.cc:331] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.570166 12177 raft_consensus.cc:2241] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:58.570384 12177 raft_consensus.cc:2270] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.570822 12177 ts_tablet_manager.cc:1905] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.573495 12177 ts_tablet_manager.cc:1918] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250625 14:01:58.573577 12177 log.cc:1199] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/4b76d36bac354543b8f7cef071aaa661
I20250625 14:01:58.573832 12177 ts_tablet_manager.cc:1939] T 4b76d36bac354543b8f7cef071aaa661 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.577780 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet c474af1901c74e6895c3a08f1cc7c65c from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.578760 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 628edde0bd0840c6a11c79f8ab810977
I20250625 14:01:58.578819 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b215f2dc28604d1387e9847a5247564d
I20250625 14:01:58.579053 11528 catalog_manager.cc:6652] ReplaceTablet: tablet 628edde0bd0840c6a11c79f8ab810977 deleted and replaced by tablet 3b589e49a8844aa3acb9f8e27c0f6faf
I20250625 14:01:58.579334 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8b1bf8f04694456e91687d89ceb39d56
I20250625 14:01:58.580508 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d5493976be964fea9539f63099a0464c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.580940 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5493976be964fea9539f63099a0464c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:58.582007 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9a788be0b8640dc9d6d06fa86580f6b consensus state has no leader
I20250625 14:01:58.582263 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 with delete_type TABLET_DATA_DELETED (replaced by tablet cdbebbb725564dc98c30ce4bbd3af8db) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.584168 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 with delete_type TABLET_DATA_DELETED (replaced by tablet cdbebbb725564dc98c30ce4bbd3af8db) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.588090 12953 tablet.cc:1722] T 7ebac6abf36f44fb93f556b59b2dd022 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.588752 12167 tablet_bootstrap.cc:492] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.588907 12984 tablet.cc:1722] T 7ebac6abf36f44fb93f556b59b2dd022 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.589367 12167 ts_tablet_manager.cc:1397] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.002s
I20250625 14:01:58.590090 12167 raft_consensus.cc:357] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.592216 12233 tablet.cc:1722] T 7ebac6abf36f44fb93f556b59b2dd022 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.594364 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b76d36bac354543b8f7cef071aaa661 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.594887 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 4b76d36bac354543b8f7cef071aaa661 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.595438 12167 raft_consensus.cc:383] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.595589 12167 raft_consensus.cc:738] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.595809 12167 consensus_queue.cc:260] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.596304 12167 ts_tablet_manager.cc:1428] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20250625 14:01:58.596812 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.597617 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d99e27063554845bea98bbe70eba3b9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.597621 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet fa2ccf77288144e5b81513dede9d4302 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.597313 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.598184 12167 tablet_bootstrap.cc:492] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.598837 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet b949191f6218463192890e13ccf6b17e with delete_type TABLET_DATA_DELETED (replaced by tablet 3faa8782ba0d45dbbd89437685a64aef) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.599205 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet fbf41efa64294f388894a9a57b45fdc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21908df7bb384e9782b97abe6f06b0f5) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.602180 12167 tablet_bootstrap.cc:654] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.603276 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 628edde0bd0840c6a11c79f8ab810977 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b589e49a8844aa3acb9f8e27c0f6faf) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.603543 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet b215f2dc28604d1387e9847a5247564d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.603938 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 628edde0bd0840c6a11c79f8ab810977 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b589e49a8844aa3acb9f8e27c0f6faf) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.604305 12175 tablet_replica.cc:331] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.604516 12175 raft_consensus.cc:2241] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.604821 12175 raft_consensus.cc:2270] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.605314 12175 ts_tablet_manager.cc:1905] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.606232 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet b215f2dc28604d1387e9847a5247564d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.606475 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.607244 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:01:58.607378 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 54a59027aef04a12a0bf1fbece3c3161 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54a59027aef04a12a0bf1fbece3c3161 already in progress: creating tablet
W20250625 14:01:58.607673 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12c5e71b4a4f4efc81f822bdf95d0f99 already in progress: creating tablet
W20250625 14:01:58.607930 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 6c8c667108694caab967bd91f74759b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c8c667108694caab967bd91f74759b6 already in progress: creating tablet
I20250625 14:01:58.608234 12175 ts_tablet_manager.cc:1918] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250625 14:01:58.608314 12175 log.cc:1199] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/4b76d36bac354543b8f7cef071aaa661
I20250625 14:01:58.608593 12175 ts_tablet_manager.cc:1939] T 4b76d36bac354543b8f7cef071aaa661 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:01:58.610028 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34ef10dc2de8460c90dc0cf3bb5fe234 already in progress: creating tablet
I20250625 14:01:58.610790 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.610965 12166 tablet_bootstrap.cc:492] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.611083 12166 ts_tablet_manager.cc:1397] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.091s user 0.002s sys 0.000s
I20250625 14:01:58.611541 12166 raft_consensus.cc:357] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.611656 12166 raft_consensus.cc:383] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.611692 12166 raft_consensus.cc:738] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.611804 12166 consensus_queue.cc:260] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.612079 12166 ts_tablet_manager.cc:1428] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.612279 12166 tablet_bootstrap.cc:492] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.613534 12166 tablet_bootstrap.cc:654] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:58.617460 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef already in progress: creating tablet
W20250625 14:01:58.621546 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34ef10dc2de8460c90dc0cf3bb5fe234 already in progress: creating tablet
I20250625 14:01:58.621752 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_d169eb7ba7584f76b2a6ab70495e4855 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
I20250625 14:01:58.626178 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c474af1901c74e6895c3a08f1cc7c65c
I20250625 14:01:58.626397 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 295ddb94cd4f489c9d53875bd1578474 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.626536 11532 catalog_manager.cc:6652] ReplaceTablet: tablet c474af1901c74e6895c3a08f1cc7c65c deleted and replaced by tablet 41eb1c8d2afa4a4593a466bffae5dc23
I20250625 14:01:58.626914 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ba6488926235441ea0f1a8d78706f1d6" } modify_external_catalogs: true
I20250625 14:01:58.627032 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ba6488926235441ea0f1a8d78706f1d6" } modify_external_catalogs: true
I20250625 14:01:58.628096 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_d169eb7ba7584f76b2a6ab70495e4855 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
I20250625 14:01:58.629033 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet c474af1901c74e6895c3a08f1cc7c65c with delete_type TABLET_DATA_DELETED (replaced by tablet 41eb1c8d2afa4a4593a466bffae5dc23) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.629287 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet c474af1901c74e6895c3a08f1cc7c65c with delete_type TABLET_DATA_DELETED (replaced by tablet 41eb1c8d2afa4a4593a466bffae5dc23) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.629683 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.630380 12166 tablet_bootstrap.cc:492] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.630426 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_7b8f1d6665bc48d7941de9d9f6f609d1 [id=5c8c581dd0874ff4899ea9d857c40a3c] alter complete (version 1)
I20250625 14:01:58.630489 12166 ts_tablet_manager.cc:1397] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:01:58.631032 12166 raft_consensus.cc:357] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.631150 12166 raft_consensus.cc:383] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.631196 12166 raft_consensus.cc:738] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.631325 12166 consensus_queue.cc:260] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.631626 12166 ts_tablet_manager.cc:1428] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:58.631821 12166 tablet_bootstrap.cc:492] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.632143 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 8feddd83af08466ea11c4a15a08d3c8b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.633275 12166 tablet_bootstrap.cc:654] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.634727 12172 tablet_bootstrap.cc:492] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.634835 12172 ts_tablet_manager.cc:1397] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.223s user 0.002s sys 0.000s
I20250625 14:01:58.635291 12172 raft_consensus.cc:357] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.635398 12172 raft_consensus.cc:383] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.635434 12172 raft_consensus.cc:738] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.635577 12172 consensus_queue.cc:260] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.635860 12172 ts_tablet_manager.cc:1428] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.636214 12172 tablet_bootstrap.cc:492] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.637324 12172 tablet_bootstrap.cc:654] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.639374 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 60ca3a1ea9b944a2a1830cad6cee3cff
I20250625 14:01:58.640305 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.640806 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.641769 12166 tablet_bootstrap.cc:492] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.641891 12166 ts_tablet_manager.cc:1397] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:58.642464 12166 raft_consensus.cc:357] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.642582 12166 raft_consensus.cc:383] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.642617 12166 raft_consensus.cc:738] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.642745 12166 consensus_queue.cc:260] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.643029 12166 ts_tablet_manager.cc:1428] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.643620 12166 tablet_bootstrap.cc:492] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.645371 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.645471 12166 tablet_bootstrap.cc:654] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.652683 12172 tablet_bootstrap.cc:492] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.652808 12172 ts_tablet_manager.cc:1397] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:01:58.652859 12175 tablet_replica.cc:331] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.653116 12175 raft_consensus.cc:2241] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.653465 12175 raft_consensus.cc:2270] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.653564 12172 raft_consensus.cc:357] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.653681 12172 raft_consensus.cc:383] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.653715 12172 raft_consensus.cc:738] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.653841 12172 consensus_queue.cc:260] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.654165 12172 ts_tablet_manager.cc:1428] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.654357 12175 ts_tablet_manager.cc:1905] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.654484 12172 tablet_bootstrap.cc:492] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.655493 12172 tablet_bootstrap.cc:654] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.657095 12175 ts_tablet_manager.cc:1918] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.657253 12175 log.cc:1199] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/5489ee768c384fc0a1c8b6bed25b3a26
I20250625 14:01:58.657614 12175 ts_tablet_manager.cc:1939] T 5489ee768c384fc0a1c8b6bed25b3a26 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.658265 12172 tablet_bootstrap.cc:492] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.658381 12172 ts_tablet_manager.cc:1397] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:58.658846 12172 raft_consensus.cc:357] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.658998 12172 raft_consensus.cc:383] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.659050 12172 raft_consensus.cc:738] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.659163 12172 consensus_queue.cc:260] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.659572 12172 ts_tablet_manager.cc:1428] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.659768 12172 tablet_bootstrap.cc:492] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.659924 12175 tablet_replica.cc:331] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.660054 12175 raft_consensus.cc:2241] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.660204 12175 raft_consensus.cc:2270] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.660712 12175 ts_tablet_manager.cc:1905] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.660832 12172 tablet_bootstrap.cc:654] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.662634 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_05ba0d7a47814bd5b9443c9db8a32e6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.663376 12175 ts_tablet_manager.cc:1918] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.663544 12175 log.cc:1199] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b949191f6218463192890e13ccf6b17e
I20250625 14:01:58.663913 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet b215f2dc28604d1387e9847a5247564d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.664148 12175 ts_tablet_manager.cc:1939] T b949191f6218463192890e13ccf6b17e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.664434 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 628edde0bd0840c6a11c79f8ab810977 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b589e49a8844aa3acb9f8e27c0f6faf) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.664497 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.664620 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet c474af1901c74e6895c3a08f1cc7c65c with delete_type TABLET_DATA_DELETED (replaced by tablet 41eb1c8d2afa4a4593a466bffae5dc23) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.664779 12177 tablet_replica.cc:331] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.664970 12177 raft_consensus.cc:2241] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:58.665191 12177 raft_consensus.cc:2270] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.665460 12175 tablet_replica.cc:331] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.665632 12175 raft_consensus.cc:2241] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.665650 12177 ts_tablet_manager.cc:1905] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.665789 12175 raft_consensus.cc:2270] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.665985 12172 tablet_bootstrap.cc:492] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.666363 12175 ts_tablet_manager.cc:1905] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.666258 12172 ts_tablet_manager.cc:1397] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20250625 14:01:58.668030 12172 raft_consensus.cc:357] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.668435 12172 raft_consensus.cc:383] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.668664 12172 raft_consensus.cc:738] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.668974 12175 ts_tablet_manager.cc:1918] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.669106 12175 log.cc:1199] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/fbf41efa64294f388894a9a57b45fdc2
I20250625 14:01:58.669114 12177 ts_tablet_manager.cc:1918] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:58.669101 12172 consensus_queue.cc:260] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.669404 12175 ts_tablet_manager.cc:1939] T fbf41efa64294f388894a9a57b45fdc2 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.670262 12172 ts_tablet_manager.cc:1428] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:01:58.669384 12177 log.cc:1199] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c474af1901c74e6895c3a08f1cc7c65c
I20250625 14:01:58.670859 12172 tablet_bootstrap.cc:492] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.671046 12177 ts_tablet_manager.cc:1939] T c474af1901c74e6895c3a08f1cc7c65c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.672525 12175 tablet_replica.cc:331] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.672720 12175 raft_consensus.cc:2241] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.672888 12175 raft_consensus.cc:2270] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.673808 12173 ts_tablet_manager.cc:1918] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.673908 12172 tablet_bootstrap.cc:654] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.673966 12173 log.cc:1199] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/1dc443822d504733b5d67e212020df0e
I20250625 14:01:58.674295 12173 ts_tablet_manager.cc:1939] T 1dc443822d504733b5d67e212020df0e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.674984 12175 ts_tablet_manager.cc:1905] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.675642 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.675669 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet edfce8c80bb341a48fb1b59def057571 with delete_type TABLET_DATA_DELETED (replaced by tablet 8578d07c9b4a44f887b5a30e92c1ede9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.675938 12177 tablet_replica.cc:331] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.676083 12177 raft_consensus.cc:2241] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.677312 12177 raft_consensus.cc:2270] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.677518 12233 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:01:58.678270 12177 ts_tablet_manager.cc:1905] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.679190 12173 tablet_replica.cc:331] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.680312 12053 raft_consensus.cc:3058] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.680614 12175 ts_tablet_manager.cc:1918] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:58.680687 12175 log.cc:1199] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c474af1901c74e6895c3a08f1cc7c65c
W20250625 14:01:58.680692 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b215f2dc28604d1387e9847a5247564d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b215f2dc28604d1387e9847a5247564d already in progress: creating tablet
I20250625 14:01:58.679795 12173 raft_consensus.cc:2241] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.680954 12175 ts_tablet_manager.cc:1939] T c474af1901c74e6895c3a08f1cc7c65c P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:01:58.681025 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 628edde0bd0840c6a11c79f8ab810977 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 628edde0bd0840c6a11c79f8ab810977 already in progress: creating tablet
I20250625 14:01:58.681056 12173 raft_consensus.cc:2270] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:58.681275 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8b1bf8f04694456e91687d89ceb39d56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b1bf8f04694456e91687d89ceb39d56 already in progress: creating tablet
I20250625 14:01:58.681488 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]) successfully deleted
W20250625 14:01:58.681705 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 60ca3a1ea9b944a2a1830cad6cee3cff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ca3a1ea9b944a2a1830cad6cee3cff already in progress: creating tablet
I20250625 14:01:58.682225 12173 ts_tablet_manager.cc:1905] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.682528 12172 tablet_bootstrap.cc:492] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.682560 12984 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:01:58.682623 12172 ts_tablet_manager.cc:1397] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20250625 14:01:58.684947 12177 ts_tablet_manager.cc:1918] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.685429 12167 tablet_bootstrap.cc:492] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.685588 12167 ts_tablet_manager.cc:1397] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.087s user 0.001s sys 0.002s
I20250625 14:01:58.686147 12167 raft_consensus.cc:357] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.686270 12167 raft_consensus.cc:383] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.686365 12167 raft_consensus.cc:738] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.686540 12167 consensus_queue.cc:260] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.686936 12167 ts_tablet_manager.cc:1428] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.687139 12167 tablet_bootstrap.cc:492] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.688736 12167 tablet_bootstrap.cc:654] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.689368 12173 ts_tablet_manager.cc:1918] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250625 14:01:58.689721 12173 log.cc:1199] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/4b76d36bac354543b8f7cef071aaa661
I20250625 14:01:58.690654 12167 tablet_bootstrap.cc:492] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.690738 12167 ts_tablet_manager.cc:1397] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:01:58.691612 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_59df2339a1ce4fcba83a683bad90e026" } new_table_name: "default.Table_32b413d2535247dabef6866ffa215cae" modify_external_catalogs: true
I20250625 14:01:58.691221 12167 raft_consensus.cc:357] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.691843 12167 raft_consensus.cc:383] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.692051 12167 raft_consensus.cc:738] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.692474 12167 consensus_queue.cc:260] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.691005 12173 ts_tablet_manager.cc:1939] T 4b76d36bac354543b8f7cef071aaa661 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.694281 12167 ts_tablet_manager.cc:1428] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250625 14:01:58.695513 12167 tablet_bootstrap.cc:492] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.699144 12953 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:01:58.700831 12173 tablet_replica.cc:331] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.702188 12173 raft_consensus.cc:2241] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.703238 12173 raft_consensus.cc:2270] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.706611 12177 log.cc:1199] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/edfce8c80bb341a48fb1b59def057571
I20250625 14:01:58.706502 12167 tablet_bootstrap.cc:654] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.695422 13137 consensus_queue.cc:1035] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.699007 12894 raft_consensus.cc:491] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.706818 12894 raft_consensus.cc:513] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.706565 12173 ts_tablet_manager.cc:1905] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.707163 12894 leader_election.cc:290] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.706167 12208 consensus_queue.cc:1035] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.689957 12172 raft_consensus.cc:357] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.707280 12172 raft_consensus.cc:383] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.707324 12172 raft_consensus.cc:738] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.707489 12172 consensus_queue.cc:260] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.707851 12172 ts_tablet_manager.cc:1428] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.025s user 0.000s sys 0.001s
I20250625 14:01:58.708096 12172 tablet_bootstrap.cc:492] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.709324 12177 ts_tablet_manager.cc:1939] T edfce8c80bb341a48fb1b59def057571 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.712354 12600 raft_consensus.cc:491] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.712469 12600 raft_consensus.cc:513] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.712875 12600 leader_election.cc:290] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.713176 12053 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34806da4b2ec4c2db13322952bf943c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:58.713299 12172 tablet_bootstrap.cc:654] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.713415 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34806da4b2ec4c2db13322952bf943c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:58.713717 11855 leader_election.cc:343] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:58.713969 11858 leader_election.cc:343] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.714047 11858 leader_election.cc:304] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.714260 12600 raft_consensus.cc:2747] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.715269 13117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Bootstrap replayed 1/1 log segments. Stats: ops{read=487 overwritten=0 applied=487 ignored=0} inserts{seen=384 ignored=0} mutations{seen=556 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250625 14:01:58.715539 12053 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e9c835f1c3dc47c09fcd413793c7b468" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:58.715790 13117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: Bootstrap complete.
I20250625 14:01:58.718253 12173 ts_tablet_manager.cc:1918] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:58.718690 12173 log.cc:1199] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c474af1901c74e6895c3a08f1cc7c65c
I20250625 14:01:58.719293 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e9c835f1c3dc47c09fcd413793c7b468" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:58.719437 11920 raft_consensus.cc:2466] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:58.719630 12173 ts_tablet_manager.cc:1939] T c474af1901c74e6895c3a08f1cc7c65c P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.719967 13117 raft_consensus.cc:357] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:58.720479 13117 raft_consensus.cc:738] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac8e2e2cf5c4faea7755bbad7d23d99, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.721055 13117 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 487, Last appended: 1.487, Last appended by leader: 487, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:01:58.722087 12167 tablet_bootstrap.cc:492] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.722190 12167 ts_tablet_manager.cc:1397] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.004s
W20250625 14:01:58.722383 11717 leader_election.cc:343] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:58.722761 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05ba0d7a47814bd5b9443c9db8a32e6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.722898 13117 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: configured and running, proceeding with master startup.
I20250625 14:01:58.723502 11717 leader_election.cc:304] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:01:58.652626 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef already in progress: creating tablet
I20250625 14:01:58.723748 12238 consensus_queue.cc:1035] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:01:58.723718 11517 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.11.39.130:45381, user_credentials={real_user=slave}} blocked reactor thread for 71107.6us
I20250625 14:01:58.724117 12238 raft_consensus.cc:2802] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:58.724179 12238 raft_consensus.cc:491] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:58.724220 12238 raft_consensus.cc:3058] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.724236 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 1dc443822d504733b5d67e212020df0e (table default.Table_7854449269c249a3bce7ffeebec57005 [id=7e7a74b6fc62426db15b91037d400d42]) successfully deleted
W20250625 14:01:58.724372 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9cb56a7e714d45038feaf1132a5e06af because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cb56a7e714d45038feaf1132a5e06af already in progress: creating tablet
W20250625 14:01:58.724478 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet dce1b63ad2924626972ce7a42a4fdb60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dce1b63ad2924626972ce7a42a4fdb60 already in progress: creating tablet
W20250625 14:01:58.724570 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34ef10dc2de8460c90dc0cf3bb5fe234 already in progress: creating tablet
I20250625 14:01:58.725263 12238 raft_consensus.cc:513] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.725606 12238 leader_election.cc:290] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.727269 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet edfce8c80bb341a48fb1b59def057571 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]) successfully deleted
I20250625 14:01:58.724640 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 4b76d36bac354543b8f7cef071aaa661 (table default.Table_d169eb7ba7584f76b2a6ab70495e4855 [id=d60959d1e4b14c1d820f04d9bfedfe11]) successfully deleted
W20250625 14:01:58.727689 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef already in progress: creating tablet
W20250625 14:01:58.727802 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 628edde0bd0840c6a11c79f8ab810977 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 628edde0bd0840c6a11c79f8ab810977 already in progress: creating tablet
W20250625 14:01:58.727908 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b215f2dc28604d1387e9847a5247564d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b215f2dc28604d1387e9847a5247564d already in progress: creating tablet
W20250625 14:01:58.728010 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8b1bf8f04694456e91687d89ceb39d56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b1bf8f04694456e91687d89ceb39d56 already in progress: creating tablet
I20250625 14:01:58.728181 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 5489ee768c384fc0a1c8b6bed25b3a26 (table default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]) successfully deleted
I20250625 14:01:58.728281 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b949191f6218463192890e13ccf6b17e (table default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 [id=492a3d0d7a8e44a9a4e12606ef07a9fd]) successfully deleted
I20250625 14:01:58.728364 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet fbf41efa64294f388894a9a57b45fdc2 (table default.Table_99ef32b961ed4799869db0bddb6346de [id=55cc2676447f4267a1b31fb53a7705dd]) successfully deleted
I20250625 14:01:58.728394 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e9c835f1c3dc47c09fcd413793c7b468" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:58.728515 11919 raft_consensus.cc:3058] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:58.728451 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b215f2dc28604d1387e9847a5247564d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b215f2dc28604d1387e9847a5247564d already in progress: creating tablet
W20250625 14:01:58.729233 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 628edde0bd0840c6a11c79f8ab810977 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 628edde0bd0840c6a11c79f8ab810977 already in progress: creating tablet
W20250625 14:01:58.729348 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8b1bf8f04694456e91687d89ceb39d56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b1bf8f04694456e91687d89ceb39d56 already in progress: creating tablet
I20250625 14:01:58.729439 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]) successfully deleted
W20250625 14:01:58.729568 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 60ca3a1ea9b944a2a1830cad6cee3cff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ca3a1ea9b944a2a1830cad6cee3cff already in progress: creating tablet
I20250625 14:01:58.729614 11919 raft_consensus.cc:2466] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:58.730063 12166 tablet_bootstrap.cc:492] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.730149 12166 ts_tablet_manager.cc:1397] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.087s user 0.002s sys 0.000s
I20250625 14:01:58.730360 12167 raft_consensus.cc:357] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.730435 12172 tablet_bootstrap.cc:492] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.730474 12167 raft_consensus.cc:383] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.730508 12167 raft_consensus.cc:738] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.730525 12172 ts_tablet_manager.cc:1397] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20250625 14:01:58.730636 12167 consensus_queue.cc:260] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.730679 12166 raft_consensus.cc:357] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.730767 12166 raft_consensus.cc:383] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.730798 12166 raft_consensus.cc:738] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.730906 12166 consensus_queue.cc:260] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.730969 12167 ts_tablet_manager.cc:1428] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20250625 14:01:58.731024 12172 raft_consensus.cc:357] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.731142 12172 raft_consensus.cc:383] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.731164 12166 ts_tablet_manager.cc:1428] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.731179 12172 raft_consensus.cc:738] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.731279 12172 consensus_queue.cc:260] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.731357 12166 tablet_bootstrap.cc:492] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.731567 12172 ts_tablet_manager.cc:1428] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.731735 12172 tablet_bootstrap.cc:492] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.732395 12166 tablet_bootstrap.cc:654] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.732699 12172 tablet_bootstrap.cc:654] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.733023 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e9c835f1c3dc47c09fcd413793c7b468" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:58.733295 12167 tablet_bootstrap.cc:492] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.733822 11717 leader_election.cc:304] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:58.734218 13137 raft_consensus.cc:2802] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:58.734292 13137 raft_consensus.cc:695] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:58.735227 13137 consensus_queue.cc:237] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.735827 12167 tablet_bootstrap.cc:654] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.737227 12173 tablet_replica.cc:331] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.737370 12173 raft_consensus.cc:2241] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.737462 12173 raft_consensus.cc:2270] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.739682 12953 tablet.cc:1722] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.739755 13121 raft_consensus.cc:491] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.739831 13121 raft_consensus.cc:513] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.740236 13121 leader_election.cc:290] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.742722 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a483b01a74c424db2a10c3215783411" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:58.743613 12167 tablet_bootstrap.cc:492] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.743813 12167 ts_tablet_manager.cc:1397] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20250625 14:01:58.744678 12233 tablet.cc:1722] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.745417 12167 raft_consensus.cc:357] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.745520 12167 raft_consensus.cc:383] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.745549 12167 raft_consensus.cc:738] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.745662 12167 consensus_queue.cc:260] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.746282 12167 ts_tablet_manager.cc:1428] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:58.746505 12167 tablet_bootstrap.cc:492] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.746479 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_c984df852aa94d7ca7bd587f29837bda [id=05ba3fb82ea74715a67dbefb3018db83] alter complete (version 5)
I20250625 14:01:58.747452 11968 heartbeater.cc:344] Connected to a master server at 127.11.39.188:43359
W20250625 14:01:58.748736 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11bd0fc7e8ef430ea2cef302f67b8b22 consensus state has no leader
I20250625 14:01:58.748715 12984 tablet.cc:1722] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:58.749825 11757 tablet_service.cc:1468] Processing CreateTablet for tablet a70afbc1a02a457c9099532e16eaac48 (DEFAULT_TABLE table=default.Table_ca18a9657ad246d1a95d953e4b2389c9 [id=60a0cf9a9dca461c99ae321b9c2528b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.750106 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70afbc1a02a457c9099532e16eaac48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.750084 11756 tablet_service.cc:1468] Processing CreateTablet for tablet ed176205a65d4127b0ae23649187fba0 (DEFAULT_TABLE table=default.Table_7b1b3da0207d4e2fa0a84a55707035c7 [id=6010f3f552cf4773a1beb3d3686fdd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.750267 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed176205a65d4127b0ae23649187fba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.750494 11763 tablet_service.cc:1468] Processing CreateTablet for tablet c188bc758a4c4a71a5550fc11fe59b1a (DEFAULT_TABLE table=default.Table_3fdd6c4a3751422b8f5f2d0a9c17a9ec [id=8030abc171274e888b1dc6dd7b57b98d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.750687 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c188bc758a4c4a71a5550fc11fe59b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.750883 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 (DEFAULT_TABLE table=default.Table_78362853037e4817a825f5e2432d44bc [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.751139 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcc674dc5e448c0871e4efe0c9100b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.752511 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6a483b01a74c424db2a10c3215783411" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:58.752645 11782 raft_consensus.cc:2391] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate bfff52620fea460d850827814b790c35 in this term.
I20250625 14:01:58.752818 11755 tablet_service.cc:1468] Processing CreateTablet for tablet c744b3d26efa42c0bf7fe30c561c692d (DEFAULT_TABLE table=default.Table_6dab46b8294a4cc1913268a5f6933b73 [id=5d7d7235935340089195e54e50d9bc32]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.753021 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c744b3d26efa42c0bf7fe30c561c692d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.753288 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 0f49508e87b5416db9f123df898eaada (DEFAULT_TABLE table=default.Table_4e68cf1c61974d0aa5f1c4bfab1c9fcf [id=f60e403ee8b148c0bba46992498547e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.753504 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f49508e87b5416db9f123df898eaada. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.755154 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 725a0db4c6374805903657f755ca1783 (DEFAULT_TABLE table=default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.755385 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 31f843108ecf440090c05255afa1687e (DEFAULT_TABLE table=default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.755512 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725a0db4c6374805903657f755ca1783. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.755689 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 55ede5e94e12449abbbec9146331deb5 (DEFAULT_TABLE table=default.Table_85edeb4b51284604b988da8b6dbd6a34 [id=0954c7104a6243169519805ca7369806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.755874 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ede5e94e12449abbbec9146331deb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.757479 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6c025a609dc74d37a082a5050f756463" } new_table_name: "default.Table_3e51886fcb0d40efbfbff1e57fc55cf0" modify_external_catalogs: true
I20250625 14:01:58.757534 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_71763ac380284b57b2934b0ef542d711" } modify_external_catalogs: true
I20250625 14:01:58.757642 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_71763ac380284b57b2934b0ef542d711" } modify_external_catalogs: true
I20250625 14:01:58.757709 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b8218761d9fd4d17889a2b82dc4a9cea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.757891 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 (DEFAULT_TABLE table=default.Table_d2eeb21d15424aa0a2f57b108f2028f3 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:58.758044 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8218761d9fd4d17889a2b82dc4a9cea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.758093 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6980c62d63b34c67ad095ad9ea18a3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.758441 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_711bc5a641614b02bfd29d577629b3b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.758731 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_711bc5a641614b02bfd29d577629b3b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.759466 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_84fc4739c8554d4e9fe0419a738f9c79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.759773 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84fc4739c8554d4e9fe0419a738f9c79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.760349 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8f4cc0c04ab146eabd50c010b6986d53" } new_table_name: "default.Table_cf7e033c21a74df9b4b8690ce30c808a" modify_external_catalogs: true
I20250625 14:01:58.760399 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 31157f3bd20f4db5a0baa05b61d92f87 (table default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7]). Expected version 1 got 0
I20250625 14:01:58.760586 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]). Expected version 1 got 0
I20250625 14:01:58.760673 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f5e271b27ac349d6bb8cf47aa8b9668a (table default.Table_5f4cfca1a111436d9a80d3b64d0cfe0f [id=29fdfe34ed7648feb4f21f471fd5e154]). Expected version 1 got 0
I20250625 14:01:58.761404 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_522af79c54de47dca6f8f5b92399167d" } modify_external_catalogs: true
I20250625 14:01:58.761489 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_522af79c54de47dca6f8f5b92399167d" } modify_external_catalogs: true
I20250625 14:01:58.762357 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f843108ecf440090c05255afa1687e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.762933 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fe87d71898b848e49fed4a97af4cefa9" } new_table_name: "default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6" modify_external_catalogs: true
I20250625 14:01:58.768108 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 295ddb94cd4f489c9d53875bd1578474
I20250625 14:01:58.768514 11530 catalog_manager.cc:6652] ReplaceTablet: tablet 295ddb94cd4f489c9d53875bd1578474 deleted and replaced by tablet 881295234a5b4a089985382765774cd9
I20250625 14:01:58.770376 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet d9ed251f36e34e33b35489e9c0c45f9d from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.771991 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 725a0db4c6374805903657f755ca1783 (DEFAULT_TABLE table=default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.772219 11894 tablet_service.cc:1468] Processing CreateTablet for tablet a753b44395994a4abaaa96fb9b6d594a (DEFAULT_TABLE table=default.Table_d1aa2dda09c84623a4377b2c4c4175a2 [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.772262 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 (DEFAULT_TABLE table=default.Table_78362853037e4817a825f5e2432d44bc [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.772406 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 (DEFAULT_TABLE table=default.Table_d2eeb21d15424aa0a2f57b108f2028f3 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.772483 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 55ede5e94e12449abbbec9146331deb5 (DEFAULT_TABLE table=default.Table_85edeb4b51284604b988da8b6dbd6a34 [id=0954c7104a6243169519805ca7369806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.772591 11902 tablet_service.cc:1468] Processing CreateTablet for tablet b55487136b024aa788e31debeb1b2eca (DEFAULT_TABLE table=default.Table_418c3536c18d47b6ba687faf26494aec [id=2a1a9f6617b14b9791434d1474b48ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.772720 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet 295ddb94cd4f489c9d53875bd1578474 with delete_type TABLET_DATA_DELETED (replaced by tablet 881295234a5b4a089985382765774cd9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.772859 11901 tablet_service.cc:1468] Processing CreateTablet for tablet c744b3d26efa42c0bf7fe30c561c692d (DEFAULT_TABLE table=default.Table_6dab46b8294a4cc1913268a5f6933b73 [id=5d7d7235935340089195e54e50d9bc32]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.772934 11898 tablet_service.cc:1468] Processing CreateTablet for tablet cbe2dcd1fb924dcba5c12aaa8e141435 (DEFAULT_TABLE table=default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.773202 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 31f843108ecf440090c05255afa1687e (DEFAULT_TABLE table=default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.773524 11893 tablet_service.cc:1468] Processing CreateTablet for tablet ed176205a65d4127b0ae23649187fba0 (DEFAULT_TABLE table=default.Table_7b1b3da0207d4e2fa0a84a55707035c7 [id=6010f3f552cf4773a1beb3d3686fdd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.773875 11889 tablet_service.cc:1468] Processing CreateTablet for tablet a951fa8b0cab485f9c221367c029fa4a (DEFAULT_TABLE table=default.Table_a6705ab73c6b41b983cb216b9ecf344f [id=b47a27670713465f9246664bd492cd59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.773912 12032 tablet_service.cc:1468] Processing CreateTablet for tablet b55487136b024aa788e31debeb1b2eca (DEFAULT_TABLE table=default.Table_418c3536c18d47b6ba687faf26494aec [id=2a1a9f6617b14b9791434d1474b48ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.772866 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c474af1901c74e6895c3a08f1cc7c65c (table default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]) successfully deleted
I20250625 14:01:58.774003 12026 tablet_service.cc:1468] Processing CreateTablet for tablet a70afbc1a02a457c9099532e16eaac48 (DEFAULT_TABLE table=default.Table_ca18a9657ad246d1a95d953e4b2389c9 [id=60a0cf9a9dca461c99ae321b9c2528b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.774174 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55487136b024aa788e31debeb1b2eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.772733 11897 tablet_service.cc:1468] Processing CreateTablet for tablet c188bc758a4c4a71a5550fc11fe59b1a (DEFAULT_TABLE table=default.Table_3fdd6c4a3751422b8f5f2d0a9c17a9ec [id=8030abc171274e888b1dc6dd7b57b98d]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:58.749859 11717 leader_election.cc:343] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.772591 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 0f49508e87b5416db9f123df898eaada (DEFAULT_TABLE table=default.Table_4e68cf1c61974d0aa5f1c4bfab1c9fcf [id=f60e403ee8b148c0bba46992498547e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.774338 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 (DEFAULT_TABLE table=default.Table_78362853037e4817a825f5e2432d44bc [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.775823 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcc674dc5e448c0871e4efe0c9100b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.772315 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725a0db4c6374805903657f755ca1783. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.776175 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ede5e94e12449abbbec9146331deb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.776438 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c744b3d26efa42c0bf7fe30c561c692d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.776557 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55487136b024aa788e31debeb1b2eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.776679 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bcc674dc5e448c0871e4efe0c9100b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.774595 12037 tablet_service.cc:1468] Processing CreateTablet for tablet a753b44395994a4abaaa96fb9b6d594a (DEFAULT_TABLE table=default.Table_d1aa2dda09c84623a4377b2c4c4175a2 [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.777987 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a753b44395994a4abaaa96fb9b6d594a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.778394 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f49508e87b5416db9f123df898eaada. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.778762 12024 tablet_service.cc:1468] Processing CreateTablet for tablet a951fa8b0cab485f9c221367c029fa4a (DEFAULT_TABLE table=default.Table_a6705ab73c6b41b983cb216b9ecf344f [id=b47a27670713465f9246664bd492cd59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.778995 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a951fa8b0cab485f9c221367c029fa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.774606 12034 tablet_service.cc:1468] Processing CreateTablet for tablet c188bc758a4c4a71a5550fc11fe59b1a (DEFAULT_TABLE table=default.Table_3fdd6c4a3751422b8f5f2d0a9c17a9ec [id=8030abc171274e888b1dc6dd7b57b98d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.780118 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c188bc758a4c4a71a5550fc11fe59b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.780512 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed176205a65d4127b0ae23649187fba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.781261 12173 ts_tablet_manager.cc:1905] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.774713 12027 tablet_service.cc:1468] Processing CreateTablet for tablet c744b3d26efa42c0bf7fe30c561c692d (DEFAULT_TABLE table=default.Table_6dab46b8294a4cc1913268a5f6933b73 [id=5d7d7235935340089195e54e50d9bc32]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.782671 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c744b3d26efa42c0bf7fe30c561c692d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.782944 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c188bc758a4c4a71a5550fc11fe59b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.783313 12173 ts_tablet_manager.cc:1918] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.783372 12173 log.cc:1199] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8feddd83af08466ea11c4a15a08d3c8b
I20250625 14:01:58.783601 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe2dcd1fb924dcba5c12aaa8e141435. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.774812 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 725a0db4c6374805903657f755ca1783 (DEFAULT_TABLE table=default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.784830 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725a0db4c6374805903657f755ca1783. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.784832 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f843108ecf440090c05255afa1687e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.785786 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a753b44395994a4abaaa96fb9b6d594a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.786402 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a951fa8b0cab485f9c221367c029fa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.774912 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 31f843108ecf440090c05255afa1687e (DEFAULT_TABLE table=default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.786974 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f843108ecf440090c05255afa1687e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.775018 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 55ede5e94e12449abbbec9146331deb5 (DEFAULT_TABLE table=default.Table_85edeb4b51284604b988da8b6dbd6a34 [id=0954c7104a6243169519805ca7369806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.787379 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ede5e94e12449abbbec9146331deb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.775148 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 (DEFAULT_TABLE table=default.Table_d2eeb21d15424aa0a2f57b108f2028f3 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.789626 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6980c62d63b34c67ad095ad9ea18a3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.775281 12029 tablet_service.cc:1468] Processing CreateTablet for tablet ed176205a65d4127b0ae23649187fba0 (DEFAULT_TABLE table=default.Table_7b1b3da0207d4e2fa0a84a55707035c7 [id=6010f3f552cf4773a1beb3d3686fdd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.791888 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed176205a65d4127b0ae23649187fba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.792843 12172 tablet_bootstrap.cc:492] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.792939 12172 ts_tablet_manager.cc:1397] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.061s user 0.000s sys 0.001s
I20250625 14:01:58.793470 12172 raft_consensus.cc:357] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.793589 12172 raft_consensus.cc:383] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.793625 12172 raft_consensus.cc:738] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.793763 12172 consensus_queue.cc:260] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.775465 12025 tablet_service.cc:1468] Processing CreateTablet for tablet cbe2dcd1fb924dcba5c12aaa8e141435 (DEFAULT_TABLE table=default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.794113 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe2dcd1fb924dcba5c12aaa8e141435. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.794098 12172 ts_tablet_manager.cc:1428] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.775529 12023 tablet_service.cc:1515] Processing DeleteTablet for tablet 295ddb94cd4f489c9d53875bd1578474 with delete_type TABLET_DATA_DELETED (replaced by tablet 881295234a5b4a089985382765774cd9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.775600 12035 tablet_service.cc:1468] Processing CreateTablet for tablet 0f49508e87b5416db9f123df898eaada (DEFAULT_TABLE table=default.Table_4e68cf1c61974d0aa5f1c4bfab1c9fcf [id=f60e403ee8b148c0bba46992498547e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.796379 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f49508e87b5416db9f123df898eaada. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:58.798760 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 295ddb94cd4f489c9d53875bd1578474 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295ddb94cd4f489c9d53875bd1578474 already in progress: creating tablet
I20250625 14:01:58.799039 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70afbc1a02a457c9099532e16eaac48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.802736 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 295ddb94cd4f489c9d53875bd1578474 with delete_type TABLET_DATA_DELETED (replaced by tablet 881295234a5b4a089985382765774cd9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.803107 12172 tablet_bootstrap.cc:492] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:58.804275 12172 tablet_bootstrap.cc:654] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.805032 11764 tablet_service.cc:1468] Processing CreateTablet for tablet a951fa8b0cab485f9c221367c029fa4a (DEFAULT_TABLE table=default.Table_a6705ab73c6b41b983cb216b9ecf344f [id=b47a27670713465f9246664bd492cd59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.805296 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a951fa8b0cab485f9c221367c029fa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.805564 11900 tablet_service.cc:1468] Processing CreateTablet for tablet a70afbc1a02a457c9099532e16eaac48 (DEFAULT_TABLE table=default.Table_ca18a9657ad246d1a95d953e4b2389c9 [id=60a0cf9a9dca461c99ae321b9c2528b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.805826 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70afbc1a02a457c9099532e16eaac48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.807233 11760 tablet_service.cc:1468] Processing CreateTablet for tablet b55487136b024aa788e31debeb1b2eca (DEFAULT_TABLE table=default.Table_418c3536c18d47b6ba687faf26494aec [id=2a1a9f6617b14b9791434d1474b48ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.807467 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55487136b024aa788e31debeb1b2eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.807668 13186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:58.807830 13186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:58.807931 11757 tablet_service.cc:1468] Processing CreateTablet for tablet a753b44395994a4abaaa96fb9b6d594a (DEFAULT_TABLE table=default.Table_d1aa2dda09c84623a4377b2c4c4175a2 [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.808152 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6980c62d63b34c67ad095ad9ea18a3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.808152 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a753b44395994a4abaaa96fb9b6d594a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.808136 13197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b19d4bb9dd34b4c92dd939a17482334. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:58.808228 13197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99 [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:01:58.808784 11993 leader_election.cc:304] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:58.808960 13121 raft_consensus.cc:3058] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.809795 13121 raft_consensus.cc:2747] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.813553 13070 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "bfff52620fea460d850827814b790c35" instance_seqno: 1750860112036552) as {username='slave'} at 127.11.39.130:43611; Asking this server to re-register.
I20250625 14:01:58.814513 13078 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" instance_seqno: 1750860111839732) as {username='slave'} at 127.11.39.129:50903; Asking this server to re-register.
I20250625 14:01:58.815338 11761 tablet_service.cc:1468] Processing CreateTablet for tablet cbe2dcd1fb924dcba5c12aaa8e141435 (DEFAULT_TABLE table=default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.815636 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe2dcd1fb924dcba5c12aaa8e141435. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.816196 11830 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:58.816347 11968 heartbeater.cc:461] Registering TS with master...
I20250625 14:01:58.819509 13078 ts_manager.cc:194] Registered new tserver with Master: 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.819715 13070 ts_manager.cc:194] Registered new tserver with Master: bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.819844 13077 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" instance_seqno: 1750860112228776) as {username='slave'} at 127.11.39.131:40753; Asking this server to re-register.
I20250625 14:01:58.820889 12103 heartbeater.cc:461] Registering TS with master...
W20250625 14:01:58.821614 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 295ddb94cd4f489c9d53875bd1578474 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295ddb94cd4f489c9d53875bd1578474 already in progress: creating tablet
I20250625 14:01:58.821745 12173 ts_tablet_manager.cc:1939] T 8feddd83af08466ea11c4a15a08d3c8b P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.822500 12166 tablet_bootstrap.cc:492] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.822609 12166 ts_tablet_manager.cc:1397] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.091s user 0.002s sys 0.000s
I20250625 14:01:58.822610 13078 ts_manager.cc:194] Registered new tserver with Master: 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:58.822748 12167 tablet_bootstrap.cc:654] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.823153 12166 raft_consensus.cc:357] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.823266 12166 raft_consensus.cc:383] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.823302 12166 raft_consensus.cc:738] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.823432 12166 consensus_queue.cc:260] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.823771 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8feddd83af08466ea11c4a15a08d3c8b (table default.Table_ec27a022d9e9492babebf395fc96724d [id=d9b7da024f7841eb867569b7c06dc2a5]) successfully deleted
I20250625 14:01:58.823870 12167 tablet_bootstrap.cc:492] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.823890 12166 ts_tablet_manager.cc:1428] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.823959 12167 ts_tablet_manager.cc:1397] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.078s user 0.000s sys 0.002s
W20250625 14:01:58.823947 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 60ca3a1ea9b944a2a1830cad6cee3cff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60ca3a1ea9b944a2a1830cad6cee3cff already in progress: creating tablet
I20250625 14:01:58.824101 12166 tablet_bootstrap.cc:492] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:58.824105 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 295ddb94cd4f489c9d53875bd1578474 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295ddb94cd4f489c9d53875bd1578474 already in progress: creating tablet
I20250625 14:01:58.824432 12167 raft_consensus.cc:357] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.824551 12167 raft_consensus.cc:383] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.824595 12167 raft_consensus.cc:738] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.824717 12167 consensus_queue.cc:260] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.825034 12167 ts_tablet_manager.cc:1428] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:58.825213 12167 tablet_bootstrap.cc:492] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.825517 12166 tablet_bootstrap.cc:654] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.827199 12172 tablet_bootstrap.cc:492] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:58.827306 12172 ts_tablet_manager.cc:1397] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.002s
I20250625 14:01:58.827353 11527 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 3b589e49a8844aa3acb9f8e27c0f6faf
I20250625 14:01:58.827400 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6a483b01a74c424db2a10c3215783411
I20250625 14:01:58.827792 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_418c3536c18d47b6ba687faf26494aec" } modify_external_catalogs: true
I20250625 14:01:58.827926 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_418c3536c18d47b6ba687faf26494aec" } modify_external_catalogs: true
I20250625 14:01:58.827914 12172 raft_consensus.cc:357] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.828028 12172 raft_consensus.cc:383] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.828063 12172 raft_consensus.cc:738] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.828197 12172 consensus_queue.cc:260] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.828840 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_624b939aea9f40bdbe04f0a87a83f8c3" } modify_external_catalogs: true
I20250625 14:01:58.828946 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_624b939aea9f40bdbe04f0a87a83f8c3" } modify_external_catalogs: true
I20250625 14:01:58.828990 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4ca6f331bfad4a5db8b2da07d1cfa7a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.829363 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ca6f331bfad4a5db8b2da07d1cfa7a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.829753 12172 ts_tablet_manager.cc:1428] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:58.829870 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_77847d143a98441197cbf9363315fb78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.829967 12172 tablet_bootstrap.cc:492] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:58.830197 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77847d143a98441197cbf9363315fb78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.830416 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a483b01a74c424db2a10c3215783411 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.830624 12175 tablet_replica.cc:331] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.830753 12175 raft_consensus.cc:2241] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:58.831058 12175 pending_rounds.cc:70] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:01:58.831108 12175 pending_rounds.cc:77] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523045388685312 op_type: NO_OP noop_request { }
I20250625 14:01:58.831207 12175 raft_consensus.cc:2887] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:01:58.831262 12175 raft_consensus.cc:2270] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:58.831596 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9ed052ae88e4b679ac55177a3bbab88 consensus state has no leader
I20250625 14:01:58.831794 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4571ef6dee28441bb7db7d12168d94c7" } new_table_name: "default.Table_24234495422c4a268ac8113d692ae092" modify_external_catalogs: true
I20250625 14:01:58.832623 12172 tablet_bootstrap.cc:654] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.837330 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d9ed251f36e34e33b35489e9c0c45f9d
I20250625 14:01:58.837644 11530 catalog_manager.cc:6652] ReplaceTablet: tablet d9ed251f36e34e33b35489e9c0c45f9d deleted and replaced by tablet 8ef6745366054d0dbdda7c0ffa2313c4
I20250625 14:01:58.837901 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d2dc78ca4ab140898fcf05498f5a7003"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.838285 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet d9ed251f36e34e33b35489e9c0c45f9d with delete_type TABLET_DATA_DELETED (replaced by tablet 8ef6745366054d0dbdda7c0ffa2313c4) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:58.838369 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2dc78ca4ab140898fcf05498f5a7003 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.840173 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a483b01a74c424db2a10c3215783411 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.840327 11526 catalog_manager.cc:5582] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
W20250625 14:01:58.841204 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9c835f1c3dc47c09fcd413793c7b468 consensus state has no leader
I20250625 14:01:58.841457 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d3d8631cb0b448dcbcd5ce16b5c57453"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.841828 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3d8631cb0b448dcbcd5ce16b5c57453 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.842466 12177 tablet_replica.cc:331] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.842604 12177 raft_consensus.cc:2241] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.842697 12177 raft_consensus.cc:2270] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.843197 12177 ts_tablet_manager.cc:1905] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.844491 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet d9ed251f36e34e33b35489e9c0c45f9d with delete_type TABLET_DATA_DELETED (replaced by tablet 8ef6745366054d0dbdda7c0ffa2313c4) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.845378 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a483b01a74c424db2a10c3215783411 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.845649 12177 ts_tablet_manager.cc:1918] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.845722 12177 log.cc:1199] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6a483b01a74c424db2a10c3215783411
I20250625 14:01:58.845924 12177 ts_tablet_manager.cc:1939] T 6a483b01a74c424db2a10c3215783411 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.846251 12177 tablet_replica.cc:331] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.846413 12177 raft_consensus.cc:2241] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:58.846496 12173 tablet_replica.cc:331] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.846607 12177 raft_consensus.cc:2270] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.846627 12173 raft_consensus.cc:2241] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.846727 12173 raft_consensus.cc:2270] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.847486 12173 ts_tablet_manager.cc:1905] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.848198 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6a483b01a74c424db2a10c3215783411 (table default.Table_71763ac380284b57b2934b0ef542d711 [id=73b6c64b51d344b89b94deab58c14218]) successfully deleted
I20250625 14:01:58.849692 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet d9ed251f36e34e33b35489e9c0c45f9d with delete_type TABLET_DATA_DELETED (replaced by tablet 8ef6745366054d0dbdda7c0ffa2313c4) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.849944 12173 ts_tablet_manager.cc:1918] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.850018 12173 log.cc:1199] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6a483b01a74c424db2a10c3215783411
I20250625 14:01:58.850230 12173 ts_tablet_manager.cc:1939] T 6a483b01a74c424db2a10c3215783411 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.850847 12175 ts_tablet_manager.cc:1905] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.851835 12984 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:58.853267 12175 ts_tablet_manager.cc:1918] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:58.853340 12175 log.cc:1199] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6a483b01a74c424db2a10c3215783411
I20250625 14:01:58.853592 12175 ts_tablet_manager.cc:1939] T 6a483b01a74c424db2a10c3215783411 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.853807 12233 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:58.854840 12177 ts_tablet_manager.cc:1905] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.856390 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 975a71cb743443dc97228472e00b8c5c
I20250625 14:01:58.856712 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b55487136b024aa788e31debeb1b2eca
I20250625 14:01:58.856925 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1b24c24d74c040278e5b696da66ddc5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.857116 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_634b6d869acd4da2bd66aff2b24c393c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:58.857400 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b24c24d74c040278e5b696da66ddc5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:58.857466 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_634b6d869acd4da2bd66aff2b24c393c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.858108 12177 ts_tablet_manager.cc:1918] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:58.858330 12177 log.cc:1199] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d9ed251f36e34e33b35489e9c0c45f9d
I20250625 14:01:58.858429 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet ed176205a65d4127b0ae23649187fba0 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.858696 12177 ts_tablet_manager.cc:1939] T d9ed251f36e34e33b35489e9c0c45f9d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.859030 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_32b413d2535247dabef6866ffa215cae" } modify_external_catalogs: true
I20250625 14:01:58.859141 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_32b413d2535247dabef6866ffa215cae" } modify_external_catalogs: true
W20250625 14:01:58.859229 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1af86cdb13f427ea61ee8ad56ca3f26 consensus state has no leader
I20250625 14:01:58.859715 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet b55487136b024aa788e31debeb1b2eca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.859908 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 975a71cb743443dc97228472e00b8c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.860764 13210 catalog_manager.cc:1261] Loaded cluster ID: a3a3501b615546dbb967e53684a94696
I20250625 14:01:58.860818 13210 catalog_manager.cc:1554] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: loading cluster ID for follower catalog manager: success
I20250625 14:01:58.861173 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 975a71cb743443dc97228472e00b8c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.861459 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet b55487136b024aa788e31debeb1b2eca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.826279 12167 tablet_bootstrap.cc:654] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.862839 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 975a71cb743443dc97228472e00b8c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.863358 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet b55487136b024aa788e31debeb1b2eca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.864367 12173 tablet_replica.cc:331] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.864526 12173 raft_consensus.cc:2241] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.864647 12173 raft_consensus.cc:2270] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.864959 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6a483b01a74c424db2a10c3215783411 (table default.Table_71763ac380284b57b2934b0ef542d711 [id=73b6c64b51d344b89b94deab58c14218]) successfully deleted
I20250625 14:01:58.865689 12175 tablet_replica.cc:331] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.865880 12175 raft_consensus.cc:2241] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.866052 12175 raft_consensus.cc:2270] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.866798 12175 ts_tablet_manager.cc:1905] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.869182 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6a483b01a74c424db2a10c3215783411 (table default.Table_71763ac380284b57b2934b0ef542d711 [id=73b6c64b51d344b89b94deab58c14218]) successfully deleted
I20250625 14:01:58.870013 12175 ts_tablet_manager.cc:1918] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:58.870095 12175 log.cc:1199] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d9ed251f36e34e33b35489e9c0c45f9d
I20250625 14:01:58.870359 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_eaf70884d45f4eb6b1fc06888fdcd505 [id=06f86a5adb9a4fccb3756ff3fc5aef9c] alter complete (version 1)
I20250625 14:01:58.871239 12167 tablet_bootstrap.cc:492] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:58.871417 12167 ts_tablet_manager.cc:1397] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.002s
I20250625 14:01:58.871606 12173 ts_tablet_manager.cc:1905] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.871897 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 562187f6db8a4883a5bb2d939a31b769 with delete_type TABLET_DATA_DELETED (replaced by tablet fce93c919a3446bb9999be958e08b500) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.873360 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 58eacad688d747118971f4c4ad163871 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.873450 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 0752a7f1371e42d68d83afe41d2f1da9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.873534 12023 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b78fd0d543449bdb2e95fee6a53e93f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:55 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.873632 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 6a483b01a74c424db2a10c3215783411 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.873704 12167 raft_consensus.cc:357] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.873833 12167 raft_consensus.cc:383] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.873885 12167 raft_consensus.cc:738] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.874146 12175 ts_tablet_manager.cc:1939] T d9ed251f36e34e33b35489e9c0c45f9d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:58.874029 12167 consensus_queue.cc:260] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.874042 12173 ts_tablet_manager.cc:1918] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:58.874567 12238 raft_consensus.cc:491] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.874699 12238 raft_consensus.cc:513] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.875082 12238 leader_election.cc:290] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.875504 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34806da4b2ec4c2db13322952bf943c5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:58.875948 11717 leader_election.cc:343] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.876000 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet b949191f6218463192890e13ccf6b17e with delete_type TABLET_DATA_DELETED (replaced by tablet 3faa8782ba0d45dbbd89437685a64aef) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.876197 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet fbf41efa64294f388894a9a57b45fdc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21908df7bb384e9782b97abe6f06b0f5) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.878404 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d99e27063554845bea98bbe70eba3b9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.879374 12167 ts_tablet_manager.cc:1428] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20250625 14:01:58.879938 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ed176205a65d4127b0ae23649187fba0
I20250625 14:01:58.881079 11529 catalog_manager.cc:6652] ReplaceTablet: tablet ed176205a65d4127b0ae23649187fba0 deleted and replaced by tablet f7808bed1b8f4103bf728b8a525dad5d
I20250625 14:01:58.886593 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet ed176205a65d4127b0ae23649187fba0 with delete_type TABLET_DATA_DELETED (replaced by tablet f7808bed1b8f4103bf728b8a525dad5d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.887306 12173 log.cc:1199] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d9ed251f36e34e33b35489e9c0c45f9d
I20250625 14:01:58.887732 12173 ts_tablet_manager.cc:1939] T d9ed251f36e34e33b35489e9c0c45f9d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.889945 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet ed176205a65d4127b0ae23649187fba0 with delete_type TABLET_DATA_DELETED (replaced by tablet f7808bed1b8f4103bf728b8a525dad5d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.875686 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34806da4b2ec4c2db13322952bf943c5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:58.891664 11921 raft_consensus.cc:2466] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:58.888933 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet ed176205a65d4127b0ae23649187fba0 with delete_type TABLET_DATA_DELETED (replaced by tablet f7808bed1b8f4103bf728b8a525dad5d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.892009 11717 leader_election.cc:304] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.892273 12238 raft_consensus.cc:2802] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:58.892354 12238 raft_consensus.cc:491] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:58.892413 12238 raft_consensus.cc:3058] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.892704 12173 tablet_replica.cc:331] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:58.893163 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d9ed251f36e34e33b35489e9c0c45f9d (table default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]) successfully deleted
W20250625 14:01:58.893368 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b55487136b024aa788e31debeb1b2eca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b55487136b024aa788e31debeb1b2eca already in progress: creating tablet
I20250625 14:01:58.893558 12238 raft_consensus.cc:513] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.893957 12238 leader_election.cc:290] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.892885 13121 raft_consensus.cc:491] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.894239 13121 raft_consensus.cc:513] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.894438 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34806da4b2ec4c2db13322952bf943c5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:58.894582 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34806da4b2ec4c2db13322952bf943c5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:58.894649 13121 leader_election.cc:290] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.889161 12167 tablet_bootstrap.cc:492] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:58.894699 11921 raft_consensus.cc:3058] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:58.894737 11717 leader_election.cc:343] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:58.895382 11990 leader_election.cc:343] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 7b78fd0d543449bdb2e95fee6a53e93f
I20250625 14:01:58.895785 11921 raft_consensus.cc:2466] T 34806da4b2ec4c2db13322952bf943c5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:58.895944 12167 tablet_bootstrap.cc:654] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.896559 12238 raft_consensus.cc:491] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.896652 12238 raft_consensus.cc:513] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.896688 12173 raft_consensus.cc:2241] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.896934 12173 raft_consensus.cc:2270] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.897004 12238 leader_election.cc:290] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:58.897382 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d9ed251f36e34e33b35489e9c0c45f9d (table default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]) successfully deleted
I20250625 14:01:58.897663 12175 tablet_replica.cc:331] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:58.897871 12175 raft_consensus.cc:2241] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.898046 12175 raft_consensus.cc:2270] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:58.898433 11993 leader_election.cc:343] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 7b78fd0d543449bdb2e95fee6a53e93f
I20250625 14:01:58.898512 11993 leader_election.cc:304] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:58.898532 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5489ee768c384fc0a1c8b6bed25b3a26" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:58.898716 13121 raft_consensus.cc:2747] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.899031 11717 leader_election.cc:304] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:58.899087 12175 ts_tablet_manager.cc:1905] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.899227 12238 raft_consensus.cc:2802] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 14:01:58.899273 11717 leader_election.cc:343] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 5489ee768c384fc0a1c8b6bed25b3a26
W20250625 14:01:58.899381 11717 leader_election.cc:343] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.899381 12238 raft_consensus.cc:695] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:58.899457 11717 leader_election.cc:304] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:58.900743 13137 raft_consensus.cc:2747] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:58.899559 12238 consensus_queue.cc:237] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.909194 12177 tablet_replica.cc:331] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.909371 12177 raft_consensus.cc:2241] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:58.909551 12177 raft_consensus.cc:2270] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.910158 12177 ts_tablet_manager.cc:1905] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.912153 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 11bd0fc7e8ef430ea2cef302f67b8b22
I20250625 14:01:58.912817 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet e9c835f1c3dc47c09fcd413793c7b468 (table default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6 [id=b434548c0974419586018378be509878]). Expected version 1 got 0
I20250625 14:01:58.915002 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet f5e271b27ac349d6bb8cf47aa8b9668a (table default.Table_5f4cfca1a111436d9a80d3b64d0cfe0f [id=29fdfe34ed7648feb4f21f471fd5e154]). Expected version 1 got 0
I20250625 14:01:58.915515 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.915684 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:58.916978 11921 raft_consensus.cc:1273] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:58.917266 12026 tablet_service.cc:1468] Processing CreateTablet for tablet fddd9a629d984649ad92c8f4fe52e114 (DEFAULT_TABLE table=default.Table_39dbe13f14dd4baa92a5256ab572973a [id=db2d7f8c45ba4676b4fa1da5714279df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.917575 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddd9a629d984649ad92c8f4fe52e114. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.917686 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.917838 12056 raft_consensus.cc:3058] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:58.918869 13137 consensus_queue.cc:1035] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.918999 12056 raft_consensus.cc:1273] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:58.919939 13210 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: acquiring CA information for follower catalog manager: success
I20250625 14:01:58.923173 12177 ts_tablet_manager.cc:1918] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:58.923281 12177 log.cc:1199] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/975a71cb743443dc97228472e00b8c5c
I20250625 14:01:58.923561 12177 ts_tablet_manager.cc:1939] T 975a71cb743443dc97228472e00b8c5c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.924680 11528 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e9c835f1c3dc47c09fcd413793c7b468 (table default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6 [id=b434548c0974419586018378be509878]). Expected version 1 got 0
I20250625 14:01:58.925251 12177 tablet_replica.cc:331] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.925393 12177 raft_consensus.cc:2241] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.925513 12177 raft_consensus.cc:2270] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.926167 12177 ts_tablet_manager.cc:1905] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.926699 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d9ed251f36e34e33b35489e9c0c45f9d (table default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]) successfully deleted
I20250625 14:01:58.926972 11899 tablet_service.cc:1468] Processing CreateTablet for tablet fddd9a629d984649ad92c8f4fe52e114 (DEFAULT_TABLE table=default.Table_39dbe13f14dd4baa92a5256ab572973a [id=db2d7f8c45ba4676b4fa1da5714279df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.927249 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddd9a629d984649ad92c8f4fe52e114. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.930658 12177 ts_tablet_manager.cc:1918] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.930816 12177 log.cc:1199] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b949191f6218463192890e13ccf6b17e
I20250625 14:01:58.931115 12177 ts_tablet_manager.cc:1939] T b949191f6218463192890e13ccf6b17e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.931269 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet a4199634a8be4e359cc9707d4754cac9 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.931466 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 185a1a5f14344caa89473baa57f0b02d (DEFAULT_TABLE table=default.Table_b4d06384dfcc49e1b0cc55d392fe9f24 [id=2efaf3cfcced4f92a53e106561ccec60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.931569 12177 tablet_replica.cc:331] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.931771 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185a1a5f14344caa89473baa57f0b02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.931706 12177 raft_consensus.cc:2241] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.932327 12177 raft_consensus.cc:2270] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.932391 11760 tablet_service.cc:1468] Processing CreateTablet for tablet fddd9a629d984649ad92c8f4fe52e114 (DEFAULT_TABLE table=default.Table_39dbe13f14dd4baa92a5256ab572973a [id=db2d7f8c45ba4676b4fa1da5714279df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.932634 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddd9a629d984649ad92c8f4fe52e114. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.932847 12177 ts_tablet_manager.cc:1905] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.934765 12177 ts_tablet_manager.cc:1918] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.935207 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 185a1a5f14344caa89473baa57f0b02d (DEFAULT_TABLE table=default.Table_b4d06384dfcc49e1b0cc55d392fe9f24 [id=2efaf3cfcced4f92a53e106561ccec60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.935415 12177 log.cc:1199] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/fbf41efa64294f388894a9a57b45fdc2
I20250625 14:01:58.935515 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185a1a5f14344caa89473baa57f0b02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.935498 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 975a71cb743443dc97228472e00b8c5c (table default.Table_624b939aea9f40bdbe04f0a87a83f8c3 [id=9ff06a3b7ae844e18bd0575488004bbf]) successfully deleted
W20250625 14:01:58.935678 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b55487136b024aa788e31debeb1b2eca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b55487136b024aa788e31debeb1b2eca already in progress: creating tablet
I20250625 14:01:58.935810 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b949191f6218463192890e13ccf6b17e (table default.Table_8ac0c0afb60d4d058ddbd40f5227cce0 [id=492a3d0d7a8e44a9a4e12606ef07a9fd]) successfully deleted
I20250625 14:01:58.935969 12177 ts_tablet_manager.cc:1939] T fbf41efa64294f388894a9a57b45fdc2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.936311 12177 tablet_replica.cc:331] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:58.936712 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 4ed7734f171f4692ba7900844100c878 (DEFAULT_TABLE table=default.Table_adab8acd3bfa4278a0007fbcaa2a79c8 [id=a4421b5e7a1845c2b92f8635993abec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.937054 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed7734f171f4692ba7900844100c878. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.938247 12208 consensus_queue.cc:1035] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:58.942081 12173 ts_tablet_manager.cc:1905] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.940019 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 185a1a5f14344caa89473baa57f0b02d (DEFAULT_TABLE table=default.Table_b4d06384dfcc49e1b0cc55d392fe9f24 [id=2efaf3cfcced4f92a53e106561ccec60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.943300 13210 catalog_manager.cc:1604] T 00000000000000000000000000000000 P 4ac8e2e2cf5c4faea7755bbad7d23d99: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250625 14:01:58.943368 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_3e51886fcb0d40efbfbff1e57fc55cf0 [id=62132df62b3a42fb9886592b9b885d31] alter complete (version 2)
I20250625 14:01:58.942826 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185a1a5f14344caa89473baa57f0b02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.944752 12173 ts_tablet_manager.cc:1918] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:58.944836 12173 log.cc:1199] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/975a71cb743443dc97228472e00b8c5c
I20250625 14:01:58.945109 12173 ts_tablet_manager.cc:1939] T 975a71cb743443dc97228472e00b8c5c P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:58.946000 12881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:01:58.946156 12881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
I20250625 14:01:58.942663 12177 raft_consensus.cc:2241] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:58.947358 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 32e39d974af9439c873ba8ec6523c428 (DEFAULT_TABLE table=default.Table_29210cfb24ec49caadf051016702660e [id=c43aded6e81948a890074e730d89a0b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.947562 12177 raft_consensus.cc:2270] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:58.947537 12023 tablet_service.cc:1468] Processing CreateTablet for tablet b345695e57a24b09aff2b8e00bf0fbdf (DEFAULT_TABLE table=default.Table_40002fc3ebb64224b030b871c7a3dd5f [id=0b16c8212aad40b6bd5289f62521c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.947777 12035 tablet_service.cc:1468] Processing CreateTablet for tablet c767ef4cab694e09866524f84a429da7 (DEFAULT_TABLE table=default.Table_05ba0d7a47814bd5b9443c9db8a32e6e [id=804b247e248b4720a350f63a492d84fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.948141 12025 tablet_service.cc:1468] Processing CreateTablet for tablet 16b68e0df99d4a1b8744b52d175b2eb2 (DEFAULT_TABLE table=default.Table_d5493976be964fea9539f63099a0464c [id=5d4ba1ed93544c8eb875e36110a54e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.948346 12177 ts_tablet_manager.cc:1905] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:58.948499 12029 tablet_service.cc:1468] Processing CreateTablet for tablet 8b7f27723e424ae9900b11ef0781533b (DEFAULT_TABLE table=default.Table_16cb68f67e81452ab5be9b16c3e6f0ca [id=0d2976b736fb4eb5a4cc83a8a793dc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.948752 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d (DEFAULT_TABLE table=default.Table_3a571013915f48b1846783c8681bcd48 [id=badcbb46059d44ea82de121a958a2f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.951077 12030 tablet_service.cc:1515] Processing DeleteTablet for tablet edfce8c80bb341a48fb1b59def057571 with delete_type TABLET_DATA_DELETED (replaced by tablet 8578d07c9b4a44f887b5a30e92c1ede9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:58.951680 12177 ts_tablet_manager.cc:1918] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:58.951818 12177 log.cc:1199] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/5489ee768c384fc0a1c8b6bed25b3a26
I20250625 14:01:58.952118 12177 ts_tablet_manager.cc:1939] T 5489ee768c384fc0a1c8b6bed25b3a26 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:58.953248 12953 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:58.954336 11526 catalog_manager.cc:5582] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:58.954551 12265 raft_consensus.cc:491] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.954648 12265 raft_consensus.cc:513] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.955034 12265 leader_election.cc:290] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.955443 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "562187f6db8a4883a5bb2d939a31b769" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:58.955637 11900 tablet_service.cc:1468] Processing CreateTablet for tablet c4c32692666047fe9a18a75e66365e16 (DEFAULT_TABLE table=default.Table_312ca07ca7b941c4a2dae1ae52c46b56 [id=44291c78dc3e4c0b9f1e81a9b8907e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.955910 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c32692666047fe9a18a75e66365e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.955945 12600 raft_consensus.cc:491] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 14:01:58.955924 11858 leader_election.cc:343] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.956019 12600 raft_consensus.cc:513] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.956333 12600 leader_election.cc:290] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:58.956447 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 4ed7734f171f4692ba7900844100c878 (DEFAULT_TABLE table=default.Table_adab8acd3bfa4278a0007fbcaa2a79c8 [id=a4421b5e7a1845c2b92f8635993abec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.956674 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed7734f171f4692ba7900844100c878. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.956876 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b07c4c7d9ba54abe9794ab432f55bf62" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:58.957259 11858 leader_election.cc:343] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:58.960361 11899 tablet_service.cc:1468] Processing CreateTablet for tablet b345695e57a24b09aff2b8e00bf0fbdf (DEFAULT_TABLE table=default.Table_40002fc3ebb64224b030b871c7a3dd5f [id=0b16c8212aad40b6bd5289f62521c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.960464 11895 tablet_service.cc:1468] Processing CreateTablet for tablet c767ef4cab694e09866524f84a429da7 (DEFAULT_TABLE table=default.Table_05ba0d7a47814bd5b9443c9db8a32e6e [id=804b247e248b4720a350f63a492d84fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.960675 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c767ef4cab694e09866524f84a429da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.960695 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 16b68e0df99d4a1b8744b52d175b2eb2 (DEFAULT_TABLE table=default.Table_d5493976be964fea9539f63099a0464c [id=5d4ba1ed93544c8eb875e36110a54e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.960889 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b68e0df99d4a1b8744b52d175b2eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.961359 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 32e39d974af9439c873ba8ec6523c428 (DEFAULT_TABLE table=default.Table_29210cfb24ec49caadf051016702660e [id=c43aded6e81948a890074e730d89a0b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.961585 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32e39d974af9439c873ba8ec6523c428. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.962872 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 8b7f27723e424ae9900b11ef0781533b (DEFAULT_TABLE table=default.Table_16cb68f67e81452ab5be9b16c3e6f0ca [id=0d2976b736fb4eb5a4cc83a8a793dc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.963110 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d (DEFAULT_TABLE table=default.Table_3a571013915f48b1846783c8681bcd48 [id=badcbb46059d44ea82de121a958a2f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.963164 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7f27723e424ae9900b11ef0781533b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.965233 12026 tablet_service.cc:1468] Processing CreateTablet for tablet c4c32692666047fe9a18a75e66365e16 (DEFAULT_TABLE table=default.Table_312ca07ca7b941c4a2dae1ae52c46b56 [id=44291c78dc3e4c0b9f1e81a9b8907e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.965728 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3b7cbb8e624e9da3b12a63a710710d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.969228 12166 tablet_bootstrap.cc:492] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.969148 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_75eefac2950f498d963162a9e06305c1" } new_table_name: "default.Table_99867a76f7444c73b03daf2d410e0156" modify_external_catalogs: true
I20250625 14:01:58.969321 12166 ts_tablet_manager.cc:1397] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.145s user 0.002s sys 0.000s
I20250625 14:01:58.969820 12166 raft_consensus.cc:357] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.969919 12166 raft_consensus.cc:383] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.969951 12166 raft_consensus.cc:738] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.970093 12166 consensus_queue.cc:260] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:58.970153 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet fbf41efa64294f388894a9a57b45fdc2 (table default.Table_99ef32b961ed4799869db0bddb6346de [id=55cc2676447f4267a1b31fb53a7705dd]) successfully deleted
I20250625 14:01:58.970122 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_482a3dd3e80a424e8ffec8e002eeb7e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:58.970414 12166 ts_tablet_manager.cc:1428] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.970605 12166 tablet_bootstrap.cc:492] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.970585 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 5489ee768c384fc0a1c8b6bed25b3a26 (table default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]) successfully deleted
W20250625 14:01:58.970726 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ed176205a65d4127b0ae23649187fba0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed176205a65d4127b0ae23649187fba0 already in progress: creating tablet
W20250625 14:01:58.970832 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11bd0fc7e8ef430ea2cef302f67b8b22 already in progress: creating tablet
I20250625 14:01:58.971635 12166 tablet_bootstrap.cc:654] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.973835 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 94232e8e88e84350b5f150a6eb433c92 (table default.Table_fc6abd07a4dc4176a7a9c81d3fb81fa4 [id=9bd1814bba0a43fa8a66a50e91ef165f]). Expected version 4 got 0
W20250625 14:01:58.977782 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a36ed3e126ef4edfa69fcffb098d0e4f consensus state has no leader
I20250625 14:01:58.978323 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 94232e8e88e84350b5f150a6eb433c92 (table default.Table_fc6abd07a4dc4176a7a9c81d3fb81fa4 [id=9bd1814bba0a43fa8a66a50e91ef165f]). Expected version 4 got 0
W20250625 14:01:58.970592 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_482a3dd3e80a424e8ffec8e002eeb7e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:58.985344 12166 tablet_bootstrap.cc:492] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:58.985489 12166 ts_tablet_manager.cc:1397] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:58.986181 12166 raft_consensus.cc:357] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.986353 12166 raft_consensus.cc:383] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:58.986388 12166 raft_consensus.cc:738] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:58.986514 12166 consensus_queue.cc:260] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:58.986817 12166 ts_tablet_manager.cc:1428] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:58.987025 12166 tablet_bootstrap.cc:492] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:58.987927 12030 tablet_service.cc:1468] Processing CreateTablet for tablet cdbebbb725564dc98c30ce4bbd3af8db (DEFAULT_TABLE table=default.Table_dfb0fb317e8d4ca799c64b29140de875 [id=ca4d9657d22c41cb8df831d8a7470745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.988095 12166 tablet_bootstrap.cc:654] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:58.988269 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 41eb1c8d2afa4a4593a466bffae5dc23 (DEFAULT_TABLE table=default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.990338 11901 tablet_service.cc:1468] Processing CreateTablet for tablet cdbebbb725564dc98c30ce4bbd3af8db (DEFAULT_TABLE table=default.Table_dfb0fb317e8d4ca799c64b29140de875 [id=ca4d9657d22c41cb8df831d8a7470745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.990615 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbebbb725564dc98c30ce4bbd3af8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.993044 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 41eb1c8d2afa4a4593a466bffae5dc23 (DEFAULT_TABLE table=default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:58.993327 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41eb1c8d2afa4a4593a466bffae5dc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:58.995745 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 1d596792632e4e32be161450f46b4168 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:58.998780 13121 raft_consensus.cc:491] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:58.998906 13121 raft_consensus.cc:513] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:58.999337 13121 leader_election.cc:290] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:01:59.000336 11990 leader_election.cc:343] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 58eacad688d747118971f4c4ad163871
I20250625 14:01:59.003147 11757 tablet_service.cc:1468] Processing CreateTablet for tablet c4c32692666047fe9a18a75e66365e16 (DEFAULT_TABLE table=default.Table_312ca07ca7b941c4a2dae1ae52c46b56 [id=44291c78dc3e4c0b9f1e81a9b8907e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.003329 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 4ed7734f171f4692ba7900844100c878 (DEFAULT_TABLE table=default.Table_adab8acd3bfa4278a0007fbcaa2a79c8 [id=a4421b5e7a1845c2b92f8635993abec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.003477 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c32692666047fe9a18a75e66365e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.003593 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 07497399a6cd463f8d20d33d9db1d46b with delete_type TABLET_DATA_DELETED (replaced by tablet ce6e907d627f4f3e8219eaabe4373c6e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.003770 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed7734f171f4692ba7900844100c878. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.005457 12166 tablet_bootstrap.cc:492] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.005564 12166 ts_tablet_manager.cc:1397] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:01:59.006121 12166 raft_consensus.cc:357] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.006263 12166 raft_consensus.cc:383] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.006418 12166 raft_consensus.cc:738] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.006454 11760 tablet_service.cc:1468] Processing CreateTablet for tablet b345695e57a24b09aff2b8e00bf0fbdf (DEFAULT_TABLE table=default.Table_40002fc3ebb64224b030b871c7a3dd5f [id=0b16c8212aad40b6bd5289f62521c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.006590 12166 consensus_queue.cc:260] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.006726 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b345695e57a24b09aff2b8e00bf0fbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.006911 12166 ts_tablet_manager.cc:1428] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:59.007125 12166 tablet_bootstrap.cc:492] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.008250 12166 tablet_bootstrap.cc:654] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.009330 11757 tablet_service.cc:1468] Processing CreateTablet for tablet c767ef4cab694e09866524f84a429da7 (DEFAULT_TABLE table=default.Table_05ba0d7a47814bd5b9443c9db8a32e6e [id=804b247e248b4720a350f63a492d84fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.009577 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c767ef4cab694e09866524f84a429da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.016606 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 32e39d974af9439c873ba8ec6523c428 (DEFAULT_TABLE table=default.Table_29210cfb24ec49caadf051016702660e [id=c43aded6e81948a890074e730d89a0b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.017083 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32e39d974af9439c873ba8ec6523c428. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.020413 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet fe7e0145fb2f48c29259afafcbe29599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.021034 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 8b7f27723e424ae9900b11ef0781533b (DEFAULT_TABLE table=default.Table_16cb68f67e81452ab5be9b16c3e6f0ca [id=0d2976b736fb4eb5a4cc83a8a793dc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.021095 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 975a71cb743443dc97228472e00b8c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.021095 11752 tablet_service.cc:1468] Processing CreateTablet for tablet cdbebbb725564dc98c30ce4bbd3af8db (DEFAULT_TABLE table=default.Table_dfb0fb317e8d4ca799c64b29140de875 [id=ca4d9657d22c41cb8df831d8a7470745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.021322 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7f27723e424ae9900b11ef0781533b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.021464 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbebbb725564dc98c30ce4bbd3af8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.021049 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d (DEFAULT_TABLE table=default.Table_3a571013915f48b1846783c8681bcd48 [id=badcbb46059d44ea82de121a958a2f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.021721 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3b7cbb8e624e9da3b12a63a710710d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.024125 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 41eb1c8d2afa4a4593a466bffae5dc23 (DEFAULT_TABLE table=default.Table_0484c8fc78484d04841a05f84b8d7dfe [id=db2410fbfdb04e9980e32af6f24ae771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.024382 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41eb1c8d2afa4a4593a466bffae5dc23. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.026454 11993 leader_election.cc:343] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 58eacad688d747118971f4c4ad163871
I20250625 14:01:59.026551 11993 leader_election.cc:304] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:59.026533 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 16b68e0df99d4a1b8744b52d175b2eb2 (DEFAULT_TABLE table=default.Table_d5493976be964fea9539f63099a0464c [id=5d4ba1ed93544c8eb875e36110a54e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.026768 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b68e0df99d4a1b8744b52d175b2eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.026816 13121 raft_consensus.cc:2747] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:59.028748 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b345695e57a24b09aff2b8e00bf0fbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.031883 12027 tablet_service.cc:1468] Processing CreateTablet for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 (DEFAULT_TABLE table=default.Table_1b24c24d74c040278e5b696da66ddc5a [id=e2f16feebe44452688a8509ec544424a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.032384 12024 tablet_service.cc:1468] Processing CreateTablet for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e (DEFAULT_TABLE table=default.Table_d2dc78ca4ab140898fcf05498f5a7003 [id=e60f5069d2e84ae9ba236e312d292418]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.032384 12034 tablet_service.cc:1468] Processing CreateTablet for tablet d8227e0205bb4b9fa9b8047558cf9a1c (DEFAULT_TABLE table=default.Table_634b6d869acd4da2bd66aff2b24c393c [id=582f8b57917f47879f494d3661b2abc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.032689 11891 tablet_service.cc:1468] Processing CreateTablet for tablet d8227e0205bb4b9fa9b8047558cf9a1c (DEFAULT_TABLE table=default.Table_634b6d869acd4da2bd66aff2b24c393c [id=582f8b57917f47879f494d3661b2abc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.032989 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8227e0205bb4b9fa9b8047558cf9a1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.033273 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 975a71cb743443dc97228472e00b8c5c because the tablet was not found. No further retry: Not found: Tablet not found: 975a71cb743443dc97228472e00b8c5c
I20250625 14:01:59.035313 11764 tablet_service.cc:1468] Processing CreateTablet for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e (DEFAULT_TABLE table=default.Table_d2dc78ca4ab140898fcf05498f5a7003 [id=e60f5069d2e84ae9ba236e312d292418]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.035503 11901 tablet_service.cc:1468] Processing CreateTablet for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e (DEFAULT_TABLE table=default.Table_d2dc78ca4ab140898fcf05498f5a7003 [id=e60f5069d2e84ae9ba236e312d292418]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.035725 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.035727 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.035688 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_973b50c79f674df1b6cf16c53eb85f04" } modify_external_catalogs: true
I20250625 14:01:59.035811 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_973b50c79f674df1b6cf16c53eb85f04" } modify_external_catalogs: true
I20250625 14:01:59.036645 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e4fe5899ea124412b41a61ce3e23c37e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.037007 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4fe5899ea124412b41a61ce3e23c37e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.037981 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6bb0b7abdba94cf389ace541328ae1b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.038360 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bb0b7abdba94cf389ace541328ae1b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.038430 12600 raft_consensus.cc:491] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.038530 12600 raft_consensus.cc:513] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.038929 12600 leader_election.cc:290] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.038893 11757 tablet_service.cc:1468] Processing CreateTablet for tablet d8227e0205bb4b9fa9b8047558cf9a1c (DEFAULT_TABLE table=default.Table_634b6d869acd4da2bd66aff2b24c393c [id=582f8b57917f47879f494d3661b2abc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.039366 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "94232e8e88e84350b5f150a6eb433c92" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:59.039656 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8227e0205bb4b9fa9b8047558cf9a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.040323 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_aef9a66f765d4816ade12005b3c33318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.040648 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aef9a66f765d4816ade12005b3c33318 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.040637 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 881295234a5b4a089985382765774cd9 (DEFAULT_TABLE table=default.Table_478843ad04c04773be560cc8ac45cc52 [id=9954b567381b49cf81d3cea6b706f327]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.040829 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1b24c24d74c040278e5b696da66ddc5a" } new_table_name: "default.Table_5d55b3b2d4744021bd002b13b919aad9" modify_external_catalogs: true
I20250625 14:01:59.040982 12022 tablet_service.cc:1468] Processing CreateTablet for tablet 5d676d411a34492c8b269a64a62fa4af (DEFAULT_TABLE table=default.Table_4ca6f331bfad4a5db8b2da07d1cfa7a7 [id=c0522a75938042b69b1128e6516b3f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.041008 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a868c6d7d31c43a49e263018f45db372" } modify_external_catalogs: true
I20250625 14:01:59.041260 12020 tablet_service.cc:1468] Processing CreateTablet for tablet f7808bed1b8f4103bf728b8a525dad5d (DEFAULT_TABLE table=default.Table_7b1b3da0207d4e2fa0a84a55707035c7 [id=6010f3f552cf4773a1beb3d3686fdd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.041509 12018 tablet_service.cc:1468] Processing CreateTablet for tablet 8ef6745366054d0dbdda7c0ffa2313c4 (DEFAULT_TABLE table=default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.041527 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 5d676d411a34492c8b269a64a62fa4af (DEFAULT_TABLE table=default.Table_4ca6f331bfad4a5db8b2da07d1cfa7a7 [id=c0522a75938042b69b1128e6516b3f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.041790 11894 tablet_service.cc:1468] Processing CreateTablet for tablet ee86afd7088e48ab86a2f82fbd799905 (DEFAULT_TABLE table=default.Table_d3d8631cb0b448dcbcd5ce16b5c57453 [id=22308d28adce4829bb232a1cb7b44361]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.041899 12037 tablet_service.cc:1468] Processing CreateTablet for tablet d0d890fd97404513bb031cd6f866b976 (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.041940 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b (DEFAULT_TABLE table=default.Table_711bc5a641614b02bfd29d577629b3b1 [id=87be528999a54ddd822364d0ad46af3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.042116 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 32dd38cbe4634d3e97d657a8a4129039 (DEFAULT_TABLE table=default.Table_b8218761d9fd4d17889a2b82dc4a9cea [id=a75bbf36bc6a4085af710e2be144a2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.041957 11889 tablet_service.cc:1468] Processing CreateTablet for tablet f7808bed1b8f4103bf728b8a525dad5d (DEFAULT_TABLE table=default.Table_7b1b3da0207d4e2fa0a84a55707035c7 [id=6010f3f552cf4773a1beb3d3686fdd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.042161 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 8ef6745366054d0dbdda7c0ffa2313c4 (DEFAULT_TABLE table=default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.041807 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d676d411a34492c8b269a64a62fa4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.042397 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b (DEFAULT_TABLE table=default.Table_711bc5a641614b02bfd29d577629b3b1 [id=87be528999a54ddd822364d0ad46af3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.042577 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7808bed1b8f4103bf728b8a525dad5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.042542 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 6d43d6332c6046b3a9171f93335e72fd (DEFAULT_TABLE table=default.Table_84fc4739c8554d4e9fe0419a738f9c79 [id=c43c12f7088042ed8ce964bb3a28a967]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.042660 12019 tablet_service.cc:1468] Processing CreateTablet for tablet ee86afd7088e48ab86a2f82fbd799905 (DEFAULT_TABLE table=default.Table_d3d8631cb0b448dcbcd5ce16b5c57453 [id=22308d28adce4829bb232a1cb7b44361]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.042726 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d43d6332c6046b3a9171f93335e72fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.042910 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 881295234a5b4a089985382765774cd9 (DEFAULT_TABLE table=default.Table_478843ad04c04773be560cc8ac45cc52 [id=9954b567381b49cf81d3cea6b706f327]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.043097 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881295234a5b4a089985382765774cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.044653 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee86afd7088e48ab86a2f82fbd799905. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.045183 11858 leader_election.cc:343] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.045392 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ef6745366054d0dbdda7c0ffa2313c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.046952 11901 tablet_service.cc:1468] Processing CreateTablet for tablet d0d890fd97404513bb031cd6f866b976 (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.047220 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d890fd97404513bb031cd6f866b976. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.047544 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.050635 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 32dd38cbe4634d3e97d657a8a4129039 (DEFAULT_TABLE table=default.Table_b8218761d9fd4d17889a2b82dc4a9cea [id=a75bbf36bc6a4085af710e2be144a2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.050875 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32dd38cbe4634d3e97d657a8a4129039. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.050909 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_eaf70884d45f4eb6b1fc06888fdcd505" } new_table_name: "default.Table_7eea033a0ebc4712a45ee52653e09a47" modify_external_catalogs: true
I20250625 14:01:59.050928 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_466564dce5b24b5bbfc5d0dad764862d" } new_table_name: "default.Table_764ab4f98d194fa7a55a3a01d118f3c1" modify_external_catalogs: true
I20250625 14:01:59.051424 11760 tablet_service.cc:1468] Processing CreateTablet for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 (DEFAULT_TABLE table=default.Table_1b24c24d74c040278e5b696da66ddc5a [id=e2f16feebe44452688a8509ec544424a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.052353 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a67a7c7c8a4c6eb331676ea4d126a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.052793 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a868c6d7d31c43a49e263018f45db372" } modify_external_catalogs: true
I20250625 14:01:59.055855 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 5d676d411a34492c8b269a64a62fa4af (DEFAULT_TABLE table=default.Table_4ca6f331bfad4a5db8b2da07d1cfa7a7 [id=c0522a75938042b69b1128e6516b3f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.056124 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d676d411a34492c8b269a64a62fa4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.055850 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 881295234a5b4a089985382765774cd9 (DEFAULT_TABLE table=default.Table_478843ad04c04773be560cc8ac45cc52 [id=9954b567381b49cf81d3cea6b706f327]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.056699 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881295234a5b4a089985382765774cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.057052 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 31f843108ecf440090c05255afa1687e
I20250625 14:01:59.060741 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 32dd38cbe4634d3e97d657a8a4129039 (DEFAULT_TABLE table=default.Table_b8218761d9fd4d17889a2b82dc4a9cea [id=a75bbf36bc6a4085af710e2be144a2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.060998 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32dd38cbe4634d3e97d657a8a4129039. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.063901 11752 tablet_service.cc:1468] Processing CreateTablet for tablet f7808bed1b8f4103bf728b8a525dad5d (DEFAULT_TABLE table=default.Table_7b1b3da0207d4e2fa0a84a55707035c7 [id=6010f3f552cf4773a1beb3d3686fdd31]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.064167 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7808bed1b8f4103bf728b8a525dad5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.067454 12600 raft_consensus.cc:491] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.067564 12600 raft_consensus.cc:513] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.067749 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 31f843108ecf440090c05255afa1687e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.067992 12600 leader_election.cc:290] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.068491 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "07497399a6cd463f8d20d33d9db1d46b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:59.069152 11858 leader_election.cc:343] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.070525 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6a195a661111421cb38dde060c6dcd15" } modify_external_catalogs: true
I20250625 14:01:59.070655 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6a195a661111421cb38dde060c6dcd15" } modify_external_catalogs: true
I20250625 14:01:59.071071 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 8ef6745366054d0dbdda7c0ffa2313c4 (DEFAULT_TABLE table=default.Table_e407283f16824e65ba9d6ff88904672f [id=8a813d139881472ba2c35b94b4990c27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.071314 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ef6745366054d0dbdda7c0ffa2313c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.071497 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3ef1319b5c184316b50ed0cc8da2abec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.071895 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ef1319b5c184316b50ed0cc8da2abec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.073664 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 6d43d6332c6046b3a9171f93335e72fd (DEFAULT_TABLE table=default.Table_84fc4739c8554d4e9fe0419a738f9c79 [id=c43c12f7088042ed8ce964bb3a28a967]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.073899 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d43d6332c6046b3a9171f93335e72fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.074506 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7bfc267608654b02b8bab5ba2f13854e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.075165 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c9a67a7c7c8a4c6eb331676ea4d126a6 consensus state has no leader
W20250625 14:01:59.075313 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bfc267608654b02b8bab5ba2f13854e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.075379 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d05b0f5a4b254c48b534779262ad0ac4" } new_table_name: "default.Table_dc9acbfacd2248c4afbe5de227109f68" modify_external_catalogs: true
I20250625 14:01:59.076103 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 725a0db4c6374805903657f755ca1783
I20250625 14:01:59.076411 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 31f843108ecf440090c05255afa1687e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.076494 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f67df6002e4a4dbab5f5e582fd21e7a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.076838 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f67df6002e4a4dbab5f5e582fd21e7a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.077874 11752 tablet_service.cc:1468] Processing CreateTablet for tablet ee86afd7088e48ab86a2f82fbd799905 (DEFAULT_TABLE table=default.Table_d3d8631cb0b448dcbcd5ce16b5c57453 [id=22308d28adce4829bb232a1cb7b44361]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.078022 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 725a0db4c6374805903657f755ca1783 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.078145 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee86afd7088e48ab86a2f82fbd799905. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.079562 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 8ebec65b7f6a475ab01359aab392d1cf from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.080314 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fd6351d08daa4564ba49cf00d72ecd56" } modify_external_catalogs: true
I20250625 14:01:59.080421 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fd6351d08daa4564ba49cf00d72ecd56" } modify_external_catalogs: true
I20250625 14:01:59.081916 13121 raft_consensus.cc:491] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.082042 13121 raft_consensus.cc:513] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:59.082283 12953 tablet.cc:1722] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.082499 13121 leader_election.cc:290] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:59.082615 12233 tablet.cc:1722] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.082886 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff4973a4d8ec46c7aa640fcaf40b5c87" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.083024 11920 raft_consensus.cc:2466] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:59.083320 11990 leader_election.cc:304] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.083743 13121 raft_consensus.cc:2802] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.083802 13121 raft_consensus.cc:491] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.083842 13121 raft_consensus.cc:3058] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.084872 13121 raft_consensus.cc:513] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:59.085238 13121 leader_election.cc:290] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:59.085706 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff4973a4d8ec46c7aa640fcaf40b5c87" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:59.085808 11920 raft_consensus.cc:3058] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.086771 11920 raft_consensus.cc:2466] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:59.087412 11990 leader_election.cc:304] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.087781 13121 raft_consensus.cc:2802] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:59.087980 13121 raft_consensus.cc:695] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:59.088120 13121 consensus_queue.cc:237] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:59.089072 12600 raft_consensus.cc:491] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.089148 12600 raft_consensus.cc:513] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.089524 12600 leader_election.cc:290] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.091120 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5e271b27ac349d6bb8cf47aa8b9668a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:59.091249 11780 raft_consensus.cc:2466] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:01:59.091524 11858 leader_election.cc:304] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.091678 12600 raft_consensus.cc:2802] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.091722 12600 raft_consensus.cc:491] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.091756 12600 raft_consensus.cc:3058] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.091801 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b07c4c7d9ba54abe9794ab432f55bf62
I20250625 14:01:59.092880 12600 raft_consensus.cc:513] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.093226 12600 leader_election.cc:290] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.094478 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5e271b27ac349d6bb8cf47aa8b9668a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:59.094592 11780 raft_consensus.cc:3058] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.095034 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9e3ac56046254085872f6bb408f6dcce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.095431 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e3ac56046254085872f6bb408f6dcce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.095625 11780 raft_consensus.cc:2466] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:01:59.096540 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ce33fd7f17a44af0bd8655dcdd52418b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.096879 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce33fd7f17a44af0bd8655dcdd52418b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.098603 11858 leader_election.cc:304] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:01:59.098752 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d185c7be82b04fe2a30626a6fb082219 consensus state has no leader
I20250625 14:01:59.098927 12558 raft_consensus.cc:2802] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:59.098999 12558 raft_consensus.cc:695] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:01:59.098956 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e4c20f5076904d6d8060e5013a7512bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.099104 12558 consensus_queue.cc:237] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:59.099256 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4c20f5076904d6d8060e5013a7512bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.100260 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet b07c4c7d9ba54abe9794ab432f55bf62 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.102219 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e9476529c1b7401683c02e146f54a228
I20250625 14:01:59.104516 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet e9476529c1b7401683c02e146f54a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.105406 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_7eea033a0ebc4712a45ee52653e09a47 [id=06f86a5adb9a4fccb3756ff3fc5aef9c] alter complete (version 2)
I20250625 14:01:59.110277 11527 catalog_manager.cc:5582] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:59.110623 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f5e271b27ac349d6bb8cf47aa8b9668a (table default.Table_5f4cfca1a111436d9a80d3b64d0cfe0f [id=29fdfe34ed7648feb4f21f471fd5e154]). Expected version 1 got 0
I20250625 14:01:59.111709 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet d185c7be82b04fe2a30626a6fb082219 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.114847 11899 tablet_service.cc:1468] Processing CreateTablet for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 (DEFAULT_TABLE table=default.Table_1b24c24d74c040278e5b696da66ddc5a [id=e2f16feebe44452688a8509ec544424a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.115191 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a67a7c7c8a4c6eb331676ea4d126a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.118580 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b (DEFAULT_TABLE table=default.Table_711bc5a641614b02bfd29d577629b3b1 [id=87be528999a54ddd822364d0ad46af3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.118973 12238 raft_consensus.cc:491] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.119073 12238 raft_consensus.cc:513] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:59.119302 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet e9476529c1b7401683c02e146f54a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.119410 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff4973a4d8ec46c7aa640fcaf40b5c87" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:59.119451 12238 leader_election.cc:290] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:59.119516 11780 raft_consensus.cc:2466] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:59.119901 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff4973a4d8ec46c7aa640fcaf40b5c87" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:59.120019 11780 raft_consensus.cc:3058] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:59.120223 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 31f843108ecf440090c05255afa1687e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31f843108ecf440090c05255afa1687e already in progress: creating tablet
I20250625 14:01:59.120692 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fc6abd07a4dc4176a7a9c81d3fb81fa4" } modify_external_catalogs: true
I20250625 14:01:59.120806 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fc6abd07a4dc4176a7a9c81d3fb81fa4" } modify_external_catalogs: true
I20250625 14:01:59.121069 11780 raft_consensus.cc:2466] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:59.122181 12233 tablet.cc:1722] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.122974 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff4973a4d8ec46c7aa640fcaf40b5c87" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.123160 11921 raft_consensus.cc:2391] T ff4973a4d8ec46c7aa640fcaf40b5c87 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56419e38d8e34f6985d4d970c1ce76e5 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:01:59.123636 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet b07c4c7d9ba54abe9794ab432f55bf62 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:58.960150 12175 ts_tablet_manager.cc:1918] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:59.124351 12175 log.cc:1199] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/975a71cb743443dc97228472e00b8c5c
I20250625 14:01:59.126143 12175 ts_tablet_manager.cc:1939] T 975a71cb743443dc97228472e00b8c5c P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.128158 12175 tablet_replica.cc:331] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.128379 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 975a71cb743443dc97228472e00b8c5c (table default.Table_624b939aea9f40bdbe04f0a87a83f8c3 [id=9ff06a3b7ae844e18bd0575488004bbf]) successfully deleted
I20250625 14:01:59.128479 12175 raft_consensus.cc:2241] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:01:59.128557 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b55487136b024aa788e31debeb1b2eca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b55487136b024aa788e31debeb1b2eca already in progress: creating tablet
I20250625 14:01:59.128656 12175 raft_consensus.cc:2270] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.129031 12052 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "562187f6db8a4883a5bb2d939a31b769" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.129106 12057 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b07c4c7d9ba54abe9794ab432f55bf62" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.129526 12050 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "94232e8e88e84350b5f150a6eb433c92" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.129743 12049 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "07497399a6cd463f8d20d33d9db1d46b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.130899 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 725a0db4c6374805903657f755ca1783 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.131023 12046 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5e271b27ac349d6bb8cf47aa8b9668a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.131212 12045 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f5e271b27ac349d6bb8cf47aa8b9668a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:01:59.131959 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet e9476529c1b7401683c02e146f54a228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9476529c1b7401683c02e146f54a228 already in progress: creating tablet
I20250625 14:01:59.132539 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ff4973a4d8ec46c7aa640fcaf40b5c87" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.133598 12953 tablet.cc:1722] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.134073 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32e39d974af9439c873ba8ec6523c428. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.135005 11530 catalog_manager.cc:5582] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:59.136582 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 6d43d6332c6046b3a9171f93335e72fd (DEFAULT_TABLE table=default.Table_84fc4739c8554d4e9fe0419a738f9c79 [id=c43c12f7088042ed8ce964bb3a28a967]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.136837 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d43d6332c6046b3a9171f93335e72fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.137686 12175 ts_tablet_manager.cc:1905] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.138533 12023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b345695e57a24b09aff2b8e00bf0fbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.140636 12023 tablet_service.cc:1515] Processing DeleteTablet for tablet 31f843108ecf440090c05255afa1687e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.140777 12023 tablet_service.cc:1515] Processing DeleteTablet for tablet 725a0db4c6374805903657f755ca1783 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.140864 12023 tablet_service.cc:1515] Processing DeleteTablet for tablet b07c4c7d9ba54abe9794ab432f55bf62 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.140946 12023 tablet_service.cc:1515] Processing DeleteTablet for tablet e9476529c1b7401683c02e146f54a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.141158 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c767ef4cab694e09866524f84a429da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.141247 12175 ts_tablet_manager.cc:1918] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.141367 12175 log.cc:1199] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/562187f6db8a4883a5bb2d939a31b769
I20250625 14:01:59.141692 12175 ts_tablet_manager.cc:1939] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.143363 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7f27723e424ae9900b11ef0781533b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.143769 12167 tablet_bootstrap.cc:492] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.143868 12167 ts_tablet_manager.cc:1397] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.255s user 0.002s sys 0.000s
I20250625 14:01:59.144117 12175 tablet_replica.cc:331] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.144264 12175 raft_consensus.cc:2241] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.144371 12175 raft_consensus.cc:2270] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.144536 12167 raft_consensus.cc:357] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:59.144645 12167 raft_consensus.cc:383] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.144680 12167 raft_consensus.cc:738] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.144786 12167 consensus_queue.cc:260] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:59.144848 12175 ts_tablet_manager.cc:1905] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.145110 12167 ts_tablet_manager.cc:1428] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.145287 12167 tablet_bootstrap.cc:492] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.145694 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3b7cbb8e624e9da3b12a63a710710d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.147223 12167 tablet_bootstrap.cc:654] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.147246 12175 ts_tablet_manager.cc:1918] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.147310 12175 log.cc:1199] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/07497399a6cd463f8d20d33d9db1d46b
I20250625 14:01:59.147522 12175 ts_tablet_manager.cc:1939] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.147759 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16b68e0df99d4a1b8744b52d175b2eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.147961 12175 tablet_replica.cc:331] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.149799 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c32692666047fe9a18a75e66365e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.149987 11760 tablet_service.cc:1468] Processing CreateTablet for tablet d0d890fd97404513bb031cd6f866b976 (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.150458 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbebbb725564dc98c30ce4bbd3af8db. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.150655 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b07c4c7d9ba54abe9794ab432f55bf62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b07c4c7d9ba54abe9794ab432f55bf62 already in progress: creating tablet
I20250625 14:01:59.152554 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41eb1c8d2afa4a4593a466bffae5dc23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.152537 12175 raft_consensus.cc:2241] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.152673 12175 raft_consensus.cc:2270] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:59.152697 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 725a0db4c6374805903657f755ca1783 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 725a0db4c6374805903657f755ca1783 already in progress: creating tablet
I20250625 14:01:59.154863 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a67a7c7c8a4c6eb331676ea4d126a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.155233 11717 leader_election.cc:304] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:01:59.155447 13137 raft_consensus.cc:2747] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:59.156847 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8227e0205bb4b9fa9b8047558cf9a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.157999 12953 tablet.cc:1722] T 64b3b045e4f3424f86f473c2ad351b9c P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.158896 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d890fd97404513bb031cd6f866b976. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.159003 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.160935 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee86afd7088e48ab86a2f82fbd799905. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.161258 12175 ts_tablet_manager.cc:1905] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:59.161881 11855 leader_election.cc:343] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.161995 11855 leader_election.cc:304] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:01:59.162087 11855 raft_consensus.cc:2684] T 562187f6db8a4883a5bb2d939a31b769 P bfff52620fea460d850827814b790c35: unable to run election callback: Service unavailable: Thread pool token was shut down
W20250625 14:01:59.162551 11855 leader_election.cc:343] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.162623 11855 leader_election.cc:304] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:59.162770 12265 raft_consensus.cc:2747] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:59.162928 11855 leader_election.cc:343] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.163000 11855 leader_election.cc:304] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:59.163102 12558 raft_consensus.cc:2747] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:59.163174 11855 leader_election.cc:343] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.163228 11855 leader_election.cc:304] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:01:59.163292 11855 raft_consensus.cc:2684] T 07497399a6cd463f8d20d33d9db1d46b P bfff52620fea460d850827814b790c35: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:59.163343 12166 tablet_bootstrap.cc:492] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.163410 12166 ts_tablet_manager.cc:1397] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.156s user 0.002s sys 0.000s
W20250625 14:01:59.163583 11855 leader_election.cc:343] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:01:59.163712 11855 leader_election.cc:343] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.163885 12166 raft_consensus.cc:357] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.163993 12166 raft_consensus.cc:383] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.164026 12166 raft_consensus.cc:738] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.164088 12175 ts_tablet_manager.cc:1918] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.164156 12175 log.cc:1199] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/fe7e0145fb2f48c29259afafcbe29599
I20250625 14:01:59.164135 12166 consensus_queue.cc:260] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.164394 12175 ts_tablet_manager.cc:1939] T fe7e0145fb2f48c29259afafcbe29599 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.164433 12166 ts_tablet_manager.cc:1428] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.164601 12166 tablet_bootstrap.cc:492] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.165429 12175 tablet_replica.cc:331] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.165567 12175 raft_consensus.cc:2241] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.165663 12175 raft_consensus.cc:2270] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.165706 12166 tablet_bootstrap.cc:654] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.166395 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 562187f6db8a4883a5bb2d939a31b769 (table default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]) successfully deleted
W20250625 14:01:59.166613 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet ed176205a65d4127b0ae23649187fba0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed176205a65d4127b0ae23649187fba0 already in progress: creating tablet
W20250625 14:01:59.166724 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11bd0fc7e8ef430ea2cef302f67b8b22 already in progress: creating tablet
I20250625 14:01:59.167857 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.169494 12175 ts_tablet_manager.cc:1905] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.170594 12022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d676d411a34492c8b269a64a62fa4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.172758 12984 tablet.cc:1722] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.174787 12175 ts_tablet_manager.cc:1918] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.174932 12175 log.cc:1199] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b07c4c7d9ba54abe9794ab432f55bf62
I20250625 14:01:59.175347 12175 ts_tablet_manager.cc:1939] T b07c4c7d9ba54abe9794ab432f55bf62 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.175450 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32dd38cbe4634d3e97d657a8a4129039. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.178858 12020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7808bed1b8f4103bf728b8a525dad5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.180828 12953 tablet.cc:1722] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.181985 12018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ef6745366054d0dbdda7c0ffa2313c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.184391 12984 tablet.cc:1722] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.186218 12984 tablet.cc:1722] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.190129 12233 tablet.cc:1722] T 64b3b045e4f3424f86f473c2ad351b9c P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.191699 12233 tablet.cc:1722] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.166822 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 07497399a6cd463f8d20d33d9db1d46b (table default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]) successfully deleted
I20250625 14:01:59.192010 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet fe7e0145fb2f48c29259afafcbe29599 (table default.Table_57f7d205bb304fd8982fcd30bb558c54 [id=3d7b081834c54daba8172abc85c60576]) successfully deleted
W20250625 14:01:59.192150 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 31f843108ecf440090c05255afa1687e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31f843108ecf440090c05255afa1687e already in progress: creating tablet
I20250625 14:01:59.192247 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.192277 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 725a0db4c6374805903657f755ca1783 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 725a0db4c6374805903657f755ca1783 already in progress: creating tablet
I20250625 14:01:59.192373 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b07c4c7d9ba54abe9794ab432f55bf62 (table default.Table_6a195a661111421cb38dde060c6dcd15 [id=dea2357ffccc4f74b480841db27be138]) successfully deleted
I20250625 14:01:59.181644 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_11b1368ec2c3492eb0d0476a28bd925c" } new_table_name: "default.Table_84156ec483954d3eb4f9a7f57244204c" modify_external_catalogs: true
I20250625 14:01:59.195725 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d890fd97404513bb031cd6f866b976. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.195896 13232 raft_consensus.cc:491] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.195999 13232 raft_consensus.cc:513] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:59.196861 12558 raft_consensus.cc:491] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.196964 12558 raft_consensus.cc:513] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.197374 12558 leader_election.cc:290] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.198200 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31157f3bd20f4db5a0baa05b61d92f87" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:01:59.199328 11990 leader_election.cc:343] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 0752a7f1371e42d68d83afe41d2f1da9
W20250625 14:01:59.199875 11858 leader_election.cc:343] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.199985 12048 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31157f3bd20f4db5a0baa05b61d92f87" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.200515 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881295234a5b4a089985382765774cd9. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.203105 11855 leader_election.cc:343] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.203192 11855 leader_election.cc:304] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:01:59.204241 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet edc5b7cc92564ba4ad04f68e18b56dfe consensus state has no leader
I20250625 14:01:59.204504 12558 raft_consensus.cc:2747] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:59.205528 13232 leader_election.cc:290] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:59.206508 12173 tablet_replica.cc:331] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.206662 12173 raft_consensus.cc:2241] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.206709 11529 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6 [id=b434548c0974419586018378be509878] alter complete (version 1)
I20250625 14:01:59.206768 12173 raft_consensus.cc:2270] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.207158 12173 ts_tablet_manager.cc:1905] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.207949 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_764ab4f98d194fa7a55a3a01d118f3c1 [id=93046a99ed124c649143efbfceeda5ff] alter complete (version 1)
I20250625 14:01:59.209057 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 975a71cb743443dc97228472e00b8c5c (table default.Table_624b939aea9f40bdbe04f0a87a83f8c3 [id=9ff06a3b7ae844e18bd0575488004bbf]) successfully deleted
I20250625 14:01:59.209558 12173 ts_tablet_manager.cc:1918] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.209625 12173 log.cc:1199] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/58eacad688d747118971f4c4ad163871
I20250625 14:01:59.209827 12173 ts_tablet_manager.cc:1939] T 58eacad688d747118971f4c4ad163871 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.213207 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d9db4adbbed242fdb6cf2b0bd4434cb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.213776 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9db4adbbed242fdb6cf2b0bd4434cb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.214922 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.216868 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet f61d1400161440e49365680085a3fe63 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.217229 12984 tablet.cc:1722] T 64b3b045e4f3424f86f473c2ad351b9c P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.222405 12167 tablet_bootstrap.cc:492] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.222519 12167 ts_tablet_manager.cc:1397] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.077s user 0.000s sys 0.002s
I20250625 14:01:59.223014 12167 raft_consensus.cc:357] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.223121 12167 raft_consensus.cc:383] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.223150 12167 raft_consensus.cc:738] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.223273 12167 consensus_queue.cc:260] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.223541 12167 ts_tablet_manager.cc:1428] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:59.223716 12167 tablet_bootstrap.cc:492] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.224851 12167 tablet_bootstrap.cc:654] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.226599 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 4317c3460f664f32aeb9b25ffb57d5bd from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:59.230741 11993 leader_election.cc:343] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 0752a7f1371e42d68d83afe41d2f1da9
I20250625 14:01:59.230849 11993 leader_election.cc:304] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:59.232550 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f61d1400161440e49365680085a3fe63
I20250625 14:01:59.232893 11529 catalog_manager.cc:6652] ReplaceTablet: tablet f61d1400161440e49365680085a3fe63 deleted and replaced by tablet 0357aab4556d46d9b4d89e7da15ecea1
I20250625 14:01:59.233790 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26] alter complete (version 1)
I20250625 14:01:59.237699 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet f61d1400161440e49365680085a3fe63 with delete_type TABLET_DATA_DELETED (replaced by tablet 0357aab4556d46d9b4d89e7da15ecea1) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.237890 12177 tablet_replica.cc:331] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.238026 12177 raft_consensus.cc:2241] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:59.238184 12177 raft_consensus.cc:2270] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.239007 12177 ts_tablet_manager.cc:1905] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.241487 12177 ts_tablet_manager.cc:1918] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:59.241560 12177 log.cc:1199] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f61d1400161440e49365680085a3fe63
I20250625 14:01:59.241812 12177 ts_tablet_manager.cc:1939] T f61d1400161440e49365680085a3fe63 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.242810 12173 tablet_replica.cc:331] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.242969 12173 raft_consensus.cc:2241] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.243091 12173 raft_consensus.cc:2270] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.243513 12173 ts_tablet_manager.cc:1905] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.244577 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet 5489ee768c384fc0a1c8b6bed25b3a26 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d99e27063554845bea98bbe70eba3b9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.244836 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 58eacad688d747118971f4c4ad163871 (table default.Table_ac11fbf6c80047a78d8983642c8746dc [id=96c998c0c13e49aeaa4b3fff136f2e27]) successfully deleted
I20250625 14:01:59.245332 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet f61d1400161440e49365680085a3fe63 with delete_type TABLET_DATA_DELETED (replaced by tablet 0357aab4556d46d9b4d89e7da15ecea1) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.245609 12018 tablet_service.cc:1515] Processing DeleteTablet for tablet f61d1400161440e49365680085a3fe63 with delete_type TABLET_DATA_DELETED (replaced by tablet 0357aab4556d46d9b4d89e7da15ecea1) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.246124 12173 ts_tablet_manager.cc:1918] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.246199 12173 log.cc:1199] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0752a7f1371e42d68d83afe41d2f1da9
I20250625 14:01:59.246428 12173 ts_tablet_manager.cc:1939] T 0752a7f1371e42d68d83afe41d2f1da9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.246980 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f61d1400161440e49365680085a3fe63 (table default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]) successfully deleted
I20250625 14:01:59.251356 12172 tablet_bootstrap.cc:492] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.251475 12172 ts_tablet_manager.cc:1397] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.422s user 0.002s sys 0.000s
I20250625 14:01:59.251585 12175 tablet_replica.cc:331] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:01:59.251632 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet e9476529c1b7401683c02e146f54a228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9476529c1b7401683c02e146f54a228 already in progress: creating tablet
I20250625 14:01:59.251892 12018 tablet_service.cc:1515] Processing DeleteTablet for tablet b949191f6218463192890e13ccf6b17e with delete_type TABLET_DATA_DELETED (replaced by tablet 3faa8782ba0d45dbbd89437685a64aef) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.252081 12167 tablet_bootstrap.cc:492] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.252040 12172 raft_consensus.cc:357] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.252163 12167 ts_tablet_manager.cc:1397] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.001s
I20250625 14:01:59.252175 12172 raft_consensus.cc:383] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.252219 12172 raft_consensus.cc:738] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.252363 12172 consensus_queue.cc:260] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.252641 12172 ts_tablet_manager.cc:1428] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.252851 12172 tablet_bootstrap.cc:492] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.252635 12167 raft_consensus.cc:357] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.253607 12167 raft_consensus.cc:383] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.253659 12167 raft_consensus.cc:738] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.253836 12172 tablet_bootstrap.cc:654] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.253798 12167 consensus_queue.cc:260] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.254168 12167 ts_tablet_manager.cc:1428] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:59.254411 12167 tablet_bootstrap.cc:492] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.255415 12167 tablet_bootstrap.cc:654] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.256534 12175 raft_consensus.cc:2241] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.257741 12175 raft_consensus.cc:2270] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.259603 12175 ts_tablet_manager.cc:1905] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.260243 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 562187f6db8a4883a5bb2d939a31b769 with delete_type TABLET_DATA_DELETED (replaced by tablet fce93c919a3446bb9999be958e08b500) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.260475 12177 tablet_replica.cc:331] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.260587 12177 raft_consensus.cc:2241] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.260687 12177 raft_consensus.cc:2270] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.261198 12177 ts_tablet_manager.cc:1905] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.262760 12018 tablet_service.cc:1515] Processing DeleteTablet for tablet fbf41efa64294f388894a9a57b45fdc2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21908df7bb384e9782b97abe6f06b0f5) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.263756 12177 ts_tablet_manager.cc:1918] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.263825 12177 log.cc:1199] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/562187f6db8a4883a5bb2d939a31b769
I20250625 14:01:59.264040 12177 ts_tablet_manager.cc:1939] T 562187f6db8a4883a5bb2d939a31b769 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.266799 12167 tablet_bootstrap.cc:492] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.266919 12167 ts_tablet_manager.cc:1397] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:01:59.267124 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 562187f6db8a4883a5bb2d939a31b769 (table default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]) successfully deleted
I20250625 14:01:59.267484 12167 raft_consensus.cc:357] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.267596 12167 raft_consensus.cc:383] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.267629 12167 raft_consensus.cc:738] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.267798 12167 consensus_queue.cc:260] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.268152 12167 ts_tablet_manager.cc:1428] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:59.268359 12167 tablet_bootstrap.cc:492] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.269373 12167 tablet_bootstrap.cc:654] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.271893 12173 tablet_replica.cc:331] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.272729 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0752a7f1371e42d68d83afe41d2f1da9 (table default.Table_ba88e68554e349be85cfbc86283df3e7 [id=86457396dd0e41c59a0e4b3805825778]) successfully deleted
I20250625 14:01:59.272691 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 562187f6db8a4883a5bb2d939a31b769 with delete_type TABLET_DATA_DELETED (replaced by tablet fce93c919a3446bb9999be958e08b500) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.273602 12173 raft_consensus.cc:2241] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.273775 12175 ts_tablet_manager.cc:1918] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.273942 12173 raft_consensus.cc:2270] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.274456 12175 log.cc:1199] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/11bd0fc7e8ef430ea2cef302f67b8b22
W20250625 14:01:59.275792 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 562187f6db8a4883a5bb2d939a31b769 because the tablet was not found. No further retry: Not found: Tablet not found: 562187f6db8a4883a5bb2d939a31b769
I20250625 14:01:59.276227 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet f5e271b27ac349d6bb8cf47aa8b9668a (table default.Table_5f4cfca1a111436d9a80d3b64d0cfe0f [id=29fdfe34ed7648feb4f21f471fd5e154]). Expected version 1 got 0
I20250625 14:01:59.276455 12175 ts_tablet_manager.cc:1939] T 11bd0fc7e8ef430ea2cef302f67b8b22 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.277287 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 11bd0fc7e8ef430ea2cef302f67b8b22 (table default.Table_32b413d2535247dabef6866ffa215cae [id=0719452dd3df4a8bb8668b9b63c62cc9]) successfully deleted
I20250625 14:01:59.277549 12173 ts_tablet_manager.cc:1905] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.278519 12175 tablet_replica.cc:331] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.281528 12175 raft_consensus.cc:2241] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.281738 12175 raft_consensus.cc:2270] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.284206 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_47a020733f644c45b54865bbd14ff779" } modify_external_catalogs: true
I20250625 14:01:59.284353 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_47a020733f644c45b54865bbd14ff779" } modify_external_catalogs: true
I20250625 14:01:59.286676 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet c767ef4cab694e09866524f84a429da7 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.289202 12175 ts_tablet_manager.cc:1905] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.293470 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 94232e8e88e84350b5f150a6eb433c92
I20250625 14:01:59.293792 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8ac0c0afb60d4d058ddbd40f5227cce0" } new_table_name: "default.Table_f7ef8af8357846339868b61391e6199c" modify_external_catalogs: true
I20250625 14:01:59.294698 12018 tablet_service.cc:1515] Processing DeleteTablet for tablet 94232e8e88e84350b5f150a6eb433c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.294719 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 94232e8e88e84350b5f150a6eb433c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.297521 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_99ef32b961ed4799869db0bddb6346de" } modify_external_catalogs: true
I20250625 14:01:59.297659 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_99ef32b961ed4799869db0bddb6346de" } modify_external_catalogs: true
I20250625 14:01:59.298483 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a1ecfd0916294ebe951c634ea2a511cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.298852 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1ecfd0916294ebe951c634ea2a511cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.299594 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b4d06384dfcc49e1b0cc55d392fe9f24" } new_table_name: "default.Table_922f57fe76d744abb3ae8b1378afad5a" modify_external_catalogs: true
I20250625 14:01:59.300349 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_92f186752e894a628d90ac456558a555"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.300524 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 94232e8e88e84350b5f150a6eb433c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:59.300642 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92f186752e894a628d90ac456558a555 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.301333 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f8c95bb7ee4a4466bccff25a7d276647"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.301627 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8c95bb7ee4a4466bccff25a7d276647 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:59.301668 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 94232e8e88e84350b5f150a6eb433c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94232e8e88e84350b5f150a6eb433c92 already in progress: creating tablet
W20250625 14:01:59.304314 11717 consensus_peers.cc:487] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250625 14:01:59.304469 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3faa8782ba0d45dbbd89437685a64aef consensus state has no leader
I20250625 14:01:59.304936 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f4d1651a42f04c3ea03c9db2668e3c62" } modify_external_catalogs: true
I20250625 14:01:59.305037 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f4d1651a42f04c3ea03c9db2668e3c62" } modify_external_catalogs: true
I20250625 14:01:59.306813 12166 tablet_bootstrap.cc:492] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.306936 12166 ts_tablet_manager.cc:1397] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.142s user 0.002s sys 0.000s
I20250625 14:01:59.307477 12166 raft_consensus.cc:357] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.307587 12166 raft_consensus.cc:383] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.307626 12166 raft_consensus.cc:738] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.307756 12166 consensus_queue.cc:260] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.308112 12166 ts_tablet_manager.cc:1428] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.308331 12166 tablet_bootstrap.cc:492] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.310240 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7b1b3da0207d4e2fa0a84a55707035c7" } new_table_name: "default.Table_9bcb6255870b4c80b484ff12bcfdca06" modify_external_catalogs: true
I20250625 14:01:59.311774 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c767ef4cab694e09866524f84a429da7
I20250625 14:01:59.312201 11525 catalog_manager.cc:6652] ReplaceTablet: tablet c767ef4cab694e09866524f84a429da7 deleted and replaced by tablet d1b9e127f181474fa1571efd76a99536
I20250625 14:01:59.312599 12166 tablet_bootstrap.cc:654] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.312834 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet c767ef4cab694e09866524f84a429da7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1b9e127f181474fa1571efd76a99536) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:59.316051 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 185a1a5f14344caa89473baa57f0b02d consensus state has no leader
I20250625 14:01:59.316803 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 44dd83c53b15400d94bb7b1a8784569a
I20250625 14:01:59.315464 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5ca55989aaad4709ae95a79ee2c7085c" } modify_external_catalogs: true
I20250625 14:01:59.317042 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5ca55989aaad4709ae95a79ee2c7085c" } modify_external_catalogs: true
I20250625 14:01:59.317418 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b9953f6a3687459a839dae9e6e40beff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.318007 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9953f6a3687459a839dae9e6e40beff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.318522 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_976852db31af4df49d08193e8428af4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.318557 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 44dd83c53b15400d94bb7b1a8784569a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:59.318832 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_976852db31af4df49d08193e8428af4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.303817 12173 ts_tablet_manager.cc:1918] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.319111 12173 log.cc:1199] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7b78fd0d543449bdb2e95fee6a53e93f
I20250625 14:01:59.319401 12173 ts_tablet_manager.cc:1939] T 7b78fd0d543449bdb2e95fee6a53e93f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.313314 12018 tablet_service.cc:1515] Processing DeleteTablet for tablet c767ef4cab694e09866524f84a429da7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1b9e127f181474fa1571efd76a99536) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.320189 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7b78fd0d543449bdb2e95fee6a53e93f (table default.Table_3d82e197e7174db08e444c89b45c77be [id=1cf0251105444beca355668b5a0da27b]) successfully deleted
I20250625 14:01:59.318967 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet 44dd83c53b15400d94bb7b1a8784569a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.317617 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8174031405c64209bd73d2acaf79cf10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.321023 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8174031405c64209bd73d2acaf79cf10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.321903 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5f7bec805c5d4182a130bf45d09b3b35" } new_table_name: "default.Table_918b236a1aca4304b96c0c6a27792324" modify_external_catalogs: true
W20250625 14:01:59.321946 11517 catalog_manager.cc:4895] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 6a483b01a74c424db2a10c3215783411 because the tablet was not found. No further retry: Not found: Tablet not found: 6a483b01a74c424db2a10c3215783411
W20250625 14:01:59.322439 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet ed176205a65d4127b0ae23649187fba0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed176205a65d4127b0ae23649187fba0 already in progress: creating tablet
I20250625 14:01:59.322738 12175 ts_tablet_manager.cc:1918] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:59.322804 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e92174a368614f6184e7a1870cc3d71c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.323136 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e92174a368614f6184e7a1870cc3d71c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:01:59.323185 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11bd0fc7e8ef430ea2cef302f67b8b22 already in progress: creating tablet
I20250625 14:01:59.311771 13232 raft_consensus.cc:491] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.323328 13232 raft_consensus.cc:513] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:01:59.323375 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet c767ef4cab694e09866524f84a429da7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1b9e127f181474fa1571efd76a99536) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.323529 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 44dd83c53b15400d94bb7b1a8784569a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.323681 12173 tablet_replica.cc:331] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.323753 13232 leader_election.cc:290] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:59.323820 12173 raft_consensus.cc:2241] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.323920 12173 raft_consensus.cc:2270] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.324245 12167 tablet_bootstrap.cc:492] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.324333 12167 ts_tablet_manager.cc:1397] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.000s
I20250625 14:01:59.324815 12167 raft_consensus.cc:357] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.324934 12167 raft_consensus.cc:383] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.324975 12167 raft_consensus.cc:738] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.325088 12167 consensus_queue.cc:260] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.325395 12167 ts_tablet_manager.cc:1428] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.325479 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet baf41b19a5ba4eddb65d31567b375eaa
I20250625 14:01:59.325606 12167 tablet_bootstrap.cc:492] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.327649 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d185c7be82b04fe2a30626a6fb082219
W20250625 14:01:59.327759 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c767ef4cab694e09866524f84a429da7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c767ef4cab694e09866524f84a429da7 already in progress: creating tablet
W20250625 14:01:59.327893 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 44dd83c53b15400d94bb7b1a8784569a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44dd83c53b15400d94bb7b1a8784569a already in progress: creating tablet
I20250625 14:01:59.327924 11526 catalog_manager.cc:6652] ReplaceTablet: tablet d185c7be82b04fe2a30626a6fb082219 deleted and replaced by tablet 3ca235e89ed14e8697c73bc4d3ebec7b
I20250625 14:01:59.328064 12167 tablet_bootstrap.cc:654] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.328145 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ba3f2489c8d84b9ab06776e6446dd316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.328529 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba3f2489c8d84b9ab06776e6446dd316 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.328545 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet baf41b19a5ba4eddb65d31567b375eaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.328701 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet d185c7be82b04fe2a30626a6fb082219 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca235e89ed14e8697c73bc4d3ebec7b) from {username='slave'} at 127.0.0.1:48698
W20250625 14:01:59.328665 11993 leader_election.cc:343] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: edfce8c80bb341a48fb1b59def057571
I20250625 14:01:59.328931 12177 tablet_replica.cc:331] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.329083 12177 raft_consensus.cc:2241] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:01:59.329449 11990 leader_election.cc:343] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: edfce8c80bb341a48fb1b59def057571
I20250625 14:01:59.329516 11990 leader_election.cc:304] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:59.329298 12177 raft_consensus.cc:2270] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:59.329610 11990 raft_consensus.cc:2684] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
W20250625 14:01:59.330085 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7808bed1b8f4103bf728b8a525dad5d consensus state has no leader
I20250625 14:01:59.330072 12173 ts_tablet_manager.cc:1905] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.330796 12175 log.cc:1199] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f61d1400161440e49365680085a3fe63
I20250625 14:01:59.331409 12177 ts_tablet_manager.cc:1905] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.331972 12175 ts_tablet_manager.cc:1939] T f61d1400161440e49365680085a3fe63 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.333057 12175 tablet_replica.cc:331] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.333408 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f61d1400161440e49365680085a3fe63 (table default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]) successfully deleted
I20250625 14:01:59.333549 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.333631 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet baf41b19a5ba4eddb65d31567b375eaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.333685 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet d185c7be82b04fe2a30626a6fb082219 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca235e89ed14e8697c73bc4d3ebec7b) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.334053 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet baf41b19a5ba4eddb65d31567b375eaa with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.334203 12018 tablet_service.cc:1515] Processing DeleteTablet for tablet d185c7be82b04fe2a30626a6fb082219 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca235e89ed14e8697c73bc4d3ebec7b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.334913 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f2576ff766494c37b316552a66a5ff31
I20250625 14:01:59.335429 12175 raft_consensus.cc:2241] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.335829 12175 raft_consensus.cc:2270] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.336521 12175 ts_tablet_manager.cc:1905] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.336899 12018 tablet_service.cc:1515] Processing DeleteTablet for tablet 562187f6db8a4883a5bb2d939a31b769 with delete_type TABLET_DATA_DELETED (replaced by tablet fce93c919a3446bb9999be958e08b500) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.336997 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet f2576ff766494c37b316552a66a5ff31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.337258 12177 ts_tablet_manager.cc:1918] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:59.337347 12177 log.cc:1199] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/baf41b19a5ba4eddb65d31567b375eaa
I20250625 14:01:59.337612 12177 ts_tablet_manager.cc:1939] T baf41b19a5ba4eddb65d31567b375eaa P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.338673 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet f2576ff766494c37b316552a66a5ff31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.338694 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet baf41b19a5ba4eddb65d31567b375eaa (table default.Table_f4d1651a42f04c3ea03c9db2668e3c62 [id=d9660eb383fc48bca21f1567f0862813]) successfully deleted
I20250625 14:01:59.335836 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet f2576ff766494c37b316552a66a5ff31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:59.338874 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d185c7be82b04fe2a30626a6fb082219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d185c7be82b04fe2a30626a6fb082219 already in progress: creating tablet
I20250625 14:01:59.339300 12173 ts_tablet_manager.cc:1918] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.339385 12173 log.cc:1199] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/edfce8c80bb341a48fb1b59def057571
I20250625 14:01:59.339466 13137 consensus_queue.cc:1035] T 34806da4b2ec4c2db13322952bf943c5 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:59.339607 12173 ts_tablet_manager.cc:1939] T edfce8c80bb341a48fb1b59def057571 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.340157 12175 ts_tablet_manager.cc:1918] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.340320 12175 log.cc:1199] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/94232e8e88e84350b5f150a6eb433c92
W20250625 14:01:59.340317 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f2576ff766494c37b316552a66a5ff31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2576ff766494c37b316552a66a5ff31 already in progress: creating tablet
I20250625 14:01:59.340610 12175 ts_tablet_manager.cc:1939] T 94232e8e88e84350b5f150a6eb433c92 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.340672 12173 tablet_replica.cc:331] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.340808 12173 raft_consensus.cc:2241] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.340905 12173 raft_consensus.cc:2270] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.342386 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet edfce8c80bb341a48fb1b59def057571 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]) successfully deleted
W20250625 14:01:59.342543 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 31f843108ecf440090c05255afa1687e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31f843108ecf440090c05255afa1687e already in progress: creating tablet
W20250625 14:01:59.342636 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 725a0db4c6374805903657f755ca1783 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 725a0db4c6374805903657f755ca1783 already in progress: creating tablet
W20250625 14:01:59.342717 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b07c4c7d9ba54abe9794ab432f55bf62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b07c4c7d9ba54abe9794ab432f55bf62 already in progress: creating tablet
W20250625 14:01:59.342819 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet e9476529c1b7401683c02e146f54a228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9476529c1b7401683c02e146f54a228 already in progress: creating tablet
I20250625 14:01:59.345099 12173 ts_tablet_manager.cc:1905] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.346802 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 94232e8e88e84350b5f150a6eb433c92 (table default.Table_fc6abd07a4dc4176a7a9c81d3fb81fa4 [id=9bd1814bba0a43fa8a66a50e91ef165f]) successfully deleted
W20250625 14:01:59.347047 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c767ef4cab694e09866524f84a429da7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c767ef4cab694e09866524f84a429da7 already in progress: creating tablet
I20250625 14:01:59.347112 12175 tablet_replica.cc:331] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:01:59.347247 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 44dd83c53b15400d94bb7b1a8784569a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44dd83c53b15400d94bb7b1a8784569a already in progress: creating tablet
I20250625 14:01:59.347386 12175 raft_consensus.cc:2241] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.347536 12175 raft_consensus.cc:2270] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.348117 12175 ts_tablet_manager.cc:1905] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.348528 12173 ts_tablet_manager.cc:1918] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.348610 12173 log.cc:1199] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/5489ee768c384fc0a1c8b6bed25b3a26
I20250625 14:01:59.348816 12173 ts_tablet_manager.cc:1939] T 5489ee768c384fc0a1c8b6bed25b3a26 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.352381 12175 ts_tablet_manager.cc:1918] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.352536 12175 log.cc:1199] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7c68ae7ecff34d34baaffe47c740bac6
I20250625 14:01:59.353050 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 5e2c23049bc84d968e8cfb1f38c2c57e (DEFAULT_TABLE table=default.Table_482a3dd3e80a424e8ffec8e002eeb7e9 [id=752d119e74294b15aaace3426d56fbfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.353432 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2c23049bc84d968e8cfb1f38c2c57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.353422 12173 tablet_replica.cc:331] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.353569 12173 raft_consensus.cc:2241] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.353679 12173 raft_consensus.cc:2270] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.353698 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 5489ee768c384fc0a1c8b6bed25b3a26 (table default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]) successfully deleted
I20250625 14:01:59.354287 12173 ts_tablet_manager.cc:1905] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.352805 12175 ts_tablet_manager.cc:1939] T 7c68ae7ecff34d34baaffe47c740bac6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.353106 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 5e2c23049bc84d968e8cfb1f38c2c57e (DEFAULT_TABLE table=default.Table_482a3dd3e80a424e8ffec8e002eeb7e9 [id=752d119e74294b15aaace3426d56fbfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.356500 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2c23049bc84d968e8cfb1f38c2c57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.357251 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7c68ae7ecff34d34baaffe47c740bac6 (table default.Table_dc38af2e12bd48faa284df718dff16f9 [id=e6793d23bb264d259e9d0218259fea14]) successfully deleted
I20250625 14:01:59.357533 12175 tablet_replica.cc:331] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.357720 12175 raft_consensus.cc:2241] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.357895 12175 raft_consensus.cc:2270] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.358358 12175 ts_tablet_manager.cc:1905] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.360735 12175 ts_tablet_manager.cc:1918] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:59.360857 12175 log.cc:1199] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/baf41b19a5ba4eddb65d31567b375eaa
I20250625 14:01:59.361155 12175 ts_tablet_manager.cc:1939] T baf41b19a5ba4eddb65d31567b375eaa P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.361907 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet baf41b19a5ba4eddb65d31567b375eaa (table default.Table_f4d1651a42f04c3ea03c9db2668e3c62 [id=d9660eb383fc48bca21f1567f0862813]) successfully deleted
W20250625 14:01:59.362475 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d185c7be82b04fe2a30626a6fb082219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d185c7be82b04fe2a30626a6fb082219 already in progress: creating tablet
W20250625 14:01:59.362876 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f2576ff766494c37b316552a66a5ff31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2576ff766494c37b316552a66a5ff31 already in progress: creating tablet
I20250625 14:01:59.363761 12173 ts_tablet_manager.cc:1918] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:59.363888 12173 log.cc:1199] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f61d1400161440e49365680085a3fe63
I20250625 14:01:59.364077 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet d0d890fd97404513bb031cd6f866b976 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.364495 12173 ts_tablet_manager.cc:1939] T f61d1400161440e49365680085a3fe63 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.364769 12172 tablet_bootstrap.cc:492] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.364899 12172 ts_tablet_manager.cc:1397] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.112s user 0.002s sys 0.000s
I20250625 14:01:59.365293 12173 tablet_replica.cc:331] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.365470 12173 raft_consensus.cc:2241] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.365428 12172 raft_consensus.cc:357] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.365576 12172 raft_consensus.cc:383] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.365628 12172 raft_consensus.cc:738] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.365667 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f61d1400161440e49365680085a3fe63 (table default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]) successfully deleted
I20250625 14:01:59.365736 12173 raft_consensus.cc:2270] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.365772 12172 consensus_queue.cc:260] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.366092 12172 ts_tablet_manager.cc:1428] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:59.366338 12172 tablet_bootstrap.cc:492] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.367126 12173 ts_tablet_manager.cc:1905] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.367594 13232 raft_consensus.cc:491] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.367668 13232 raft_consensus.cc:513] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.368072 13232 leader_election.cc:290] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.367477 12172 tablet_bootstrap.cc:654] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:59.369598 11990 leader_election.cc:343] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 562187f6db8a4883a5bb2d939a31b769
I20250625 14:01:59.370714 12173 ts_tablet_manager.cc:1918] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.370795 12173 log.cc:1199] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b949191f6218463192890e13ccf6b17e
I20250625 14:01:59.371016 12173 ts_tablet_manager.cc:1939] T b949191f6218463192890e13ccf6b17e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.372114 12173 tablet_replica.cc:331] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.372277 12173 raft_consensus.cc:2241] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.372289 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b949191f6218463192890e13ccf6b17e (table default.Table_f7ef8af8357846339868b61391e6199c [id=492a3d0d7a8e44a9a4e12606ef07a9fd]) successfully deleted
I20250625 14:01:59.372381 12173 raft_consensus.cc:2270] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.373039 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet fe7e0145fb2f48c29259afafcbe29599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.373221 12177 tablet_replica.cc:331] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.373351 12177 raft_consensus.cc:2241] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.373456 12177 raft_consensus.cc:2270] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.373759 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3731eff88c3045d198a9ac0688354e28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.374193 12173 ts_tablet_manager.cc:1905] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:01:59.374246 11993 leader_election.cc:343] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 562187f6db8a4883a5bb2d939a31b769
I20250625 14:01:59.374372 11993 leader_election.cc:304] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:59.374580 13232 raft_consensus.cc:2747] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:01:59.374912 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3731eff88c3045d198a9ac0688354e28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.376088 12177 ts_tablet_manager.cc:1905] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.376416 12020 tablet_service.cc:1468] Processing CreateTablet for tablet 5e2c23049bc84d968e8cfb1f38c2c57e (DEFAULT_TABLE table=default.Table_482a3dd3e80a424e8ffec8e002eeb7e9 [id=752d119e74294b15aaace3426d56fbfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.376935 12020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2c23049bc84d968e8cfb1f38c2c57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.378631 12177 ts_tablet_manager.cc:1918] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.378705 12177 log.cc:1199] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/fe7e0145fb2f48c29259afafcbe29599
W20250625 14:01:59.378975 11520 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 185a1a5f14344caa89473baa57f0b02d (table default.Table_922f57fe76d744abb3ae8b1378afad5a [id=2efaf3cfcced4f92a53e106561ccec60], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 185a1a5f14344caa89473baa57f0b02d consensus state has no leader
I20250625 14:01:59.381505 12177 ts_tablet_manager.cc:1939] T fe7e0145fb2f48c29259afafcbe29599 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.382357 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet fe7e0145fb2f48c29259afafcbe29599 (table default.Table_57f7d205bb304fd8982fcd30bb558c54 [id=3d7b081834c54daba8172abc85c60576]) successfully deleted
I20250625 14:01:59.382684 12173 ts_tablet_manager.cc:1918] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.382786 12173 log.cc:1199] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/fbf41efa64294f388894a9a57b45fdc2
I20250625 14:01:59.383479 12173 ts_tablet_manager.cc:1939] T fbf41efa64294f388894a9a57b45fdc2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.384392 12173 tablet_replica.cc:331] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.384541 12173 raft_consensus.cc:2241] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.384652 12173 raft_consensus.cc:2270] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.385047 12173 ts_tablet_manager.cc:1905] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.386029 12166 tablet_bootstrap.cc:492] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.386127 12166 ts_tablet_manager.cc:1397] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.000s
I20250625 14:01:59.386812 12166 raft_consensus.cc:357] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.386940 12166 raft_consensus.cc:383] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.386940 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d0d890fd97404513bb031cd6f866b976
I20250625 14:01:59.386974 12166 raft_consensus.cc:738] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.387161 11529 catalog_manager.cc:6652] ReplaceTablet: tablet d0d890fd97404513bb031cd6f866b976 deleted and replaced by tablet 39b41ff066cb499fae9b71ca1f2f9d2b
I20250625 14:01:59.387105 12166 consensus_queue.cc:260] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.387415 12166 ts_tablet_manager.cc:1428] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:59.387617 12166 tablet_bootstrap.cc:492] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:59.387728 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 94232e8e88e84350b5f150a6eb433c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94232e8e88e84350b5f150a6eb433c92 already in progress: creating tablet
W20250625 14:01:59.387840 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c767ef4cab694e09866524f84a429da7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c767ef4cab694e09866524f84a429da7 already in progress: creating tablet
W20250625 14:01:59.387946 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 44dd83c53b15400d94bb7b1a8784569a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44dd83c53b15400d94bb7b1a8784569a already in progress: creating tablet
I20250625 14:01:59.388897 12166 tablet_bootstrap.cc:654] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.390379 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet d0d890fd97404513bb031cd6f866b976 with delete_type TABLET_DATA_DELETED (replaced by tablet 39b41ff066cb499fae9b71ca1f2f9d2b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.391741 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet d0d890fd97404513bb031cd6f866b976 with delete_type TABLET_DATA_DELETED (replaced by tablet 39b41ff066cb499fae9b71ca1f2f9d2b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.391917 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet d0d890fd97404513bb031cd6f866b976 with delete_type TABLET_DATA_DELETED (replaced by tablet 39b41ff066cb499fae9b71ca1f2f9d2b) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:59.392735 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d0d890fd97404513bb031cd6f866b976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0d890fd97404513bb031cd6f866b976 already in progress: creating tablet
W20250625 14:01:59.393183 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d0d890fd97404513bb031cd6f866b976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0d890fd97404513bb031cd6f866b976 already in progress: creating tablet
I20250625 14:01:59.399425 12172 tablet_bootstrap.cc:492] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.399541 12172 ts_tablet_manager.cc:1397] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20250625 14:01:59.400071 12172 raft_consensus.cc:357] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.400195 12172 raft_consensus.cc:383] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.400231 12172 raft_consensus.cc:738] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.400373 12172 consensus_queue.cc:260] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.400664 12172 ts_tablet_manager.cc:1428] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.400877 12172 tablet_bootstrap.cc:492] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.401988 12172 tablet_bootstrap.cc:654] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.402555 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.402756 12175 tablet_replica.cc:331] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.402922 12175 raft_consensus.cc:2241] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.403038 12175 raft_consensus.cc:2270] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.403553 12167 tablet_bootstrap.cc:492] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.403635 12175 ts_tablet_manager.cc:1905] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.403649 12167 ts_tablet_manager.cc:1397] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.000s
I20250625 14:01:59.404175 12167 raft_consensus.cc:357] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.404285 12167 raft_consensus.cc:383] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.404313 12167 raft_consensus.cc:738] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.404429 12167 consensus_queue.cc:260] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.404716 12167 ts_tablet_manager.cc:1428] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.404950 12167 tablet_bootstrap.cc:492] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.405975 12167 tablet_bootstrap.cc:654] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.406153 12175 ts_tablet_manager.cc:1918] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.406235 12175 log.cc:1199] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/da5ed5d8d3ca4342980c893a8653d4a0
I20250625 14:01:59.409909 12175 ts_tablet_manager.cc:1939] T da5ed5d8d3ca4342980c893a8653d4a0 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.410687 12167 tablet_bootstrap.cc:492] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.410797 12167 ts_tablet_manager.cc:1397] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20250625 14:01:59.411059 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet da5ed5d8d3ca4342980c893a8653d4a0 (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]) successfully deleted
I20250625 14:01:59.411381 12167 raft_consensus.cc:357] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.411502 12167 raft_consensus.cc:383] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.411538 12167 raft_consensus.cc:738] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.411655 12167 consensus_queue.cc:260] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.411931 12167 ts_tablet_manager.cc:1428] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.412117 12167 tablet_bootstrap.cc:492] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.412664 12173 ts_tablet_manager.cc:1918] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:01:59.415032 12173 log.cc:1199] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/baf41b19a5ba4eddb65d31567b375eaa
I20250625 14:01:59.415417 12173 ts_tablet_manager.cc:1939] T baf41b19a5ba4eddb65d31567b375eaa P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.413228 12167 tablet_bootstrap.cc:654] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.416134 12018 tablet_service.cc:1515] Processing DeleteTablet for tablet b07c4c7d9ba54abe9794ab432f55bf62 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.416532 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet fe7e0145fb2f48c29259afafcbe29599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.417099 12173 tablet_replica.cc:331] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.417258 12173 raft_consensus.cc:2241] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.417330 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet baf41b19a5ba4eddb65d31567b375eaa (table default.Table_f4d1651a42f04c3ea03c9db2668e3c62 [id=d9660eb383fc48bca21f1567f0862813]) successfully deleted
I20250625 14:01:59.417378 12173 raft_consensus.cc:2270] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:01:59.417526 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d185c7be82b04fe2a30626a6fb082219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d185c7be82b04fe2a30626a6fb082219 already in progress: creating tablet
I20250625 14:01:59.417718 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_78362853037e4817a825f5e2432d44bc" } new_table_name: "default.Table_6826e63ce5054cbea665e81b978621cf" modify_external_catalogs: true
I20250625 14:01:59.421327 12173 ts_tablet_manager.cc:1905] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.424201 12172 tablet_bootstrap.cc:492] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.424316 12172 ts_tablet_manager.cc:1397] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.001s
I20250625 14:01:59.424830 12172 raft_consensus.cc:357] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.424963 12172 raft_consensus.cc:383] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.424996 12172 raft_consensus.cc:738] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.425329 12172 consensus_queue.cc:260] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:01:59.426175 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7bcc674dc5e448c0871e4efe0c9100b8 consensus state has no leader
I20250625 14:01:59.428279 12172 ts_tablet_manager.cc:1428] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250625 14:01:59.392788 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0547992986704a949305e7c5d014b965
I20250625 14:01:59.430904 12173 ts_tablet_manager.cc:1918] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.430997 12173 log.cc:1199] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/562187f6db8a4883a5bb2d939a31b769
I20250625 14:01:59.431190 12167 tablet_bootstrap.cc:492] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.431226 12173 ts_tablet_manager.cc:1939] T 562187f6db8a4883a5bb2d939a31b769 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.431277 12167 ts_tablet_manager.cc:1397] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.002s
I20250625 14:01:59.431761 12167 raft_consensus.cc:357] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.431880 12167 raft_consensus.cc:383] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.431932 12167 raft_consensus.cc:738] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.432049 12173 tablet_replica.cc:331] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.432065 12167 consensus_queue.cc:260] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.432204 12173 raft_consensus.cc:2241] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.432327 12167 ts_tablet_manager.cc:1428] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.432523 12167 tablet_bootstrap.cc:492] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.433208 12173 raft_consensus.cc:2270] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.433221 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 31157f3bd20f4db5a0baa05b61d92f87 (table default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7]). Expected version 1 got 0
I20250625 14:01:59.433678 12167 tablet_bootstrap.cc:654] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.434587 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 562187f6db8a4883a5bb2d939a31b769 (table default.Table_a0f263c69bb2468ea1f6817dc4f3828e [id=13faf6c2665340518bf53a2926d9430e]) successfully deleted
W20250625 14:01:59.434741 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f2576ff766494c37b316552a66a5ff31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2576ff766494c37b316552a66a5ff31 already in progress: creating tablet
W20250625 14:01:59.434854 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d0d890fd97404513bb031cd6f866b976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0d890fd97404513bb031cd6f866b976 already in progress: creating tablet
I20250625 14:01:59.435124 12172 tablet_bootstrap.cc:492] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.439978 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet b07c4c7d9ba54abe9794ab432f55bf62 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.441471 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 31157f3bd20f4db5a0baa05b61d92f87 (table default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7]). Expected version 1 got 0
I20250625 14:01:59.441674 12177 tablet_replica.cc:331] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.441835 12177 raft_consensus.cc:2241] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.441977 12177 raft_consensus.cc:2270] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.443531 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet 0547992986704a949305e7c5d014b965 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.443576 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 0547992986704a949305e7c5d014b965 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.443759 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 0547992986704a949305e7c5d014b965 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.443931 12175 tablet_replica.cc:331] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.444067 12175 raft_consensus.cc:2241] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:59.443589 12172 tablet_bootstrap.cc:654] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.444322 12175 raft_consensus.cc:2270] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.444859 12175 ts_tablet_manager.cc:1905] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.445464 12167 tablet_bootstrap.cc:492] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.445549 12167 ts_tablet_manager.cc:1397] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20250625 14:01:59.446084 12167 raft_consensus.cc:357] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.446208 12167 raft_consensus.cc:383] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.446242 12167 raft_consensus.cc:738] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.446393 12167 consensus_queue.cc:260] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.446725 12167 ts_tablet_manager.cc:1428] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.446942 12167 tablet_bootstrap.cc:492] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.447456 12175 ts_tablet_manager.cc:1918] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.447526 12175 log.cc:1199] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0547992986704a949305e7c5d014b965
I20250625 14:01:59.447790 12175 ts_tablet_manager.cc:1939] T 0547992986704a949305e7c5d014b965 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.448802 12166 tablet_bootstrap.cc:492] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.448879 12166 ts_tablet_manager.cc:1397] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.000s
I20250625 14:01:59.449362 12166 raft_consensus.cc:357] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.449476 12166 raft_consensus.cc:383] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.449508 12166 raft_consensus.cc:738] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.449630 12166 consensus_queue.cc:260] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.449885 12167 tablet_bootstrap.cc:654] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.449941 12166 ts_tablet_manager.cc:1428] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.450150 12166 tablet_bootstrap.cc:492] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.451252 12166 tablet_bootstrap.cc:654] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.454489 12953 tablet.cc:1722] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.455046 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]) successfully deleted
I20250625 14:01:59.455411 13241 tablet.cc:1722] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.456614 12173 ts_tablet_manager.cc:1905] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.456653 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet 07497399a6cd463f8d20d33d9db1d46b with delete_type TABLET_DATA_DELETED (replaced by tablet ce6e907d627f4f3e8219eaabe4373c6e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.457181 13244 tablet.cc:1722] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.460935 12173 ts_tablet_manager.cc:1918] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.461027 12173 log.cc:1199] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b07c4c7d9ba54abe9794ab432f55bf62
I20250625 14:01:59.461256 12173 ts_tablet_manager.cc:1939] T b07c4c7d9ba54abe9794ab432f55bf62 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.461848 12177 ts_tablet_manager.cc:1905] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.464499 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b07c4c7d9ba54abe9794ab432f55bf62 (table default.Table_6a195a661111421cb38dde060c6dcd15 [id=dea2357ffccc4f74b480841db27be138]) successfully deleted
I20250625 14:01:59.464789 12177 ts_tablet_manager.cc:1918] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.464844 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet da5ed5d8d3ca4342980c893a8653d4a0 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.464965 12177 log.cc:1199] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b07c4c7d9ba54abe9794ab432f55bf62
I20250625 14:01:59.465721 12173 tablet_replica.cc:331] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.465881 12173 raft_consensus.cc:2241] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.466015 12173 raft_consensus.cc:2270] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.466774 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet a753b44395994a4abaaa96fb9b6d594a from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.466981 12173 ts_tablet_manager.cc:1905] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.467007 12177 ts_tablet_manager.cc:1939] T b07c4c7d9ba54abe9794ab432f55bf62 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.467675 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b07c4c7d9ba54abe9794ab432f55bf62 (table default.Table_6a195a661111421cb38dde060c6dcd15 [id=dea2357ffccc4f74b480841db27be138]) successfully deleted
I20250625 14:01:59.467931 12177 tablet_replica.cc:331] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.468053 12177 raft_consensus.cc:2241] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.468161 12177 raft_consensus.cc:2270] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.469355 12173 ts_tablet_manager.cc:1918] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.469420 12173 log.cc:1199] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/fe7e0145fb2f48c29259afafcbe29599
I20250625 14:01:59.469645 12173 ts_tablet_manager.cc:1939] T fe7e0145fb2f48c29259afafcbe29599 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.472337 12166 tablet_bootstrap.cc:492] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.472451 12166 ts_tablet_manager.cc:1397] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:01:59.472986 12166 raft_consensus.cc:357] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.473105 12166 raft_consensus.cc:383] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.473107 12177 ts_tablet_manager.cc:1905] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.473142 12166 raft_consensus.cc:738] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.473286 12166 consensus_queue.cc:260] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.473592 12166 ts_tablet_manager.cc:1428] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.473783 12166 tablet_bootstrap.cc:492] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.475411 12167 tablet_bootstrap.cc:492] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.475494 12167 ts_tablet_manager.cc:1397] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.000s
I20250625 14:01:59.475720 12172 tablet_bootstrap.cc:492] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.475811 12172 ts_tablet_manager.cc:1397] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.002s
I20250625 14:01:59.476186 12167 raft_consensus.cc:357] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.476297 12167 raft_consensus.cc:383] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.476328 12167 raft_consensus.cc:738] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.476310 12172 raft_consensus.cc:357] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.476413 12172 raft_consensus.cc:383] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.476446 12172 raft_consensus.cc:738] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.476444 12167 consensus_queue.cc:260] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.476593 12172 consensus_queue.cc:260] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.476745 12167 ts_tablet_manager.cc:1428] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.476936 12167 tablet_bootstrap.cc:492] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.478025 12167 tablet_bootstrap.cc:654] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.478925 12172 ts_tablet_manager.cc:1428] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250625 14:01:59.479116 12172 tablet_bootstrap.cc:492] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.479918 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd] alter complete (version 2)
I20250625 14:01:59.483007 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2eff9b2709c74720a25fd27e8c92073d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.483477 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2eff9b2709c74720a25fd27e8c92073d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.485996 12166 tablet_bootstrap.cc:654] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.488061 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 07497399a6cd463f8d20d33d9db1d46b with delete_type TABLET_DATA_DELETED (replaced by tablet ce6e907d627f4f3e8219eaabe4373c6e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.488938 12172 tablet_bootstrap.cc:654] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.492008 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet 94232e8e88e84350b5f150a6eb433c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.495208 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6" } modify_external_catalogs: true
I20250625 14:01:59.495353 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6" } modify_external_catalogs: true
I20250625 14:01:59.499442 12166 tablet_bootstrap.cc:492] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.499557 12166 ts_tablet_manager.cc:1397] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.002s
I20250625 14:01:59.500116 12166 raft_consensus.cc:357] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.500484 12166 raft_consensus.cc:383] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.500571 12166 raft_consensus.cc:738] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.500785 12166 consensus_queue.cc:260] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.501715 12177 ts_tablet_manager.cc:1918] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.501796 12177 log.cc:1199] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0547992986704a949305e7c5d014b965
I20250625 14:01:59.504309 12177 ts_tablet_manager.cc:1939] T 0547992986704a949305e7c5d014b965 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.504976 12177 tablet_replica.cc:331] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.505061 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]) successfully deleted
I20250625 14:01:59.505113 12177 raft_consensus.cc:2241] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.505221 12177 raft_consensus.cc:2270] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.505856 12172 tablet_bootstrap.cc:492] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.505962 12172 ts_tablet_manager.cc:1397] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.001s
I20250625 14:01:59.506228 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9f894ff0b3064204a192a649afb51078" } new_table_name: "default.Table_938fda12129e4e0ba3d066955f7811b4" modify_external_catalogs: true
I20250625 14:01:59.506433 12172 raft_consensus.cc:357] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.506526 12172 raft_consensus.cc:383] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.506552 12172 raft_consensus.cc:738] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.506659 12172 consensus_queue.cc:260] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.506924 12172 ts_tablet_manager.cc:1428] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.507102 12172 tablet_bootstrap.cc:492] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.508138 12172 tablet_bootstrap.cc:654] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.510646 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet c2307a7c00204e8fa1a14b5112659d91 with delete_type TABLET_DATA_DELETED (replaced by tablet 7491e070e86346b681817fb19d4608f9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.510646 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.511021 12175 tablet_replica.cc:331] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.511171 12175 raft_consensus.cc:2241] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.511303 12175 raft_consensus.cc:2270] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.511445 12177 ts_tablet_manager.cc:1905] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.511621 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a753b44395994a4abaaa96fb9b6d594a
I20250625 14:01:59.511914 11528 catalog_manager.cc:6652] ReplaceTablet: tablet a753b44395994a4abaaa96fb9b6d594a deleted and replaced by tablet bf421457ab6c481f9fd6e18a9572ba5f
I20250625 14:01:59.512699 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 2dc474dd92134a96a8e755537fd431c6 (DEFAULT_TABLE table=default.Table_92f186752e894a628d90ac456558a555 [id=bb47530a041741308081d3d790a1a18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.512961 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc474dd92134a96a8e755537fd431c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.515044 12177 ts_tablet_manager.cc:1918] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.515220 12177 log.cc:1199] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/07497399a6cd463f8d20d33d9db1d46b
I20250625 14:01:59.515501 12177 ts_tablet_manager.cc:1939] T 07497399a6cd463f8d20d33d9db1d46b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.515897 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 3f4589a5ad6c4194a8041b0a33d3f378 (DEFAULT_TABLE table=default.Table_6bb0b7abdba94cf389ace541328ae1b9 [id=e820a11e981d4224a4ae2c25504affa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.516152 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f4589a5ad6c4194a8041b0a33d3f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.516324 11756 tablet_service.cc:1468] Processing CreateTablet for tablet d1b9e127f181474fa1571efd76a99536 (DEFAULT_TABLE table=default.Table_05ba0d7a47814bd5b9443c9db8a32e6e [id=804b247e248b4720a350f63a492d84fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.516424 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 4fd2ee633d464f7c8be1f06da7be0c70 (DEFAULT_TABLE table=default.Table_e4fe5899ea124412b41a61ce3e23c37e [id=38c269304b524db7a81238a88562390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.516539 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b9e127f181474fa1571efd76a99536. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.516654 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd2ee633d464f7c8be1f06da7be0c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.512486 11764 tablet_service.cc:1468] Processing CreateTablet for tablet c47ba61afcbc4ba0a226b54b03db9791 (DEFAULT_TABLE table=default.Table_b9953f6a3687459a839dae9e6e40beff [id=1b5bb580a107467fa7fb2586eb64863b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.517736 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47ba61afcbc4ba0a226b54b03db9791. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.512244 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 717254244e9b4cf399c231a37480a3a1 (DEFAULT_TABLE table=default.Table_8174031405c64209bd73d2acaf79cf10 [id=f05c4db3313d4cb3bae522ae816549d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.518393 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 7b3a33d8d92c4448af91b31c335ea55c (DEFAULT_TABLE table=default.Table_f67df6002e4a4dbab5f5e582fd21e7a3 [id=6865693428e34098b7f3afc9bf9a02c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.518491 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717254244e9b4cf399c231a37480a3a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.518622 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3a33d8d92c4448af91b31c335ea55c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.516115 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 8cf54c149e444987817228977ac06c2d (DEFAULT_TABLE table=default.Table_9e3ac56046254085872f6bb408f6dcce [id=9b7b82daca56413cb9d5342456fe37a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.518996 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf54c149e444987817228977ac06c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.520659 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 3ca235e89ed14e8697c73bc4d3ebec7b (DEFAULT_TABLE table=default.Table_dc9acbfacd2248c4afbe5de227109f68 [id=2c5856c86f724fca9b7f2f52c6614392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.520895 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca235e89ed14e8697c73bc4d3ebec7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.522497 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 07497399a6cd463f8d20d33d9db1d46b (table default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]) successfully deleted
I20250625 14:01:59.522552 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_af26ccf8ce5a45cfb5b289f079649798"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.522969 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af26ccf8ce5a45cfb5b289f079649798 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.522990 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 895fc98cc6dd4c20bc9d05a4fe531b5a (DEFAULT_TABLE table=default.Table_976852db31af4df49d08193e8428af4b [id=1abf7af270774fa0a9884865accb16a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.523036 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_30d2b65a1ea44e8095e36aea0cc2de45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.523193 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895fc98cc6dd4c20bc9d05a4fe531b5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.523352 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30d2b65a1ea44e8095e36aea0cc2de45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.523829 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c66ec2ace79b455dbc30a951673d2ddc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.524142 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c66ec2ace79b455dbc30a951673d2ddc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.525211 11753 tablet_service.cc:1468] Processing CreateTablet for tablet b1f5b1d02509410ca26e5861d274e098 (DEFAULT_TABLE table=default.Table_7bfc267608654b02b8bab5ba2f13854e [id=ec8e8f69a966454593eb1fd39f139674]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.525429 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f5b1d02509410ca26e5861d274e098. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.526451 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c984df852aa94d7ca7bd587f29837bda" } new_table_name: "default.Table_390418f3372f4207a237db157de126ab" modify_external_catalogs: true
I20250625 14:01:59.527477 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 25bb156e110146e3a0a8cef384166962 (DEFAULT_TABLE table=default.Table_ce33fd7f17a44af0bd8655dcdd52418b [id=c0d13eaea3ce4e5da8a568aafe1bd85d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.527741 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bb156e110146e3a0a8cef384166962. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.528759 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c2307a7c00204e8fa1a14b5112659d91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2307a7c00204e8fa1a14b5112659d91 already in progress: creating tablet
I20250625 14:01:59.528899 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8354c456c6bc43a6a7f1925797c6e199" } modify_external_catalogs: true
I20250625 14:01:59.529006 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8354c456c6bc43a6a7f1925797c6e199" } modify_external_catalogs: true
I20250625 14:01:59.529491 12018 tablet_service.cc:1468] Processing CreateTablet for tablet c47ba61afcbc4ba0a226b54b03db9791 (DEFAULT_TABLE table=default.Table_b9953f6a3687459a839dae9e6e40beff [id=1b5bb580a107467fa7fb2586eb64863b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.529767 12018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47ba61afcbc4ba0a226b54b03db9791. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.529899 12020 tablet_service.cc:1468] Processing CreateTablet for tablet 717254244e9b4cf399c231a37480a3a1 (DEFAULT_TABLE table=default.Table_8174031405c64209bd73d2acaf79cf10 [id=f05c4db3313d4cb3bae522ae816549d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.530130 12020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717254244e9b4cf399c231a37480a3a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.515184 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 34138099f8b248dbb6465f6137e3942b (DEFAULT_TABLE table=default.Table_e4c20f5076904d6d8060e5013a7512bf [id=b3d231b3023d4f1fb3228f89bad64e36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.531533 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34138099f8b248dbb6465f6137e3942b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.532274 12022 tablet_service.cc:1468] Processing CreateTablet for tablet 3f4589a5ad6c4194a8041b0a33d3f378 (DEFAULT_TABLE table=default.Table_6bb0b7abdba94cf389ace541328ae1b9 [id=e820a11e981d4224a4ae2c25504affa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.532398 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 2dc474dd92134a96a8e755537fd431c6 (DEFAULT_TABLE table=default.Table_92f186752e894a628d90ac456558a555 [id=bb47530a041741308081d3d790a1a18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.532496 12022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f4589a5ad6c4194a8041b0a33d3f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.532714 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 34138099f8b248dbb6465f6137e3942b (DEFAULT_TABLE table=default.Table_e4c20f5076904d6d8060e5013a7512bf [id=b3d231b3023d4f1fb3228f89bad64e36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.532915 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34138099f8b248dbb6465f6137e3942b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.533210 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 34138099f8b248dbb6465f6137e3942b (DEFAULT_TABLE table=default.Table_e4c20f5076904d6d8060e5013a7512bf [id=b3d231b3023d4f1fb3228f89bad64e36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.533485 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34138099f8b248dbb6465f6137e3942b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.533728 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 717254244e9b4cf399c231a37480a3a1 (DEFAULT_TABLE table=default.Table_8174031405c64209bd73d2acaf79cf10 [id=f05c4db3313d4cb3bae522ae816549d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.533923 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717254244e9b4cf399c231a37480a3a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.534526 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 8cf54c149e444987817228977ac06c2d (DEFAULT_TABLE table=default.Table_9e3ac56046254085872f6bb408f6dcce [id=9b7b82daca56413cb9d5342456fe37a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.534649 12024 tablet_service.cc:1468] Processing CreateTablet for tablet 7b3a33d8d92c4448af91b31c335ea55c (DEFAULT_TABLE table=default.Table_f67df6002e4a4dbab5f5e582fd21e7a3 [id=6865693428e34098b7f3afc9bf9a02c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.534731 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf54c149e444987817228977ac06c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.534857 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3a33d8d92c4448af91b31c335ea55c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.534917 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet a753b44395994a4abaaa96fb9b6d594a with delete_type TABLET_DATA_DELETED (replaced by tablet bf421457ab6c481f9fd6e18a9572ba5f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.535149 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 8cf54c149e444987817228977ac06c2d (DEFAULT_TABLE table=default.Table_9e3ac56046254085872f6bb408f6dcce [id=9b7b82daca56413cb9d5342456fe37a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.535339 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf54c149e444987817228977ac06c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.536010 11901 tablet_service.cc:1468] Processing CreateTablet for tablet c47ba61afcbc4ba0a226b54b03db9791 (DEFAULT_TABLE table=default.Table_b9953f6a3687459a839dae9e6e40beff [id=1b5bb580a107467fa7fb2586eb64863b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.536208 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47ba61afcbc4ba0a226b54b03db9791. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.536780 11889 tablet_service.cc:1468] Processing CreateTablet for tablet 4fd2ee633d464f7c8be1f06da7be0c70 (DEFAULT_TABLE table=default.Table_e4fe5899ea124412b41a61ce3e23c37e [id=38c269304b524db7a81238a88562390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.536830 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 4fd2ee633d464f7c8be1f06da7be0c70 (DEFAULT_TABLE table=default.Table_e4fe5899ea124412b41a61ce3e23c37e [id=38c269304b524db7a81238a88562390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.536986 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd2ee633d464f7c8be1f06da7be0c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.537078 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd2ee633d464f7c8be1f06da7be0c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.537403 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 3ca235e89ed14e8697c73bc4d3ebec7b (DEFAULT_TABLE table=default.Table_dc9acbfacd2248c4afbe5de227109f68 [id=2c5856c86f724fca9b7f2f52c6614392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.537595 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca235e89ed14e8697c73bc4d3ebec7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.538228 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 2dc474dd92134a96a8e755537fd431c6 (DEFAULT_TABLE table=default.Table_92f186752e894a628d90ac456558a555 [id=bb47530a041741308081d3d790a1a18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.538455 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc474dd92134a96a8e755537fd431c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.538987 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 25bb156e110146e3a0a8cef384166962 (DEFAULT_TABLE table=default.Table_ce33fd7f17a44af0bd8655dcdd52418b [id=c0d13eaea3ce4e5da8a568aafe1bd85d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.539224 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bb156e110146e3a0a8cef384166962. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.539215 12021 tablet_service.cc:1468] Processing CreateTablet for tablet d1b9e127f181474fa1571efd76a99536 (DEFAULT_TABLE table=default.Table_05ba0d7a47814bd5b9443c9db8a32e6e [id=804b247e248b4720a350f63a492d84fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.539438 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b9e127f181474fa1571efd76a99536. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.539961 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 895fc98cc6dd4c20bc9d05a4fe531b5a (DEFAULT_TABLE table=default.Table_976852db31af4df49d08193e8428af4b [id=1abf7af270774fa0a9884865accb16a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.540200 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895fc98cc6dd4c20bc9d05a4fe531b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.540433 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 3f4589a5ad6c4194a8041b0a33d3f378 (DEFAULT_TABLE table=default.Table_6bb0b7abdba94cf389ace541328ae1b9 [id=e820a11e981d4224a4ae2c25504affa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.540627 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f4589a5ad6c4194a8041b0a33d3f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.541528 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 7b3a33d8d92c4448af91b31c335ea55c (DEFAULT_TABLE table=default.Table_f67df6002e4a4dbab5f5e582fd21e7a3 [id=6865693428e34098b7f3afc9bf9a02c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.541742 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3a33d8d92c4448af91b31c335ea55c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.542431 12027 tablet_service.cc:1468] Processing CreateTablet for tablet b1f5b1d02509410ca26e5861d274e098 (DEFAULT_TABLE table=default.Table_7bfc267608654b02b8bab5ba2f13854e [id=ec8e8f69a966454593eb1fd39f139674]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.542662 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f5b1d02509410ca26e5861d274e098. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.542723 11893 tablet_service.cc:1468] Processing CreateTablet for tablet d1b9e127f181474fa1571efd76a99536 (DEFAULT_TABLE table=default.Table_05ba0d7a47814bd5b9443c9db8a32e6e [id=804b247e248b4720a350f63a492d84fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.542972 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b9e127f181474fa1571efd76a99536. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.544857 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 25bb156e110146e3a0a8cef384166962 (DEFAULT_TABLE table=default.Table_ce33fd7f17a44af0bd8655dcdd52418b [id=c0d13eaea3ce4e5da8a568aafe1bd85d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.544983 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 895fc98cc6dd4c20bc9d05a4fe531b5a (DEFAULT_TABLE table=default.Table_976852db31af4df49d08193e8428af4b [id=1abf7af270774fa0a9884865accb16a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.545109 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bb156e110146e3a0a8cef384166962. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.545254 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895fc98cc6dd4c20bc9d05a4fe531b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.545895 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e9c835f1c3dc47c09fcd413793c7b468
I20250625 14:01:59.546643 13232 consensus_queue.cc:1035] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:59.547250 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet a753b44395994a4abaaa96fb9b6d594a with delete_type TABLET_DATA_DELETED (replaced by tablet bf421457ab6c481f9fd6e18a9572ba5f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.547508 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 3ca235e89ed14e8697c73bc4d3ebec7b (DEFAULT_TABLE table=default.Table_dc9acbfacd2248c4afbe5de227109f68 [id=2c5856c86f724fca9b7f2f52c6614392]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.547763 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca235e89ed14e8697c73bc4d3ebec7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.548094 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet a753b44395994a4abaaa96fb9b6d594a with delete_type TABLET_DATA_DELETED (replaced by tablet bf421457ab6c481f9fd6e18a9572ba5f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.549970 11902 tablet_service.cc:1468] Processing CreateTablet for tablet b1f5b1d02509410ca26e5861d274e098 (DEFAULT_TABLE table=default.Table_7bfc267608654b02b8bab5ba2f13854e [id=ec8e8f69a966454593eb1fd39f139674]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.550227 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f5b1d02509410ca26e5861d274e098. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.550760 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 432e55208a0f48b594a2fe564132cbf0 consensus state has no leader
I20250625 14:01:59.552302 12166 ts_tablet_manager.cc:1428] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.053s user 0.001s sys 0.001s
I20250625 14:01:59.554652 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc474dd92134a96a8e755537fd431c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.556519 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_072df55a5df0479fb592845c15dff01c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.556934 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_072df55a5df0479fb592845c15dff01c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.557118 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_216035509d754cd4ac22e6f099da4b0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.557405 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_216035509d754cd4ac22e6f099da4b0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.557390 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet e9c835f1c3dc47c09fcd413793c7b468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.557562 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet e9c835f1c3dc47c09fcd413793c7b468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.557768 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 94232e8e88e84350b5f150a6eb433c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.557994 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 4bd610ccce4c4aa68491b0ebbdf0002a (DEFAULT_TABLE table=default.Table_3ef1319b5c184316b50ed0cc8da2abec [id=d0b6ed6ad96d47fe8a076bb6a74e7998]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.558153 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7bfc267608654b02b8bab5ba2f13854e" } modify_external_catalogs: true
I20250625 14:01:59.558241 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 0357aab4556d46d9b4d89e7da15ecea1 (DEFAULT_TABLE table=default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.558640 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 08e79c28647c41c4b0742ac6d9dba263 (DEFAULT_TABLE table=default.Table_a1ecfd0916294ebe951c634ea2a511cd [id=c23917a40c8c40f4a9999952c48afa1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.558641 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_23ccd801edbc4c80afbeba211d60923a" } new_table_name: "default.Table_2142455242ee42d5820deea5646c9bc2" modify_external_catalogs: true
I20250625 14:01:59.557730 11752 tablet_service.cc:1468] Processing CreateTablet for tablet ae35e73e14994aa7bd2820d5ceebcf76 (DEFAULT_TABLE table=default.Table_f8c95bb7ee4a4466bccff25a7d276647 [id=c5376886b2ca419b9cbd6135673dc119]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.558507 12166 tablet_bootstrap.cc:492] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.559118 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e79c28647c41c4b0742ac6d9dba263. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.559598 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a753b44395994a4abaaa96fb9b6d594a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a753b44395994a4abaaa96fb9b6d594a already in progress: creating tablet
I20250625 14:01:59.561357 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c0aa8bb1b9b2417aa42dddc6bc8d31b0" } modify_external_catalogs: true
I20250625 14:01:59.561401 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0357aab4556d46d9b4d89e7da15ecea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.562094 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 288a1cfb3c474a5a878824fc21937895 (DEFAULT_TABLE table=default.Table_aef9a66f765d4816ade12005b3c33318 [id=801db7022b6645b4acf6e912afb40a90]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.562371 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288a1cfb3c474a5a878824fc21937895. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.563548 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd610ccce4c4aa68491b0ebbdf0002a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.565310 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet e9c835f1c3dc47c09fcd413793c7b468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.565477 12177 tablet_replica.cc:331] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.565613 12177 raft_consensus.cc:2241] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.565737 12177 raft_consensus.cc:2270] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.565861 11764 tablet_service.cc:1468] Processing CreateTablet for tablet a0f052a379904917abdd5a5e488e6812 (DEFAULT_TABLE table=default.Table_d9db4adbbed242fdb6cf2b0bd4434cb3 [id=0a1d0dae9e6f4fc290a1697e123f7dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.566090 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae35e73e14994aa7bd2820d5ceebcf76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.568189 12177 ts_tablet_manager.cc:1905] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.570230 12177 ts_tablet_manager.cc:1918] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.570297 12177 log.cc:1199] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/94232e8e88e84350b5f150a6eb433c92
I20250625 14:01:59.570528 12177 ts_tablet_manager.cc:1939] T 94232e8e88e84350b5f150a6eb433c92 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.571306 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f052a379904917abdd5a5e488e6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.571595 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 94232e8e88e84350b5f150a6eb433c92 (table default.Table_fc6abd07a4dc4176a7a9c81d3fb81fa4 [id=9bd1814bba0a43fa8a66a50e91ef165f]) successfully deleted
I20250625 14:01:59.572688 12172 tablet_bootstrap.cc:492] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.572767 12172 ts_tablet_manager.cc:1397] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.000s
I20250625 14:01:59.573280 12172 raft_consensus.cc:357] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.573282 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7bfc267608654b02b8bab5ba2f13854e" } modify_external_catalogs: true
I20250625 14:01:59.573380 12172 raft_consensus.cc:383] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.573423 12172 raft_consensus.cc:738] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.573540 12172 consensus_queue.cc:260] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.573745 12177 tablet_replica.cc:331] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.573807 12172 ts_tablet_manager.cc:1428] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.573855 12177 raft_consensus.cc:2241] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:59.574002 12172 tablet_bootstrap.cc:492] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.574045 12177 raft_consensus.cc:2270] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.574617 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c0aa8bb1b9b2417aa42dddc6bc8d31b0" } modify_external_catalogs: true
I20250625 14:01:59.574815 12177 ts_tablet_manager.cc:1905] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.576722 12172 tablet_bootstrap.cc:654] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.576893 12177 ts_tablet_manager.cc:1918] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.576992 12177 log.cc:1199] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e9c835f1c3dc47c09fcd413793c7b468
I20250625 14:01:59.577276 12177 ts_tablet_manager.cc:1939] T e9c835f1c3dc47c09fcd413793c7b468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.580509 12028 tablet_service.cc:1468] Processing CreateTablet for tablet a0f052a379904917abdd5a5e488e6812 (DEFAULT_TABLE table=default.Table_d9db4adbbed242fdb6cf2b0bd4434cb3 [id=0a1d0dae9e6f4fc290a1697e123f7dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.580673 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 0357aab4556d46d9b4d89e7da15ecea1 (DEFAULT_TABLE table=default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.580818 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f052a379904917abdd5a5e488e6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.580947 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0357aab4556d46d9b4d89e7da15ecea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.581144 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 08e79c28647c41c4b0742ac6d9dba263 (DEFAULT_TABLE table=default.Table_a1ecfd0916294ebe951c634ea2a511cd [id=c23917a40c8c40f4a9999952c48afa1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.581218 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 0357aab4556d46d9b4d89e7da15ecea1 (DEFAULT_TABLE table=default.Table_55a7a183514a4c8fb0bccc8ee4751b96 [id=1b9036307d9e46c991e16cf6f42b0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.581429 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e79c28647c41c4b0742ac6d9dba263. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.582988 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet c2307a7c00204e8fa1a14b5112659d91 with delete_type TABLET_DATA_DELETED (replaced by tablet 7491e070e86346b681817fb19d4608f9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.582998 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 288a1cfb3c474a5a878824fc21937895 (DEFAULT_TABLE table=default.Table_aef9a66f765d4816ade12005b3c33318 [id=801db7022b6645b4acf6e912afb40a90]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.583488 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 288a1cfb3c474a5a878824fc21937895 (DEFAULT_TABLE table=default.Table_aef9a66f765d4816ade12005b3c33318 [id=801db7022b6645b4acf6e912afb40a90]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.583721 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288a1cfb3c474a5a878824fc21937895. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.583711 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 4bd610ccce4c4aa68491b0ebbdf0002a (DEFAULT_TABLE table=default.Table_3ef1319b5c184316b50ed0cc8da2abec [id=d0b6ed6ad96d47fe8a076bb6a74e7998]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.584403 12172 tablet_bootstrap.cc:492] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.584484 12172 ts_tablet_manager.cc:1397] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:01:59.585005 12172 raft_consensus.cc:357] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.585105 12172 raft_consensus.cc:383] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.585135 12172 raft_consensus.cc:738] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.585250 12172 consensus_queue.cc:260] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.585678 12172 ts_tablet_manager.cc:1428] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.585983 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 08e79c28647c41c4b0742ac6d9dba263 (DEFAULT_TABLE table=default.Table_a1ecfd0916294ebe951c634ea2a511cd [id=c23917a40c8c40f4a9999952c48afa1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.586205 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e79c28647c41c4b0742ac6d9dba263. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.588423 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 4bd610ccce4c4aa68491b0ebbdf0002a (DEFAULT_TABLE table=default.Table_3ef1319b5c184316b50ed0cc8da2abec [id=d0b6ed6ad96d47fe8a076bb6a74e7998]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.588641 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd610ccce4c4aa68491b0ebbdf0002a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.589983 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet dce1b63ad2924626972ce7a42a4fdb60 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.590376 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_43fdda0af50e4d8b987902ac23c1a825"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.590778 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43fdda0af50e4d8b987902ac23c1a825 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.590873 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f4efe8dfe3af443fbd60cac1679baa02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.591056 11902 tablet_service.cc:1468] Processing CreateTablet for tablet ae35e73e14994aa7bd2820d5ceebcf76 (DEFAULT_TABLE table=default.Table_f8c95bb7ee4a4466bccff25a7d276647 [id=c5376886b2ca419b9cbd6135673dc119]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:59.591217 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4efe8dfe3af443fbd60cac1679baa02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.591347 11892 tablet_service.cc:1468] Processing CreateTablet for tablet a0f052a379904917abdd5a5e488e6812 (DEFAULT_TABLE table=default.Table_d9db4adbbed242fdb6cf2b0bd4434cb3 [id=0a1d0dae9e6f4fc290a1697e123f7dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.591692 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet e62aba799c354c178db2d8c31ce7e969 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.592403 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e3af8a01ca1f49afb8aa1834807abf7e
I20250625 14:01:59.592532 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_aef9a66f765d4816ade12005b3c33318" } new_table_name: "default.Table_c57cd636ba1c49508359b58785d42202" modify_external_catalogs: true
I20250625 14:01:59.592742 12036 tablet_service.cc:1468] Processing CreateTablet for tablet ae35e73e14994aa7bd2820d5ceebcf76 (DEFAULT_TABLE table=default.Table_f8c95bb7ee4a4466bccff25a7d276647 [id=c5376886b2ca419b9cbd6135673dc119]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.592779 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ecf43538fe7449d3b6b1cb9e34781b9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.593017 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae35e73e14994aa7bd2820d5ceebcf76. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.593060 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecf43538fe7449d3b6b1cb9e34781b9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.594133 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288a1cfb3c474a5a878824fc21937895. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.595316 13232 raft_consensus.cc:491] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.595402 13232 raft_consensus.cc:513] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.595428 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet e3af8a01ca1f49afb8aa1834807abf7e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.595752 13232 leader_election.cc:290] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.596886 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd610ccce4c4aa68491b0ebbdf0002a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.597015 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0f052a379904917abdd5a5e488e6812. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.599063 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae35e73e14994aa7bd2820d5ceebcf76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.601138 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet e3af8a01ca1f49afb8aa1834807abf7e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.601351 13241 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20250625 14:01:59.601701 12177 tablet_replica.cc:331] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.601732 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e9c835f1c3dc47c09fcd413793c7b468 (table default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6 [id=b434548c0974419586018378be509878]) successfully deleted
I20250625 14:01:59.601845 12177 raft_consensus.cc:2241] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:01:59.602026 12177 raft_consensus.cc:2270] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.602399 12173 tablet_replica.cc:331] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.602442 12177 ts_tablet_manager.cc:1905] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.602650 12173 raft_consensus.cc:2241] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.603657 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e62aba799c354c178db2d8c31ce7e969
I20250625 14:01:59.603988 11524 catalog_manager.cc:6652] ReplaceTablet: tablet e62aba799c354c178db2d8c31ce7e969 deleted and replaced by tablet 47ed422d7a274075b5e44cd9a59e370f
I20250625 14:01:59.604218 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4b1e6053c18e494c91d6de1708f61215"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.604632 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b1e6053c18e494c91d6de1708f61215 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.604830 12177 ts_tablet_manager.cc:1918] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:59.604902 12177 log.cc:1199] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e3af8a01ca1f49afb8aa1834807abf7e
I20250625 14:01:59.605181 12177 ts_tablet_manager.cc:1939] T e3af8a01ca1f49afb8aa1834807abf7e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.603077 12173 raft_consensus.cc:2270] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.606568 12172 tablet_bootstrap.cc:492] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.607472 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b1f5b1d02509410ca26e5861d274e098
I20250625 14:01:59.607568 12172 tablet_bootstrap.cc:654] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:59.608048 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5df4b218df7d4e4e9e634d3cd4f17633 consensus state has no leader
I20250625 14:01:59.608542 12173 ts_tablet_manager.cc:1905] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.608707 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet be4378f7781541d7866e6d5c440b13e6
I20250625 14:01:59.610810 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet e3af8a01ca1f49afb8aa1834807abf7e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:59.608551 11993 leader_election.cc:343] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 07497399a6cd463f8d20d33d9db1d46b
I20250625 14:01:59.611670 12166 tablet_bootstrap.cc:654] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.612480 12600 consensus_queue.cc:1035] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:59.614537 12173 ts_tablet_manager.cc:1918] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.614616 12173 log.cc:1199] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0547992986704a949305e7c5d014b965
I20250625 14:01:59.614873 12173 ts_tablet_manager.cc:1939] T 0547992986704a949305e7c5d014b965 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.615494 12173 tablet_replica.cc:331] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.615633 12173 raft_consensus.cc:2241] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.615733 12173 raft_consensus.cc:2270] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.619231 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
I20250625 14:01:59.619908 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet e62aba799c354c178db2d8c31ce7e969 with delete_type TABLET_DATA_DELETED (replaced by tablet 47ed422d7a274075b5e44cd9a59e370f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.620085 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet b1f5b1d02509410ca26e5861d274e098 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.620203 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet be4378f7781541d7866e6d5c440b13e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.620322 12177 tablet_replica.cc:331] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.620460 12177 raft_consensus.cc:2241] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.620574 12177 raft_consensus.cc:2270] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.620647 12953 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20250625 14:01:59.620980 12177 ts_tablet_manager.cc:1905] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.621233 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0357aab4556d46d9b4d89e7da15ecea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.623230 12175 ts_tablet_manager.cc:1905] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.623466 12177 ts_tablet_manager.cc:1918] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.623543 12177 log.cc:1199] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e62aba799c354c178db2d8c31ce7e969
I20250625 14:01:59.623801 12177 ts_tablet_manager.cc:1939] T e62aba799c354c178db2d8c31ce7e969 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.625428 12175 ts_tablet_manager.cc:1918] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.625501 12175 log.cc:1199] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/1dc5b8ea4f3b47f19c603c235fa79007
I20250625 14:01:59.625712 12175 ts_tablet_manager.cc:1939] T 1dc5b8ea4f3b47f19c603c235fa79007 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.626454 12175 tablet_replica.cc:331] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.626605 12175 raft_consensus.cc:2241] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.626725 12175 raft_consensus.cc:2270] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.627341 12175 ts_tablet_manager.cc:1905] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.629565 12175 ts_tablet_manager.cc:1918] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.629729 12175 log.cc:1199] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e9c835f1c3dc47c09fcd413793c7b468
I20250625 14:01:59.630066 12175 ts_tablet_manager.cc:1939] T e9c835f1c3dc47c09fcd413793c7b468 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.621726 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet fe7e0145fb2f48c29259afafcbe29599 (table default.Table_57f7d205bb304fd8982fcd30bb558c54 [id=3d7b081834c54daba8172abc85c60576]) successfully deleted
I20250625 14:01:59.630749 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0547992986704a949305e7c5d014b965 (table default.Table_5ca55989aaad4709ae95a79ee2c7085c [id=d1350de96d2845a39d309bd7b94f6e26]) successfully deleted
W20250625 14:01:59.631565 11990 leader_election.cc:343] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 07497399a6cd463f8d20d33d9db1d46b
I20250625 14:01:59.631657 11990 leader_election.cc:304] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:01:59.631749 11990 raft_consensus.cc:2684] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:01:59.632182 13121 consensus_queue.cc:1035] T ff4973a4d8ec46c7aa640fcaf40b5c87 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:59.633417 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]) successfully deleted
W20250625 14:01:59.633729 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b1f5b1d02509410ca26e5861d274e098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f5b1d02509410ca26e5861d274e098 already in progress: creating tablet
W20250625 14:01:59.633889 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet be4378f7781541d7866e6d5c440b13e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be4378f7781541d7866e6d5c440b13e6 already in progress: creating tablet
I20250625 14:01:59.635061 12047 raft_consensus.cc:3058] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.635949 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_922f57fe76d744abb3ae8b1378afad5a" } new_table_name: "default.Table_65610e9b154a415e81112beb1f0412b4" modify_external_catalogs: true
I20250625 14:01:59.636229 12047 raft_consensus.cc:1273] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:01:59.637038 12167 tablet_bootstrap.cc:492] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.637064 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 4fd2ee633d464f7c8be1f06da7be0c70 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.637128 12167 ts_tablet_manager.cc:1397] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.160s user 0.002s sys 0.000s
I20250625 14:01:59.637652 12167 raft_consensus.cc:357] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.637753 12167 raft_consensus.cc:383] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.637778 12167 raft_consensus.cc:738] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.637882 12167 consensus_queue.cc:260] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.638172 12167 ts_tablet_manager.cc:1428] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:59.638345 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 288a1cfb3c474a5a878824fc21937895 consensus state has no leader
I20250625 14:01:59.638417 12167 tablet_bootstrap.cc:492] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.639477 12167 tablet_bootstrap.cc:654] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.640106 12600 consensus_queue.cc:1035] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:01:59.640281 12172 tablet_bootstrap.cc:492] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.640372 12172 ts_tablet_manager.cc:1397] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20250625 14:01:59.640786 12172 raft_consensus.cc:357] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.640875 12172 raft_consensus.cc:383] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.640913 12172 raft_consensus.cc:738] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.641022 12172 consensus_queue.cc:260] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.641268 12172 ts_tablet_manager.cc:1428] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.642110 13244 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20250625 14:01:59.642899 12173 ts_tablet_manager.cc:1905] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.645756 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 1dc5b8ea4f3b47f19c603c235fa79007 (table default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]) successfully deleted
W20250625 14:01:59.645956 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a753b44395994a4abaaa96fb9b6d594a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a753b44395994a4abaaa96fb9b6d594a already in progress: creating tablet
I20250625 14:01:59.646984 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet e62aba799c354c178db2d8c31ce7e969 with delete_type TABLET_DATA_DELETED (replaced by tablet 47ed422d7a274075b5e44cd9a59e370f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.647172 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet b1f5b1d02509410ca26e5861d274e098 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.647325 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet be4378f7781541d7866e6d5c440b13e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.648890 12953 tablet.cc:1722] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.649278 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet be4378f7781541d7866e6d5c440b13e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.649387 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet b1f5b1d02509410ca26e5861d274e098 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.649878 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet e62aba799c354c178db2d8c31ce7e969 with delete_type TABLET_DATA_DELETED (replaced by tablet 47ed422d7a274075b5e44cd9a59e370f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.650259 12172 tablet_bootstrap.cc:492] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.651971 13241 tablet.cc:1722] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.654517 12172 tablet_bootstrap.cc:654] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.658182 12173 ts_tablet_manager.cc:1918] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.658283 12173 log.cc:1199] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/07497399a6cd463f8d20d33d9db1d46b
I20250625 14:01:59.658519 12173 ts_tablet_manager.cc:1939] T 07497399a6cd463f8d20d33d9db1d46b P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.660593 12175 tablet_replica.cc:331] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.664584 12175 raft_consensus.cc:2241] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:01:59.664608 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 185a1a5f14344caa89473baa57f0b02d consensus state has no leader
I20250625 14:01:59.664850 12175 raft_consensus.cc:2270] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.664899 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ca18a9657ad246d1a95d953e4b2389c9" } modify_external_catalogs: true
I20250625 14:01:59.665016 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ca18a9657ad246d1a95d953e4b2389c9" } modify_external_catalogs: true
I20250625 14:01:59.667836 11529 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_390418f3372f4207a237db157de126ab [id=05ba3fb82ea74715a67dbefb3018db83] alter complete (version 6)
I20250625 14:01:59.670398 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.670593 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.670792 12177 tablet_replica.cc:331] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.670847 12173 tablet_replica.cc:331] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.670930 12177 raft_consensus.cc:2241] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.671012 12173 raft_consensus.cc:2241] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.671034 12177 raft_consensus.cc:2270] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.671137 12173 raft_consensus.cc:2270] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.671532 12177 ts_tablet_manager.cc:1905] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.673437 12173 ts_tablet_manager.cc:1905] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.673815 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 07497399a6cd463f8d20d33d9db1d46b (table default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]) successfully deleted
I20250625 14:01:59.673944 12177 ts_tablet_manager.cc:1918] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.674017 12177 log.cc:1199] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/1dc5b8ea4f3b47f19c603c235fa79007
I20250625 14:01:59.674254 12177 ts_tablet_manager.cc:1939] T 1dc5b8ea4f3b47f19c603c235fa79007 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.674556 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 39b41ff066cb499fae9b71ca1f2f9d2b (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.674669 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 042ea15848cf41949499f9878683bb83 (DEFAULT_TABLE table=default.Table_2eff9b2709c74720a25fd27e8c92073d [id=5d71af43dc0348a09233006746009e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.674816 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b41ff066cb499fae9b71ca1f2f9d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.674919 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042ea15848cf41949499f9878683bb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.677016 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 4dabfb8d01ef4177878d8748b536b1cc (DEFAULT_TABLE table=default.Table_ba3f2489c8d84b9ab06776e6446dd316 [id=a9c85b3f4d4e48b493e90aceba14c58a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.677254 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dabfb8d01ef4177878d8748b536b1cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.677260 11760 tablet_service.cc:1468] Processing CreateTablet for tablet bf421457ab6c481f9fd6e18a9572ba5f (DEFAULT_TABLE table=default.Table_d1aa2dda09c84623a4377b2c4c4175a2 [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.677501 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf421457ab6c481f9fd6e18a9572ba5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.679277 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 5f17cae1b6ef461591552e8416e3f5a2 (DEFAULT_TABLE table=default.Table_3731eff88c3045d198a9ac0688354e28 [id=d6493609a8344ac4a399b6b7468f0245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.679478 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f17cae1b6ef461591552e8416e3f5a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.679949 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 39b41ff066cb499fae9b71ca1f2f9d2b (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.680065 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 5f17cae1b6ef461591552e8416e3f5a2 (DEFAULT_TABLE table=default.Table_3731eff88c3045d198a9ac0688354e28 [id=d6493609a8344ac4a399b6b7468f0245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.680068 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e9c835f1c3dc47c09fcd413793c7b468 (table default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6 [id=b434548c0974419586018378be509878]) successfully deleted
I20250625 14:01:59.680204 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b41ff066cb499fae9b71ca1f2f9d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.680311 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f17cae1b6ef461591552e8416e3f5a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.681425 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 042ea15848cf41949499f9878683bb83 (DEFAULT_TABLE table=default.Table_2eff9b2709c74720a25fd27e8c92073d [id=5d71af43dc0348a09233006746009e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.681648 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042ea15848cf41949499f9878683bb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.682528 11893 tablet_service.cc:1468] Processing CreateTablet for tablet bf421457ab6c481f9fd6e18a9572ba5f (DEFAULT_TABLE table=default.Table_d1aa2dda09c84623a4377b2c4c4175a2 [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.682509 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 4dabfb8d01ef4177878d8748b536b1cc (DEFAULT_TABLE table=default.Table_ba3f2489c8d84b9ab06776e6446dd316 [id=a9c85b3f4d4e48b493e90aceba14c58a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.682821 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dabfb8d01ef4177878d8748b536b1cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.683889 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 5f17cae1b6ef461591552e8416e3f5a2 (DEFAULT_TABLE table=default.Table_3731eff88c3045d198a9ac0688354e28 [id=d6493609a8344ac4a399b6b7468f0245]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.684346 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f17cae1b6ef461591552e8416e3f5a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.684728 12175 ts_tablet_manager.cc:1905] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.684988 12173 ts_tablet_manager.cc:1918] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.685060 12173 log.cc:1199] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/94232e8e88e84350b5f150a6eb433c92
I20250625 14:01:59.685272 12173 ts_tablet_manager.cc:1939] T 94232e8e88e84350b5f150a6eb433c92 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.685302 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf421457ab6c481f9fd6e18a9572ba5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.686554 11751 tablet_service.cc:1468] Processing CreateTablet for tablet e954a5aebfb04818ae12bd2f5c29920f (DEFAULT_TABLE table=default.Table_e92174a368614f6184e7a1870cc3d71c [id=e9adc9ab7f3e4323946ac059c22b4fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.686802 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e954a5aebfb04818ae12bd2f5c29920f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.687094 12175 ts_tablet_manager.cc:1918] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.687173 12175 log.cc:1199] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c2307a7c00204e8fa1a14b5112659d91
I20250625 14:01:59.687405 12175 ts_tablet_manager.cc:1939] T c2307a7c00204e8fa1a14b5112659d91 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.689080 11893 tablet_service.cc:1468] Processing CreateTablet for tablet e954a5aebfb04818ae12bd2f5c29920f (DEFAULT_TABLE table=default.Table_e92174a368614f6184e7a1870cc3d71c [id=e9adc9ab7f3e4323946ac059c22b4fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.689196 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 042ea15848cf41949499f9878683bb83 (DEFAULT_TABLE table=default.Table_2eff9b2709c74720a25fd27e8c92073d [id=5d71af43dc0348a09233006746009e49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.689348 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e954a5aebfb04818ae12bd2f5c29920f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.690860 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 94232e8e88e84350b5f150a6eb433c92 (table default.Table_fc6abd07a4dc4176a7a9c81d3fb81fa4 [id=9bd1814bba0a43fa8a66a50e91ef165f]) successfully deleted
I20250625 14:01:59.691112 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 39b41ff066cb499fae9b71ca1f2f9d2b (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.691386 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39b41ff066cb499fae9b71ca1f2f9d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.692740 12173 tablet_replica.cc:331] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.692888 12173 raft_consensus.cc:2241] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.692999 12173 raft_consensus.cc:2270] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.694202 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 4dabfb8d01ef4177878d8748b536b1cc (DEFAULT_TABLE table=default.Table_ba3f2489c8d84b9ab06776e6446dd316 [id=a9c85b3f4d4e48b493e90aceba14c58a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.694473 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dabfb8d01ef4177878d8748b536b1cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.694514 12172 tablet_bootstrap.cc:492] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.694584 12172 ts_tablet_manager.cc:1397] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.002s
I20250625 14:01:59.695137 12173 ts_tablet_manager.cc:1905] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.695109 12172 raft_consensus.cc:357] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.695216 12172 raft_consensus.cc:383] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.695246 12172 raft_consensus.cc:738] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.695412 12172 consensus_queue.cc:260] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.695585 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4fd2ee633d464f7c8be1f06da7be0c70
I20250625 14:01:59.695749 12172 ts_tablet_manager.cc:1428] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.695873 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 4fd2ee633d464f7c8be1f06da7be0c70 deleted and replaced by tablet dfd6a8bf9e624b169377e7f9b8ccc761
I20250625 14:01:59.695938 12172 tablet_bootstrap.cc:492] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.696590 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042ea15848cf41949499f9878683bb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.697038 12172 tablet_bootstrap.cc:654] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.699280 12021 tablet_service.cc:1468] Processing CreateTablet for tablet e954a5aebfb04818ae12bd2f5c29920f (DEFAULT_TABLE table=default.Table_e92174a368614f6184e7a1870cc3d71c [id=e9adc9ab7f3e4323946ac059c22b4fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.699554 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e954a5aebfb04818ae12bd2f5c29920f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.700019 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_be4403815e95486da90977105215b6a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.700456 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be4403815e95486da90977105215b6a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.701321 13121 raft_consensus.cc:491] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.701409 13121 raft_consensus.cc:513] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.701826 13121 leader_election.cc:290] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.702198 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31157f3bd20f4db5a0baa05b61d92f87" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.702396 11921 raft_consensus.cc:2466] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:59.702623 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31157f3bd20f4db5a0baa05b61d92f87" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:59.702754 11780 raft_consensus.cc:2466] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:59.703078 11990 leader_election.cc:304] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.703254 13121 raft_consensus.cc:2802] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.703300 12027 tablet_service.cc:1468] Processing CreateTablet for tablet bf421457ab6c481f9fd6e18a9572ba5f (DEFAULT_TABLE table=default.Table_d1aa2dda09c84623a4377b2c4c4175a2 [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.703302 13121 raft_consensus.cc:491] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.703426 13121 raft_consensus.cc:3058] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.703574 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf421457ab6c481f9fd6e18a9572ba5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.703627 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a70afbc1a02a457c9099532e16eaac48
I20250625 14:01:59.704461 13121 raft_consensus.cc:513] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.704852 13121 leader_election.cc:290] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.705296 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31157f3bd20f4db5a0baa05b61d92f87" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:59.705416 11921 raft_consensus.cc:3058] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.705659 11529 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_5f4cfca1a111436d9a80d3b64d0cfe0f [id=29fdfe34ed7648feb4f21f471fd5e154] alter complete (version 1)
I20250625 14:01:59.706182 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 4fd2ee633d464f7c8be1f06da7be0c70 with delete_type TABLET_DATA_DELETED (replaced by tablet dfd6a8bf9e624b169377e7f9b8ccc761) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.706373 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet a70afbc1a02a457c9099532e16eaac48 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.706555 11921 raft_consensus.cc:2466] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:59.706676 12175 tablet_replica.cc:331] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.706736 12177 tablet_replica.cc:331] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.706831 12175 raft_consensus.cc:2241] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.706853 12177 raft_consensus.cc:2241] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.706946 12177 raft_consensus.cc:2270] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.706974 12175 raft_consensus.cc:2270] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.707731 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31157f3bd20f4db5a0baa05b61d92f87" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:59.707846 11780 raft_consensus.cc:3058] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:59.708220 11858 consensus_peers.cc:487] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e62aba799c354c178db2d8c31ce7e969. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:01:59.708374 12177 ts_tablet_manager.cc:1905] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.708905 11780 raft_consensus.cc:2466] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:59.709216 11993 leader_election.cc:304] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:01:59.709419 13121 raft_consensus.cc:2802] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:59.709502 13121 raft_consensus.cc:695] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:59.709640 13121 consensus_queue.cc:237] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.710526 13232 raft_consensus.cc:491] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.710641 12175 ts_tablet_manager.cc:1905] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.710629 13232 raft_consensus.cc:513] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.711007 13232 leader_election.cc:290] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.711915 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34806da4b2ec4c2db13322952bf943c5" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.713589 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34806da4b2ec4c2db13322952bf943c5" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:59.713732 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 1dc5b8ea4f3b47f19c603c235fa79007 (table default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]) successfully deleted
I20250625 14:01:59.713771 12172 tablet_bootstrap.cc:492] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.713863 12172 ts_tablet_manager.cc:1397] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250625 14:01:59.714071 11993 leader_election.cc:304] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:01:59.714342 13121 raft_consensus.cc:2747] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:01:59.714444 12172 raft_consensus.cc:357] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.714566 12172 raft_consensus.cc:383] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.714609 12172 raft_consensus.cc:738] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.714753 12172 consensus_queue.cc:260] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.715111 12172 ts_tablet_manager.cc:1428] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.715545 12172 tablet_bootstrap.cc:492] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.715780 12173 ts_tablet_manager.cc:1918] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.715854 12173 log.cc:1199] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e9c835f1c3dc47c09fcd413793c7b468
I20250625 14:01:59.716115 12173 ts_tablet_manager.cc:1939] T e9c835f1c3dc47c09fcd413793c7b468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.717557 12177 ts_tablet_manager.cc:1918] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.717638 12177 log.cc:1199] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/da5ed5d8d3ca4342980c893a8653d4a0
I20250625 14:01:59.717855 12177 ts_tablet_manager.cc:1939] T da5ed5d8d3ca4342980c893a8653d4a0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.718891 12172 tablet_bootstrap.cc:654] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.721402 12208 raft_consensus.cc:491] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.721540 12208 raft_consensus.cc:513] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.721999 12208 leader_election.cc:290] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.722554 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "237ca3218ae84a0b8354f328b91dfab4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.722715 11921 raft_consensus.cc:2466] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:59.722707 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "237ca3218ae84a0b8354f328b91dfab4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.723080 11717 leader_election.cc:304] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.723611 12208 raft_consensus.cc:2802] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.723677 12208 raft_consensus.cc:491] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.723727 12208 raft_consensus.cc:3058] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:01:59.723799 11717 leader_election.cc:343] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.723971 12173 tablet_replica.cc:331] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.724058 12172 tablet_bootstrap.cc:492] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.724184 12172 ts_tablet_manager.cc:1397] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:01:59.724360 12173 raft_consensus.cc:2241] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.724725 12172 raft_consensus.cc:357] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.724777 12208 raft_consensus.cc:513] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.724846 12172 raft_consensus.cc:383] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.724887 12172 raft_consensus.cc:738] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.724869 12175 ts_tablet_manager.cc:1918] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:59.724956 12175 log.cc:1199] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e3af8a01ca1f49afb8aa1834807abf7e
I20250625 14:01:59.725142 12172 consensus_queue.cc:260] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.725430 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "237ca3218ae84a0b8354f328b91dfab4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:59.725517 12172 ts_tablet_manager.cc:1428] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:59.725541 11921 raft_consensus.cc:3058] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.725147 12208 leader_election.cc:290] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.726173 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet da5ed5d8d3ca4342980c893a8653d4a0 (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]) successfully deleted
I20250625 14:01:59.726258 12172 tablet_bootstrap.cc:492] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:01:59.726603 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4fd2ee633d464f7c8be1f06da7be0c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fd2ee633d464f7c8be1f06da7be0c70 already in progress: creating tablet
I20250625 14:01:59.727097 11921 raft_consensus.cc:2466] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:59.725499 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "237ca3218ae84a0b8354f328b91dfab4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:59.727391 11717 leader_election.cc:304] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.727596 12173 raft_consensus.cc:2270] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.727639 12172 tablet_bootstrap.cc:654] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:01:59.727713 11717 leader_election.cc:343] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.727833 12208 raft_consensus.cc:2802] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:59.727950 12208 raft_consensus.cc:695] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:59.728083 12208 consensus_queue.cc:237] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.728668 12175 ts_tablet_manager.cc:1939] T e3af8a01ca1f49afb8aa1834807abf7e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.728974 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 1df220bf9c8447c5ac4ad35a145a8796 from {username='slave'} at 127.0.0.1:57414
W20250625 14:01:59.729005 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a70afbc1a02a457c9099532e16eaac48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a70afbc1a02a457c9099532e16eaac48 already in progress: creating tablet
I20250625 14:01:59.729332 12173 ts_tablet_manager.cc:1905] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.733336 12173 ts_tablet_manager.cc:1918] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:01:59.733947 12175 tablet_replica.cc:331] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.734136 12173 log.cc:1199] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e3af8a01ca1f49afb8aa1834807abf7e
I20250625 14:01:59.734450 12173 ts_tablet_manager.cc:1939] T e3af8a01ca1f49afb8aa1834807abf7e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.734172 12175 raft_consensus.cc:2241] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:01:59.735139 11517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.39.188:43359, user_credentials={real_user=slave}} blocked reactor thread for 43893.9us
I20250625 14:01:59.735294 12173 tablet_replica.cc:331] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.735424 12173 raft_consensus.cc:2241] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.735534 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 4fd2ee633d464f7c8be1f06da7be0c70 with delete_type TABLET_DATA_DELETED (replaced by tablet dfd6a8bf9e624b169377e7f9b8ccc761) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.735554 12173 raft_consensus.cc:2270] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.736760 12167 tablet_bootstrap.cc:492] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.736855 12167 ts_tablet_manager.cc:1397] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.000s
I20250625 14:01:59.736975 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet a70afbc1a02a457c9099532e16eaac48 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.737358 12167 raft_consensus.cc:357] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.737468 12167 raft_consensus.cc:383] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.737501 12167 raft_consensus.cc:738] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.737627 12167 consensus_queue.cc:260] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.737875 12167 ts_tablet_manager.cc:1428] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:59.738062 12167 tablet_bootstrap.cc:492] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.739104 12167 tablet_bootstrap.cc:654] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.740628 12173 ts_tablet_manager.cc:1905] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.734784 12175 raft_consensus.cc:2270] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.735769 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 4fd2ee633d464f7c8be1f06da7be0c70 with delete_type TABLET_DATA_DELETED (replaced by tablet dfd6a8bf9e624b169377e7f9b8ccc761) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.741258 12175 ts_tablet_manager.cc:1905] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.743184 12173 ts_tablet_manager.cc:1918] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.743264 12173 log.cc:1199] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e62aba799c354c178db2d8c31ce7e969
I20250625 14:01:59.743526 12173 ts_tablet_manager.cc:1939] T e62aba799c354c178db2d8c31ce7e969 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.744290 12167 tablet_bootstrap.cc:492] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.744379 12167 ts_tablet_manager.cc:1397] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:59.745050 12167 raft_consensus.cc:357] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.745162 12167 raft_consensus.cc:383] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.745196 12167 raft_consensus.cc:738] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.745319 12167 consensus_queue.cc:260] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.745398 12175 ts_tablet_manager.cc:1918] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:01:59.745463 12175 log.cc:1199] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e62aba799c354c178db2d8c31ce7e969
I20250625 14:01:59.745579 12167 ts_tablet_manager.cc:1428] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.745694 12175 ts_tablet_manager.cc:1939] T e62aba799c354c178db2d8c31ce7e969 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.745930 12167 tablet_bootstrap.cc:492] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.747013 12167 tablet_bootstrap.cc:654] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.750741 12172 tablet_bootstrap.cc:492] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.750831 12172 ts_tablet_manager.cc:1397] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20250625 14:01:59.751327 12172 raft_consensus.cc:357] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.751436 12172 raft_consensus.cc:383] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.751469 12172 raft_consensus.cc:738] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.751585 12172 consensus_queue.cc:260] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.751852 12172 ts_tablet_manager.cc:1428] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.752303 12172 tablet_bootstrap.cc:492] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.754712 12172 tablet_bootstrap.cc:654] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.754945 13244 tablet.cc:1722] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:01:59.757107 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 8d99e27063554845bea98bbe70eba3b9 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.758042 12167 tablet_bootstrap.cc:492] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.758164 12167 ts_tablet_manager.cc:1397] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:01:59.758714 12167 raft_consensus.cc:357] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.758831 12167 raft_consensus.cc:383] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.758869 12167 raft_consensus.cc:738] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.758688 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dfb0fb317e8d4ca799c64b29140de875" } new_table_name: "default.Table_be63dac05c624f438a43ab9a8f12cfe3" modify_external_catalogs: true
I20250625 14:01:59.758998 12167 consensus_queue.cc:260] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.759315 12167 ts_tablet_manager.cc:1428] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.759510 12167 tablet_bootstrap.cc:492] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.760244 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_84c115ad81fd4a09a7d228f765b67688" } modify_external_catalogs: true
I20250625 14:01:59.760425 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_84c115ad81fd4a09a7d228f765b67688" } modify_external_catalogs: true
I20250625 14:01:59.760586 12167 tablet_bootstrap.cc:654] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.763341 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 594d394be3f54a3bb2b7d4705e1877d5 (DEFAULT_TABLE table=default.Table_4b1e6053c18e494c91d6de1708f61215 [id=996afd779ef84dfbab367a3796ddcafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.763679 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594d394be3f54a3bb2b7d4705e1877d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.764959 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a753b44395994a4abaaa96fb9b6d594a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a753b44395994a4abaaa96fb9b6d594a already in progress: creating tablet
I20250625 14:01:59.765201 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e9c835f1c3dc47c09fcd413793c7b468 (table default.Table_7cc35e3c0e1d43f1b7bff762ac3062e6 [id=b434548c0974419586018378be509878]) successfully deleted
I20250625 14:01:59.765877 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet f5e271b27ac349d6bb8cf47aa8b9668a (table default.Table_5f4cfca1a111436d9a80d3b64d0cfe0f [id=29fdfe34ed7648feb4f21f471fd5e154]). Expected version 1 got 0
I20250625 14:01:59.765949 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8d99e27063554845bea98bbe70eba3b9
I20250625 14:01:59.766362 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 8d99e27063554845bea98bbe70eba3b9 deleted and replaced by tablet 2e4822e4ed7a405e8940abf314052185
I20250625 14:01:59.766978 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf (DEFAULT_TABLE table=default.Table_216035509d754cd4ac22e6f099da4b0b [id=ff64d87ddb0f481f90df5ef1a1f24e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.767058 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d99e27063554845bea98bbe70eba3b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e4822e4ed7a405e8940abf314052185) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.767256 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.768537 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8d99e27063554845bea98bbe70eba3b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d99e27063554845bea98bbe70eba3b9 already in progress: creating tablet
I20250625 14:01:59.749858 12166 tablet_bootstrap.cc:492] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.769227 12166 ts_tablet_manager.cc:1397] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.211s user 0.001s sys 0.003s
I20250625 14:01:59.750015 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet a70afbc1a02a457c9099532e16eaac48 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.769872 12166 raft_consensus.cc:357] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.769992 12166 raft_consensus.cc:383] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.770026 12166 raft_consensus.cc:738] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.765304 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
I20250625 14:01:59.770151 12166 consensus_queue.cc:260] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.771108 11752 tablet_service.cc:1468] Processing CreateTablet for tablet ce798228ec534d409bbc1896a6dd123d (DEFAULT_TABLE table=default.Table_af26ccf8ce5a45cfb5b289f079649798 [id=f912c3d7418f445dbc0c0016341701af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.771605 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce798228ec534d409bbc1896a6dd123d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.771864 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]) successfully deleted
W20250625 14:01:59.772058 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b1f5b1d02509410ca26e5861d274e098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f5b1d02509410ca26e5861d274e098 already in progress: creating tablet
W20250625 14:01:59.772181 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet be4378f7781541d7866e6d5c440b13e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be4378f7781541d7866e6d5c440b13e6 already in progress: creating tablet
W20250625 14:01:59.772293 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4fd2ee633d464f7c8be1f06da7be0c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fd2ee633d464f7c8be1f06da7be0c70 already in progress: creating tablet
W20250625 14:01:59.773636 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a70afbc1a02a457c9099532e16eaac48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a70afbc1a02a457c9099532e16eaac48 already in progress: creating tablet
I20250625 14:01:59.773799 11525 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:01:59.773903 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c2307a7c00204e8fa1a14b5112659d91 (table default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]) successfully deleted
I20250625 14:01:59.774016 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e3af8a01ca1f49afb8aa1834807abf7e (table default.Table_8354c456c6bc43a6a7f1925797c6e199 [id=f8968164e2534f03a9b0562f6c565697]) successfully deleted
W20250625 14:01:59.774114 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet be4378f7781541d7866e6d5c440b13e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be4378f7781541d7866e6d5c440b13e6 already in progress: creating tablet
W20250625 14:01:59.774212 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b1f5b1d02509410ca26e5861d274e098 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1f5b1d02509410ca26e5861d274e098 already in progress: creating tablet
I20250625 14:01:59.774830 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 594d394be3f54a3bb2b7d4705e1877d5 (DEFAULT_TABLE table=default.Table_4b1e6053c18e494c91d6de1708f61215 [id=996afd779ef84dfbab367a3796ddcafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.775125 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594d394be3f54a3bb2b7d4705e1877d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.775413 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf (DEFAULT_TABLE table=default.Table_216035509d754cd4ac22e6f099da4b0b [id=ff64d87ddb0f481f90df5ef1a1f24e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.775660 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.777451 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d99e27063554845bea98bbe70eba3b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e4822e4ed7a405e8940abf314052185) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.777760 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 594d394be3f54a3bb2b7d4705e1877d5 (DEFAULT_TABLE table=default.Table_4b1e6053c18e494c91d6de1708f61215 [id=996afd779ef84dfbab367a3796ddcafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.777822 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d99e27063554845bea98bbe70eba3b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e4822e4ed7a405e8940abf314052185) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.777987 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594d394be3f54a3bb2b7d4705e1877d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.780978 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7491e070e86346b681817fb19d4608f9
W20250625 14:01:59.781083 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdbebbb725564dc98c30ce4bbd3af8db consensus state has no leader
I20250625 14:01:59.781826 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf (DEFAULT_TABLE table=default.Table_216035509d754cd4ac22e6f099da4b0b [id=ff64d87ddb0f481f90df5ef1a1f24e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.782100 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.783007 11528 catalog_manager.cc:5582] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:01:59.783119 12166 ts_tablet_manager.cc:1428] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20250625 14:01:59.783274 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:01:59.783413 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 7491e070e86346b681817fb19d4608f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.784756 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 7491e070e86346b681817fb19d4608f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.785555 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 7491e070e86346b681817fb19d4608f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:01:59.786722 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7491e070e86346b681817fb19d4608f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7491e070e86346b681817fb19d4608f9 already in progress: creating tablet
W20250625 14:01:59.789112 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8d99e27063554845bea98bbe70eba3b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d99e27063554845bea98bbe70eba3b9 already in progress: creating tablet
W20250625 14:01:59.789299 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7491e070e86346b681817fb19d4608f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7491e070e86346b681817fb19d4608f9 already in progress: creating tablet
I20250625 14:01:59.790182 12167 tablet_bootstrap.cc:492] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.790277 12167 ts_tablet_manager.cc:1397] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:01:59.790731 12167 raft_consensus.cc:357] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.790831 12167 raft_consensus.cc:383] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.790867 12167 raft_consensus.cc:738] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.791020 12167 consensus_queue.cc:260] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.791467 12166 tablet_bootstrap.cc:492] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.792183 12167 ts_tablet_manager.cc:1428] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:59.792377 12167 tablet_bootstrap.cc:492] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.793267 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3070f1e3d3144cd5b14c7c3542aa8b98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.793902 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3070f1e3d3144cd5b14c7c3542aa8b98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.794492 12167 tablet_bootstrap.cc:654] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.794965 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_29b4142505484a25bd89b94f958d6c09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.795318 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29b4142505484a25bd89b94f958d6c09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.798462 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_30c713341cf040479971f7d4d4bacde0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.798830 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30c713341cf040479971f7d4d4bacde0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.798910 12166 tablet_bootstrap.cc:654] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.799549 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_29210cfb24ec49caadf051016702660e" } modify_external_catalogs: true
I20250625 14:01:59.799644 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_29210cfb24ec49caadf051016702660e" } modify_external_catalogs: true
I20250625 14:01:59.798462 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:01:59.801613 11525 catalog_manager.cc:5582] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:01:59.802202 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 31157f3bd20f4db5a0baa05b61d92f87 (table default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7]). Expected version 1 got 0
I20250625 14:01:59.802362 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]). Expected version 1 got 0
I20250625 14:01:59.802326 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 70aadb0035014e32bfba240e4d6d0951 (DEFAULT_TABLE table=default.Table_f4efe8dfe3af443fbd60cac1679baa02 [id=8e5d69b5257643029cce08f70a4e6b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.802598 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70aadb0035014e32bfba240e4d6d0951. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.803193 12021 tablet_service.cc:1468] Processing CreateTablet for tablet ce798228ec534d409bbc1896a6dd123d (DEFAULT_TABLE table=default.Table_af26ccf8ce5a45cfb5b289f079649798 [id=f912c3d7418f445dbc0c0016341701af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.803541 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e62aba799c354c178db2d8c31ce7e969 (table default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]) successfully deleted
I20250625 14:01:59.803831 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce798228ec534d409bbc1896a6dd123d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.803898 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 1721c814394940f094f12911b6e9c1de (DEFAULT_TABLE table=default.Table_ecf43538fe7449d3b6b1cb9e34781b9e [id=e016ef93585b4be3932bde715a8204e6]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:01:59.804054 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 4fd2ee633d464f7c8be1f06da7be0c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fd2ee633d464f7c8be1f06da7be0c70 already in progress: creating tablet
I20250625 14:01:59.804152 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1721c814394940f094f12911b6e9c1de. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.804188 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a70afbc1a02a457c9099532e16eaac48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a70afbc1a02a457c9099532e16eaac48 already in progress: creating tablet
W20250625 14:01:59.804277 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8d99e27063554845bea98bbe70eba3b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d99e27063554845bea98bbe70eba3b9 already in progress: creating tablet
W20250625 14:01:59.804350 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7491e070e86346b681817fb19d4608f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7491e070e86346b681817fb19d4608f9 already in progress: creating tablet
I20250625 14:01:59.805052 12167 tablet_bootstrap.cc:492] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.805135 12167 ts_tablet_manager.cc:1397] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20250625 14:01:59.805258 11892 tablet_service.cc:1468] Processing CreateTablet for tablet ce798228ec534d409bbc1896a6dd123d (DEFAULT_TABLE table=default.Table_af26ccf8ce5a45cfb5b289f079649798 [id=f912c3d7418f445dbc0c0016341701af]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.805461 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce798228ec534d409bbc1896a6dd123d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.805759 12167 raft_consensus.cc:357] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.805855 12167 raft_consensus.cc:383] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.805989 12167 raft_consensus.cc:738] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.806129 12167 consensus_queue.cc:260] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.806777 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 1721c814394940f094f12911b6e9c1de (DEFAULT_TABLE table=default.Table_ecf43538fe7449d3b6b1cb9e34781b9e [id=e016ef93585b4be3932bde715a8204e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.806998 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1721c814394940f094f12911b6e9c1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.807456 12167 ts_tablet_manager.cc:1428] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:01:59.807643 12167 tablet_bootstrap.cc:492] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.808061 12172 tablet_bootstrap.cc:492] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.808152 12172 ts_tablet_manager.cc:1397] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.000s
I20250625 14:01:59.808615 12172 raft_consensus.cc:357] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.808710 12167 tablet_bootstrap.cc:654] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.808715 12172 raft_consensus.cc:383] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.808756 12172 raft_consensus.cc:738] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.808888 12172 consensus_queue.cc:260] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.809191 12172 ts_tablet_manager.cc:1428] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:59.807652 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 1721c814394940f094f12911b6e9c1de (DEFAULT_TABLE table=default.Table_ecf43538fe7449d3b6b1cb9e34781b9e [id=e016ef93585b4be3932bde715a8204e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.809648 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1721c814394940f094f12911b6e9c1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.811861 12172 tablet_bootstrap.cc:492] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.812810 12172 tablet_bootstrap.cc:654] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.813387 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 with delete_type TABLET_DATA_DELETED (replaced by tablet a05b09a3225f45db841978b7b9b1fe51) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.813539 12177 tablet_replica.cc:331] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.813655 12177 raft_consensus.cc:2241] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.813742 12177 raft_consensus.cc:2270] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.814278 12177 ts_tablet_manager.cc:1905] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.815203 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.816473 12177 ts_tablet_manager.cc:1918] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.816547 12177 log.cc:1199] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/cc9e2afd5bc443398293d0ed572f6c05
I20250625 14:01:59.816741 12177 ts_tablet_manager.cc:1939] T cc9e2afd5bc443398293d0ed572f6c05 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.817821 12177 tablet_replica.cc:331] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.817948 12177 raft_consensus.cc:2241] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.818030 12177 raft_consensus.cc:2270] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.818624 12177 ts_tablet_manager.cc:1905] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.822515 12177 ts_tablet_manager.cc:1918] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.822655 12177 log.cc:1199] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/11bd0fc7e8ef430ea2cef302f67b8b22
I20250625 14:01:59.822693 13121 raft_consensus.cc:491] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.822798 13121 raft_consensus.cc:513] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.822968 12177 ts_tablet_manager.cc:1939] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.823200 13121 leader_election.cc:290] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:59.823663 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1c05e534c804eb69e0c249a03418941" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.825631 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet cc9e2afd5bc443398293d0ed572f6c05 (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:01:59.825783 12172 tablet_bootstrap.cc:492] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.825868 12172 ts_tablet_manager.cc:1397] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250625 14:01:59.826423 12172 raft_consensus.cc:357] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.826524 12172 raft_consensus.cc:383] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.826553 12172 raft_consensus.cc:738] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.826658 12172 consensus_queue.cc:260] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.826910 12172 ts_tablet_manager.cc:1428] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:01:59.826954 11990 leader_election.cc:343] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.827103 12172 tablet_bootstrap.cc:492] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.827888 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1c05e534c804eb69e0c249a03418941" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:59.828002 11780 raft_consensus.cc:2466] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:59.828143 12172 tablet_bootstrap.cc:654] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.828733 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5f4cfca1a111436d9a80d3b64d0cfe0f" } new_table_name: "default.Table_08f44e189955459ab1825ed53a44b427" modify_external_catalogs: true
I20250625 14:01:59.829423 12166 tablet_bootstrap.cc:492] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.829515 12166 ts_tablet_manager.cc:1397] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.002s
I20250625 14:01:59.829691 11993 leader_election.cc:304] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:01:59.829924 13121 raft_consensus.cc:2802] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.829977 13121 raft_consensus.cc:491] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.830014 13121 raft_consensus.cc:3058] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.829953 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5e70bbb4cf7547faa9581674e5c46cc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.830035 12166 raft_consensus.cc:357] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.830160 12166 raft_consensus.cc:383] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.830205 12166 raft_consensus.cc:738] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:59.830376 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e70bbb4cf7547faa9581674e5c46cc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.830380 12166 consensus_queue.cc:260] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.830706 12166 ts_tablet_manager.cc:1428] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.830900 12166 tablet_bootstrap.cc:492] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.831139 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3a571013915f48b1846783c8681bcd48" } modify_external_catalogs: true
I20250625 14:01:59.831240 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3a571013915f48b1846783c8681bcd48" } modify_external_catalogs: true
I20250625 14:01:59.831885 12166 tablet_bootstrap.cc:654] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.831915 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 5227c93e932a4ed4b3d03990d7ed7b69 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.832579 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d1aa2dda09c84623a4377b2c4c4175a2" } new_table_name: "default.Table_d61d2d203bec435bb70dc93c563fd08f" modify_external_catalogs: true
I20250625 14:01:59.835016 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_87b14d45472a4fcd9d299d7071ec42fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.835083 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 11bd0fc7e8ef430ea2cef302f67b8b22 (table default.Table_32b413d2535247dabef6866ffa215cae [id=0719452dd3df4a8bb8668b9b63c62cc9]) successfully deleted
I20250625 14:01:59.835167 13121 raft_consensus.cc:513] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:01:59.835378 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87b14d45472a4fcd9d299d7071ec42fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.835588 13121 leader_election.cc:290] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:01:59.836027 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1c05e534c804eb69e0c249a03418941" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:01:59.836648 11990 leader_election.cc:343] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.837116 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 with delete_type TABLET_DATA_DELETED (replaced by tablet a05b09a3225f45db841978b7b9b1fe51) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.840376 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 32e39d974af9439c873ba8ec6523c428
I20250625 14:01:59.840850 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_847e7405f014463eb6b720987a1447a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.841269 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_847e7405f014463eb6b720987a1447a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.841379 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1c05e534c804eb69e0c249a03418941" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:59.841531 11780 raft_consensus.cc:3058] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.842667 11780 raft_consensus.cc:2466] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:59.843391 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 32e39d974af9439c873ba8ec6523c428 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.844903 11993 leader_election.cc:304] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:01:59.845175 13121 raft_consensus.cc:2802] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:59.845253 13121 raft_consensus.cc:695] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:59.845378 13121 consensus_queue.cc:237] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.849139 12172 tablet_bootstrap.cc:492] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.849248 12172 ts_tablet_manager.cc:1397] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:01:59.849407 12175 tablet_replica.cc:331] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:01:59.849558 12175 raft_consensus.cc:2241] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.849655 12175 raft_consensus.cc:2270] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.849762 12172 raft_consensus.cc:357] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.849886 12172 raft_consensus.cc:383] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.849927 12172 raft_consensus.cc:738] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.850059 12172 consensus_queue.cc:260] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.850369 12172 ts_tablet_manager.cc:1428] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:01:59.850533 12172 tablet_bootstrap.cc:492] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.851089 12175 ts_tablet_manager.cc:1905] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.851580 12172 tablet_bootstrap.cc:654] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.851737 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_06824299bef54c86acdac5b99cc218d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.851888 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]). Expected version 1 got 0
W20250625 14:01:59.852200 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06824299bef54c86acdac5b99cc218d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.852360 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_91d863c5798a413a87bfb07793e23653" } modify_external_catalogs: true
I20250625 14:01:59.852450 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_91d863c5798a413a87bfb07793e23653" } modify_external_catalogs: true
I20250625 14:01:59.853802 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 70aadb0035014e32bfba240e4d6d0951 (DEFAULT_TABLE table=default.Table_f4efe8dfe3af443fbd60cac1679baa02 [id=8e5d69b5257643029cce08f70a4e6b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.854097 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70aadb0035014e32bfba240e4d6d0951. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.856539 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 70aadb0035014e32bfba240e4d6d0951 (DEFAULT_TABLE table=default.Table_f4efe8dfe3af443fbd60cac1679baa02 [id=8e5d69b5257643029cce08f70a4e6b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.856608 12172 tablet_bootstrap.cc:492] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.856693 12172 ts_tablet_manager.cc:1397] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:01:59.856850 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70aadb0035014e32bfba240e4d6d0951. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.857266 12172 raft_consensus.cc:357] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.857299 11902 tablet_service.cc:1468] Processing CreateTablet for tablet df4b51d1f71b4711a57c9aaf43758d66 (DEFAULT_TABLE table=default.Table_072df55a5df0479fb592845c15dff01c [id=43be803dc3874b5b9da09b47ff482cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.857376 12172 raft_consensus.cc:383] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.857412 12172 raft_consensus.cc:738] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.857522 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4b51d1f71b4711a57c9aaf43758d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.857539 12172 consensus_queue.cc:260] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.857867 12172 ts_tablet_manager.cc:1428] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.858062 12172 tablet_bootstrap.cc:492] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.858148 11752 tablet_service.cc:1468] Processing CreateTablet for tablet be019f453cab42fa88936c587ca623fa (DEFAULT_TABLE table=default.Table_30d2b65a1ea44e8095e36aea0cc2de45 [id=c61635c28d9a4935b83100f151d3c4c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.858386 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be019f453cab42fa88936c587ca623fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.858569 11893 tablet_service.cc:1468] Processing CreateTablet for tablet be019f453cab42fa88936c587ca623fa (DEFAULT_TABLE table=default.Table_30d2b65a1ea44e8095e36aea0cc2de45 [id=c61635c28d9a4935b83100f151d3c4c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.858810 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be019f453cab42fa88936c587ca623fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.859040 12172 tablet_bootstrap.cc:654] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.859432 12166 tablet_bootstrap.cc:492] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.859510 12166 ts_tablet_manager.cc:1397] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.001s
I20250625 14:01:59.860033 12166 raft_consensus.cc:357] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.860153 12166 raft_consensus.cc:383] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.860186 12166 raft_consensus.cc:738] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.860306 12166 consensus_queue.cc:260] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.860576 12166 ts_tablet_manager.cc:1428] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.860801 12166 tablet_bootstrap.cc:492] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.861757 12166 tablet_bootstrap.cc:654] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.862557 12036 tablet_service.cc:1468] Processing CreateTablet for tablet df4b51d1f71b4711a57c9aaf43758d66 (DEFAULT_TABLE table=default.Table_072df55a5df0479fb592845c15dff01c [id=43be803dc3874b5b9da09b47ff482cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.862810 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4b51d1f71b4711a57c9aaf43758d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.865195 11753 tablet_service.cc:1468] Processing CreateTablet for tablet df4b51d1f71b4711a57c9aaf43758d66 (DEFAULT_TABLE table=default.Table_072df55a5df0479fb592845c15dff01c [id=43be803dc3874b5b9da09b47ff482cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.865444 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4b51d1f71b4711a57c9aaf43758d66. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:01:59.868033 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 32e39d974af9439c873ba8ec6523c428 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e39d974af9439c873ba8ec6523c428 already in progress: creating tablet
I20250625 14:01:59.868820 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 95ff3d7442f94bd998d3c683dcdd03b4 (DEFAULT_TABLE table=default.Table_c66ec2ace79b455dbc30a951673d2ddc [id=e977442b742045eabfd8d9714ead3ef2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.869081 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ff3d7442f94bd998d3c683dcdd03b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.868820 11764 tablet_service.cc:1468] Processing CreateTablet for tablet bcfd65365c914c8eada42500930f7185 (DEFAULT_TABLE table=default.Table_43fdda0af50e4d8b987902ac23c1a825 [id=a5521e782f7542e38bee6c60546f30d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.869824 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfd65365c914c8eada42500930f7185. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.871896 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 32e39d974af9439c873ba8ec6523c428 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.872442 12027 tablet_service.cc:1468] Processing CreateTablet for tablet be019f453cab42fa88936c587ca623fa (DEFAULT_TABLE table=default.Table_30d2b65a1ea44e8095e36aea0cc2de45 [id=c61635c28d9a4935b83100f151d3c4c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.872731 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be019f453cab42fa88936c587ca623fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.874203 11902 tablet_service.cc:1468] Processing CreateTablet for tablet bcfd65365c914c8eada42500930f7185 (DEFAULT_TABLE table=default.Table_43fdda0af50e4d8b987902ac23c1a825 [id=a5521e782f7542e38bee6c60546f30d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.874526 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfd65365c914c8eada42500930f7185. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.875442 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 47ed422d7a274075b5e44cd9a59e370f (DEFAULT_TABLE table=default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.875710 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ed422d7a274075b5e44cd9a59e370f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.877312 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 47ed422d7a274075b5e44cd9a59e370f (DEFAULT_TABLE table=default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.877504 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 47ed422d7a274075b5e44cd9a59e370f (DEFAULT_TABLE table=default.Table_c2a2490948a24ff68ac7093e9fc54954 [id=90c7ea61891b4b628602af4547ddb8a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.877555 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ed422d7a274075b5e44cd9a59e370f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.877745 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ed422d7a274075b5e44cd9a59e370f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.880798 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 95ff3d7442f94bd998d3c683dcdd03b4 (DEFAULT_TABLE table=default.Table_c66ec2ace79b455dbc30a951673d2ddc [id=e977442b742045eabfd8d9714ead3ef2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.881033 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ff3d7442f94bd998d3c683dcdd03b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.883522 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 95ff3d7442f94bd998d3c683dcdd03b4 (DEFAULT_TABLE table=default.Table_c66ec2ace79b455dbc30a951673d2ddc [id=e977442b742045eabfd8d9714ead3ef2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.883769 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ff3d7442f94bd998d3c683dcdd03b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.886101 12175 ts_tablet_manager.cc:1918] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.886183 12175 log.cc:1199] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/cc9e2afd5bc443398293d0ed572f6c05
I20250625 14:01:59.886399 12175 ts_tablet_manager.cc:1939] T cc9e2afd5bc443398293d0ed572f6c05 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:01:59.856539 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 32e39d974af9439c873ba8ec6523c428 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.887015 12027 tablet_service.cc:1468] Processing CreateTablet for tablet bcfd65365c914c8eada42500930f7185 (DEFAULT_TABLE table=default.Table_43fdda0af50e4d8b987902ac23c1a825 [id=a5521e782f7542e38bee6c60546f30d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:01:59.887179 12167 tablet_bootstrap.cc:492] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.887264 12167 ts_tablet_manager.cc:1397] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.000s
I20250625 14:01:59.887275 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfd65365c914c8eada42500930f7185. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:01:59.887744 12167 raft_consensus.cc:357] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.887854 12167 raft_consensus.cc:383] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.887918 12167 raft_consensus.cc:738] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.888039 12167 consensus_queue.cc:260] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.888356 12167 ts_tablet_manager.cc:1428] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.888341 12208 raft_consensus.cc:491] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.888433 12208 raft_consensus.cc:513] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.888553 12167 tablet_bootstrap.cc:492] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.888801 12208 leader_election.cc:290] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.889109 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9e69770668a04547a020086532fb0af9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:01:59.889382 11524 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]). Expected version 1 got 0
W20250625 14:01:59.889532 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e69770668a04547a020086532fb0af9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.890698 12172 tablet_bootstrap.cc:492] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.890779 12172 ts_tablet_manager.cc:1397] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20250625 14:01:59.891254 12172 raft_consensus.cc:357] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.891355 12172 raft_consensus.cc:383] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.891395 12172 raft_consensus.cc:738] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.891512 12172 consensus_queue.cc:260] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.891813 12172 ts_tablet_manager.cc:1428] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.892022 12172 tablet_bootstrap.cc:492] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.893018 12172 tablet_bootstrap.cc:654] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.893668 12166 tablet_bootstrap.cc:492] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.893745 12166 ts_tablet_manager.cc:1397] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.000s
I20250625 14:01:59.894165 12166 raft_consensus.cc:357] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.894268 12166 raft_consensus.cc:383] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.894299 12166 raft_consensus.cc:738] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.894449 12166 consensus_queue.cc:260] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.894694 12166 ts_tablet_manager.cc:1428] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.894851 12166 tablet_bootstrap.cc:492] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.890237 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_01aa57734c14479888e1455726901848"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.895573 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01aa57734c14479888e1455726901848 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.895771 12166 tablet_bootstrap.cc:654] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.896097 12167 tablet_bootstrap.cc:654] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.896683 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3e8c6789c3b14bc88c2538c34d72a3a4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.896802 11921 raft_consensus.cc:2466] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:59.897475 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3e8c6789c3b14bc88c2538c34d72a3a4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.898701 12166 tablet_bootstrap.cc:492] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.898789 12166 ts_tablet_manager.cc:1397] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:01:59.899240 12166 raft_consensus.cc:357] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.899330 12166 raft_consensus.cc:383] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.899358 12166 raft_consensus.cc:738] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.899461 12166 consensus_queue.cc:260] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.899700 12166 ts_tablet_manager.cc:1428] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.899853 12166 tablet_bootstrap.cc:492] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:01:59.901538 11717 leader_election.cc:343] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.903502 11717 leader_election.cc:304] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:59.903653 13137 raft_consensus.cc:2802] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.903690 13137 raft_consensus.cc:491] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.903723 13137 raft_consensus.cc:3058] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.904826 13137 raft_consensus.cc:513] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.905094 12208 raft_consensus.cc:491] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.905180 12208 raft_consensus.cc:513] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.905210 13137 leader_election.cc:290] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.905483 12208 leader_election.cc:290] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.905567 12172 tablet_bootstrap.cc:492] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.905653 12172 ts_tablet_manager.cc:1397] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20250625 14:01:59.905977 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3e8c6789c3b14bc88c2538c34d72a3a4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:59.906090 11921 raft_consensus.cc:3058] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.906169 12172 raft_consensus.cc:357] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.906255 12172 raft_consensus.cc:383] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.906293 12172 raft_consensus.cc:738] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.906438 12172 consensus_queue.cc:260] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.906697 12172 ts_tablet_manager.cc:1428] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.906888 12172 tablet_bootstrap.cc:492] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.907178 12166 tablet_bootstrap.cc:654] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.907199 11921 raft_consensus.cc:2466] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:59.907789 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3e8c6789c3b14bc88c2538c34d72a3a4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:59.907979 12172 tablet_bootstrap.cc:654] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.908828 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e98a2085fe67479db141b2675f69a2d9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.908936 11921 raft_consensus.cc:2466] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:59.910580 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e98a2085fe67479db141b2675f69a2d9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:01:59.910693 12042 raft_consensus.cc:2466] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:59.910985 13121 raft_consensus.cc:491] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.911062 13121 raft_consensus.cc:513] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.911273 12166 tablet_bootstrap.cc:492] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.911361 12166 ts_tablet_manager.cc:1397] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250625 14:01:59.911445 13121 leader_election.cc:290] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.911897 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3693e166c2c4af0b7a8f7994507de2c" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.911893 12166 raft_consensus.cc:357] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.912039 11921 raft_consensus.cc:2466] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:59.912057 12166 raft_consensus.cc:383] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.912115 12166 raft_consensus.cc:738] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:01:59.912155 11717 leader_election.cc:343] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.912223 12166 consensus_queue.cc:260] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.912285 11717 leader_election.cc:304] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:01:59.912328 11990 leader_election.cc:304] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.912438 11717 leader_election.cc:304] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:59.912478 13121 raft_consensus.cc:2802] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.912474 12208 raft_consensus.cc:2802] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.912525 13121 raft_consensus.cc:491] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.912532 12208 raft_consensus.cc:491] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.912566 13121 raft_consensus.cc:3058] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.912566 13137 raft_consensus.cc:2802] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:59.912642 13137 raft_consensus.cc:695] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:59.912750 12166 ts_tablet_manager.cc:1428] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.912773 13137 consensus_queue.cc:237] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.913054 12166 tablet_bootstrap.cc:492] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.912570 12208 raft_consensus.cc:3058] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.913631 13121 raft_consensus.cc:513] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.913959 13121 leader_election.cc:290] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:01:59.914429 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3693e166c2c4af0b7a8f7994507de2c" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:59.914530 11921 raft_consensus.cc:3058] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.914496 12208 raft_consensus.cc:513] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.914805 12208 leader_election.cc:290] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.915446 12166 tablet_bootstrap.cc:654] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.915518 11921 raft_consensus.cc:2466] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:59.915702 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e98a2085fe67479db141b2675f69a2d9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:01:59.915807 12042 raft_consensus.cc:3058] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.915894 11990 leader_election.cc:304] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.916042 13121 raft_consensus.cc:2802] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:59.916108 13121 raft_consensus.cc:695] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:01:59.916237 13121 consensus_queue.cc:237] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.916826 12042 raft_consensus.cc:2466] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:59.918174 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e98a2085fe67479db141b2675f69a2d9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:01:59.918280 11921 raft_consensus.cc:3058] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.919482 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3693e166c2c4af0b7a8f7994507de2c" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:01:59.919617 11780 raft_consensus.cc:2466] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:01:59.919641 11921 raft_consensus.cc:2466] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:01:59.922277 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3693e166c2c4af0b7a8f7994507de2c" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:01:59.922415 11780 raft_consensus.cc:3058] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.923331 11780 raft_consensus.cc:2466] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:01:59.924670 11717 leader_election.cc:304] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:01:59.924901 12208 raft_consensus.cc:2802] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:01:59.924980 12208 raft_consensus.cc:695] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:01:59.925117 12208 consensus_queue.cc:237] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.926574 12166 tablet_bootstrap.cc:492] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.926672 12166 ts_tablet_manager.cc:1397] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20250625 14:01:59.926714 12172 tablet_bootstrap.cc:492] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.926791 12172 ts_tablet_manager.cc:1397] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20250625 14:01:59.927165 12166 raft_consensus.cc:357] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.927305 12166 raft_consensus.cc:383] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.927261 12172 raft_consensus.cc:357] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.927341 12166 raft_consensus.cc:738] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.927356 12172 raft_consensus.cc:383] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.927390 12172 raft_consensus.cc:738] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.927492 12172 consensus_queue.cc:260] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.927486 12166 consensus_queue.cc:260] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.927776 12166 ts_tablet_manager.cc:1428] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:01:59.927779 12172 ts_tablet_manager.cc:1428] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:59.927999 12172 tablet_bootstrap.cc:492] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.928313 12042 raft_consensus.cc:3058] T 34806da4b2ec4c2db13322952bf943c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.928861 12166 tablet_bootstrap.cc:492] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.930373 12166 tablet_bootstrap.cc:654] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.936036 12238 raft_consensus.cc:491] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.936152 12238 raft_consensus.cc:513] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.936493 12238 leader_election.cc:290] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.939364 12172 tablet_bootstrap.cc:654] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.939628 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4de2eeaf84084fbda097aa8c0eef2341" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:01:59.940028 11717 leader_election.cc:343] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:01:59.940402 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4de2eeaf84084fbda097aa8c0eef2341" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:01:59.940543 11921 raft_consensus.cc:2466] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:01:59.931653 12166 tablet_bootstrap.cc:492] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.940824 12166 ts_tablet_manager.cc:1397] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20250625 14:01:59.941330 12166 raft_consensus.cc:357] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.941586 12166 raft_consensus.cc:383] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.941627 12166 raft_consensus.cc:738] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.941740 12166 consensus_queue.cc:260] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.942564 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.942704 11717 leader_election.cc:304] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:01:59.942857 12238 raft_consensus.cc:2802] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:01:59.942898 12238 raft_consensus.cc:491] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:01:59.942935 12238 raft_consensus.cc:3058] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:01:59.942935 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet c2307a7c00204e8fa1a14b5112659d91 with delete_type TABLET_DATA_DELETED (replaced by tablet 7491e070e86346b681817fb19d4608f9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:01:59.943737 12177 tablet_replica.cc:331] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.943818 12166 ts_tablet_manager.cc:1428] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250625 14:01:59.943859 12177 raft_consensus.cc:2241] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.943965 12177 raft_consensus.cc:2270] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.944002 12166 tablet_bootstrap.cc:492] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.944849 12177 ts_tablet_manager.cc:1905] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.946457 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet cc9e2afd5bc443398293d0ed572f6c05 (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
W20250625 14:01:59.946619 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 32e39d974af9439c873ba8ec6523c428 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e39d974af9439c873ba8ec6523c428 already in progress: creating tablet
I20250625 14:01:59.946923 12166 tablet_bootstrap.cc:654] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.947181 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 11bd0fc7e8ef430ea2cef302f67b8b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.947369 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 1dc5b8ea4f3b47f19c603c235fa79007 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.947450 12177 ts_tablet_manager.cc:1918] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250625 14:01:59.947481 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 32e39d974af9439c873ba8ec6523c428 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32e39d974af9439c873ba8ec6523c428 already in progress: creating tablet
I20250625 14:01:59.947526 12177 log.cc:1199] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7c68ae7ecff34d34baaffe47c740bac6
I20250625 14:01:59.947734 12177 ts_tablet_manager.cc:1939] T 7c68ae7ecff34d34baaffe47c740bac6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.948335 12177 tablet_replica.cc:331] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:01:59.948488 12177 raft_consensus.cc:2241] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.948602 12177 raft_consensus.cc:2270] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.948972 12166 tablet_bootstrap.cc:492] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.949041 12177 ts_tablet_manager.cc:1905] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.949051 12166 ts_tablet_manager.cc:1397] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20250625 14:01:59.949561 12166 raft_consensus.cc:357] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.949666 12166 raft_consensus.cc:383] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.949695 12166 raft_consensus.cc:738] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.949748 12167 tablet_bootstrap.cc:492] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.949836 12167 ts_tablet_manager.cc:1397] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.001s
I20250625 14:01:59.949844 12166 consensus_queue.cc:260] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.950395 12167 raft_consensus.cc:357] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.950525 12167 raft_consensus.cc:383] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.950559 12167 raft_consensus.cc:738] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.950666 12167 consensus_queue.cc:260] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.950978 12167 ts_tablet_manager.cc:1428] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.951200 12167 tablet_bootstrap.cc:492] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.951262 12238 raft_consensus.cc:513] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.951610 12238 leader_election.cc:290] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:01:59.952087 12177 ts_tablet_manager.cc:1918] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.952169 12177 log.cc:1199] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c2307a7c00204e8fa1a14b5112659d91
I20250625 14:01:59.952231 12167 tablet_bootstrap.cc:654] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.952513 12177 ts_tablet_manager.cc:1939] T c2307a7c00204e8fa1a14b5112659d91 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:01:59.954548 12166 ts_tablet_manager.cc:1428] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20250625 14:01:59.954770 12166 tablet_bootstrap.cc:492] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.955615 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5a3b7cbb8e624e9da3b12a63a710710d
I20250625 14:01:59.956096 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d2eeb21d15424aa0a2f57b108f2028f3" } new_table_name: "default.Table_6d0b9ebb9ed4411394d69c7220244814" modify_external_catalogs: true
I20250625 14:01:59.956754 12166 tablet_bootstrap.cc:654] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.958374 12172 tablet_bootstrap.cc:492] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.958489 12172 ts_tablet_manager.cc:1397] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20250625 14:01:59.959077 12172 raft_consensus.cc:357] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.959223 12172 raft_consensus.cc:383] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.959265 12172 raft_consensus.cc:738] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.959430 12172 consensus_queue.cc:260] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.959801 12172 ts_tablet_manager.cc:1428] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.960006 12172 tablet_bootstrap.cc:492] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.960155 12173 tablet_replica.cc:331] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.960287 12173 raft_consensus.cc:2241] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:01:59.960382 12173 raft_consensus.cc:2270] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:01:59.960916 12172 tablet_bootstrap.cc:654] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.961256 12173 ts_tablet_manager.cc:1905] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:01:59.962018 12953 tablet.cc:1722] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.964565 12166 tablet_bootstrap.cc:492] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.964658 12166 ts_tablet_manager.cc:1397] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:01:59.965176 12166 raft_consensus.cc:357] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.965301 12166 raft_consensus.cc:383] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.965338 12166 raft_consensus.cc:738] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.965458 12166 consensus_queue.cc:260] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.965747 12166 ts_tablet_manager.cc:1428] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.965924 12166 tablet_bootstrap.cc:492] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.967003 12166 tablet_bootstrap.cc:654] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.968631 13244 tablet.cc:1722] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.971046 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5227c93e932a4ed4b3d03990d7ed7b69
I20250625 14:01:59.971326 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 5227c93e932a4ed4b3d03990d7ed7b69 deleted and replaced by tablet e9de91633ba3404d9002d4f27449ea48
I20250625 14:01:59.971452 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 140c1810e98741479c3754729409b46c from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.971750 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ec9c0bd54e0e441186096c7e11ccc198" } new_table_name: "default.Table_e9fd60167d824e34a9a990ec9994f4fe" modify_external_catalogs: true
W20250625 14:01:59.972648 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf421457ab6c481f9fd6e18a9572ba5f consensus state has no leader
I20250625 14:01:59.972868 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6d4b84f13d9e48689d2869134361da04" } modify_external_catalogs: true
I20250625 14:01:59.972947 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6d4b84f13d9e48689d2869134361da04" } modify_external_catalogs: true
I20250625 14:01:59.973372 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet b6318e27fb194a209c1c80ffcaf24a64 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.973676 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_60486ed7afcd496886cbaefa5a6e798f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:01:59.974026 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60486ed7afcd496886cbaefa5a6e798f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:01:59.974439 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ce6e907d627f4f3e8219eaabe4373c6e
I20250625 14:01:59.974790 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 6980c62d63b34c67ad095ad9ea18a3f1 from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.974882 13241 tablet.cc:1722] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:01:59.975301 12172 tablet_bootstrap.cc:492] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:01:59.975399 12172 ts_tablet_manager.cc:1397] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:01:59.975920 12172 raft_consensus.cc:357] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.976027 12172 raft_consensus.cc:383] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.976058 12172 raft_consensus.cc:738] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.976178 12172 consensus_queue.cc:260] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.976462 12172 ts_tablet_manager.cc:1428] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:01:59.976691 12172 tablet_bootstrap.cc:492] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:01:59.978053 12172 tablet_bootstrap.cc:654] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.981930 12173 ts_tablet_manager.cc:1918] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:01:59.982019 12173 log.cc:1199] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/11bd0fc7e8ef430ea2cef302f67b8b22
I20250625 14:01:59.982226 12173 ts_tablet_manager.cc:1939] T 11bd0fc7e8ef430ea2cef302f67b8b22 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:01:59.984462 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:01:59.984474 12173 tablet_replica.cc:331] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:01:59.984752 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:01:59.987987 12167 tablet_bootstrap.cc:492] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.988102 12167 ts_tablet_manager.cc:1397] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20250625 14:01:59.988713 12167 raft_consensus.cc:357] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.988849 12167 raft_consensus.cc:383] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.988895 12167 raft_consensus.cc:738] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.989039 12167 consensus_queue.cc:260] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.989305 12167 ts_tablet_manager.cc:1428] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.989528 12167 tablet_bootstrap.cc:492] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:01:59.991098 12167 tablet_bootstrap.cc:654] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.992311 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_84fc4739c8554d4e9fe0419a738f9c79" } new_table_name: "default.Table_8ff447c86dfe4b5196d270ccc4247395" modify_external_catalogs: true
I20250625 14:01:59.992612 12166 tablet_bootstrap.cc:492] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:01:59.992699 12166 ts_tablet_manager.cc:1397] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:01:59.993227 12166 raft_consensus.cc:357] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.993340 12166 raft_consensus.cc:383] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.993371 12166 raft_consensus.cc:738] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.993498 12166 consensus_queue.cc:260] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:01:59.993815 12166 ts_tablet_manager.cc:1428] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.993992 12166 tablet_bootstrap.cc:492] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:01:59.995049 12166 tablet_bootstrap.cc:654] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.995359 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a0513f1c1050428aafc99329d1115a93" } modify_external_catalogs: true
I20250625 14:01:59.995481 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a0513f1c1050428aafc99329d1115a93" } modify_external_catalogs: true
I20250625 14:01:59.995898 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet d4eb86621bba4f3a897d4331ef30dc7f from {username='slave'} at 127.0.0.1:57414
I20250625 14:01:59.996639 12167 tablet_bootstrap.cc:492] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:01:59.996733 12167 ts_tablet_manager.cc:1397] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:01:59.997231 12167 raft_consensus.cc:357] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.997341 12167 raft_consensus.cc:383] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:01:59.997375 12167 raft_consensus.cc:738] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:01:59.997500 12167 consensus_queue.cc:260] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:01:59.997740 12167 ts_tablet_manager.cc:1428] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:01:59.997947 12167 tablet_bootstrap.cc:492] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:01:59.998162 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6980c62d63b34c67ad095ad9ea18a3f1 consensus state has no leader
W20250625 14:01:59.998700 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e4cdf8f78d14c7d8ba3bda009d33719 consensus state has no leader
I20250625 14:01:59.999181 12167 tablet_bootstrap.cc:654] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:01:59.999801 13121 raft_consensus.cc:491] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:01:59.999879 13121 raft_consensus.cc:513] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.000226 13121 leader_election.cc:290] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:00.000882 11990 leader_election.cc:343] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: da5ed5d8d3ca4342980c893a8653d4a0
I20250625 14:02:00.005568 12167 tablet_bootstrap.cc:492] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.005677 12167 ts_tablet_manager.cc:1397] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:02:00.006188 12167 raft_consensus.cc:357] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.006342 12167 raft_consensus.cc:383] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.006379 12167 raft_consensus.cc:738] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.006528 12167 consensus_queue.cc:260] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.006793 12167 ts_tablet_manager.cc:1428] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.006989 12167 tablet_bootstrap.cc:492] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.006984 12166 tablet_bootstrap.cc:492] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.007079 12166 ts_tablet_manager.cc:1397] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:00.007555 12166 raft_consensus.cc:357] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.007658 12166 raft_consensus.cc:383] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.007689 12166 raft_consensus.cc:738] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.007820 12166 consensus_queue.cc:260] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.008140 12167 tablet_bootstrap.cc:654] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.008155 12166 ts_tablet_manager.cc:1428] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:00.008349 12166 tablet_bootstrap.cc:492] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.009346 12166 tablet_bootstrap.cc:654] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.010478 12166 tablet_bootstrap.cc:492] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.010560 12166 ts_tablet_manager.cc:1397] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:02:00.010975 12166 raft_consensus.cc:357] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.011073 12166 raft_consensus.cc:383] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.011106 12166 raft_consensus.cc:738] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.011224 12166 consensus_queue.cc:260] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.011538 12166 ts_tablet_manager.cc:1428] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.011718 12166 tablet_bootstrap.cc:492] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.012399 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]). Expected version 1 got 0
I20250625 14:02:00.012524 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]). Expected version 1 got 0
I20250625 14:02:00.012719 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 432e55208a0f48b594a2fe564132cbf0 (table default.Table_938fda12129e4e0ba3d066955f7811b4 [id=c1f855079b614aa8b55e8ee6a87570e2]). Expected version 1 got 0
I20250625 14:02:00.012851 12166 tablet_bootstrap.cc:654] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.015805 12167 tablet_bootstrap.cc:492] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.015905 12167 ts_tablet_manager.cc:1397] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
I20250625 14:02:00.016409 12167 raft_consensus.cc:357] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.016522 12167 raft_consensus.cc:383] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.016556 12167 raft_consensus.cc:738] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.016705 12167 consensus_queue.cc:260] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.016957 12167 ts_tablet_manager.cc:1428] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.017644 13121 raft_consensus.cc:491] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.017724 13121 raft_consensus.cc:513] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.017845 12167 tablet_bootstrap.cc:492] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.018057 13121 leader_election.cc:290] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:00.018807 11990 leader_election.cc:343] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 7c68ae7ecff34d34baaffe47c740bac6
I20250625 14:02:00.019290 12167 tablet_bootstrap.cc:654] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.024523 12167 tablet_bootstrap.cc:492] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.024641 12167 ts_tablet_manager.cc:1397] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20250625 14:02:00.025173 12167 raft_consensus.cc:357] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.025301 12167 raft_consensus.cc:383] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.025338 12167 raft_consensus.cc:738] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.025477 12167 consensus_queue.cc:260] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.025744 12167 ts_tablet_manager.cc:1428] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.025928 12167 tablet_bootstrap.cc:492] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.026907 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8aaa44063346451f85e8a9b9742de378"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.027621 12167 tablet_bootstrap.cc:654] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:00.027974 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aaa44063346451f85e8a9b9742de378 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.029424 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4cb1c030a37648f0aaffe6805c232499"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.029735 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cb1c030a37648f0aaffe6805c232499 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.033344 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 5227c93e932a4ed4b3d03990d7ed7b69 with delete_type TABLET_DATA_DELETED (replaced by tablet e9de91633ba3404d9002d4f27449ea48) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.033556 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 5227c93e932a4ed4b3d03990d7ed7b69 with delete_type TABLET_DATA_DELETED (replaced by tablet e9de91633ba3404d9002d4f27449ea48) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.033720 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.033864 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.033876 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 11bd0fc7e8ef430ea2cef302f67b8b22 (table default.Table_32b413d2535247dabef6866ffa215cae [id=0719452dd3df4a8bb8668b9b63c62cc9]) successfully deleted
W20250625 14:02:00.034102 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 5a3b7cbb8e624e9da3b12a63a710710d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a3b7cbb8e624e9da3b12a63a710710d already in progress: creating tablet
I20250625 14:02:00.034875 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3e56586f5cd745a397bf6ed1a63d070e
I20250625 14:02:00.034864 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 7e387f4203ca4c84855bc5b041ce391e (DEFAULT_TABLE table=default.Table_30c713341cf040479971f7d4d4bacde0 [id=7ce06f0d34db46bdb7040f7144bdf5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.035145 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e387f4203ca4c84855bc5b041ce391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.036379 11890 tablet_service.cc:1468] Processing CreateTablet for tablet b5b5564d64d645c88a0e2c624b989944 (DEFAULT_TABLE table=default.Table_29b4142505484a25bd89b94f958d6c09 [id=0037901ba0df4140b07a10b24d7f06a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.036397 11526 catalog_manager.cc:5582] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:00.036643 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]). Expected version 1 got 0
I20250625 14:02:00.036674 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b5564d64d645c88a0e2c624b989944. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.036756 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:02:00.036839 11526 catalog_manager.cc:5582] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:00.036985 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]). Expected version 1 got 0
I20250625 14:02:00.037557 12175 tablet_replica.cc:331] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.037709 12175 raft_consensus.cc:2241] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:00.037750 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 7e387f4203ca4c84855bc5b041ce391e (DEFAULT_TABLE table=default.Table_30c713341cf040479971f7d4d4bacde0 [id=7ce06f0d34db46bdb7040f7144bdf5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.037925 12175 raft_consensus.cc:2270] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.037978 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e387f4203ca4c84855bc5b041ce391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.038286 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6980c62d63b34c67ad095ad9ea18a3f1
I20250625 14:02:00.038545 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 6980c62d63b34c67ad095ad9ea18a3f1 deleted and replaced by tablet 60414f22c3bd4938b11c678197e0b34c
I20250625 14:02:00.038770 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b6318e27fb194a209c1c80ffcaf24a64
I20250625 14:02:00.039019 11530 catalog_manager.cc:6652] ReplaceTablet: tablet b6318e27fb194a209c1c80ffcaf24a64 deleted and replaced by tablet 73a40d0ee5034aaea24684739c3f5154
I20250625 14:02:00.039232 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d4eb86621bba4f3a897d4331ef30dc7f
I20250625 14:02:00.039469 11529 catalog_manager.cc:6652] ReplaceTablet: tablet d4eb86621bba4f3a897d4331ef30dc7f deleted and replaced by tablet 9d8501126146425baa26ba7741963085
I20250625 14:02:00.040334 12173 raft_consensus.cc:2241] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.040438 12027 tablet_service.cc:1468] Processing CreateTablet for tablet fe456db1a0d34efab1a711b18637ae48 (DEFAULT_TABLE table=default.Table_3070f1e3d3144cd5b14c7c3542aa8b98 [id=7209c549dbe8462688d7ae6d869728c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.040460 12173 raft_consensus.cc:2270] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.040742 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe456db1a0d34efab1a711b18637ae48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.040799 11902 tablet_service.cc:1468] Processing CreateTablet for tablet fe456db1a0d34efab1a711b18637ae48 (DEFAULT_TABLE table=default.Table_3070f1e3d3144cd5b14c7c3542aa8b98 [id=7209c549dbe8462688d7ae6d869728c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.041044 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe456db1a0d34efab1a711b18637ae48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.041183 12173 ts_tablet_manager.cc:1905] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.043365 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 6315917a0af74762a1802b3dd4e02ca8 (DEFAULT_TABLE table=default.Table_be4403815e95486da90977105215b6a3 [id=65e9a81c90e8445da4cf4cb5be472d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.043347 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 6315917a0af74762a1802b3dd4e02ca8 (DEFAULT_TABLE table=default.Table_be4403815e95486da90977105215b6a3 [id=65e9a81c90e8445da4cf4cb5be472d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.043599 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6315917a0af74762a1802b3dd4e02ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.043599 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6315917a0af74762a1802b3dd4e02ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.045475 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4de2eeaf84084fbda097aa8c0eef2341" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:00.045588 11921 raft_consensus.cc:3058] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.045836 12034 tablet_service.cc:1468] Processing CreateTablet for tablet dfd6a8bf9e624b169377e7f9b8ccc761 (DEFAULT_TABLE table=default.Table_e4fe5899ea124412b41a61ce3e23c37e [id=38c269304b524db7a81238a88562390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.046078 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd6a8bf9e624b169377e7f9b8ccc761. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.046284 11895 tablet_service.cc:1468] Processing CreateTablet for tablet dfd6a8bf9e624b169377e7f9b8ccc761 (DEFAULT_TABLE table=default.Table_e4fe5899ea124412b41a61ce3e23c37e [id=38c269304b524db7a81238a88562390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.046521 11921 raft_consensus.cc:2466] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:00.046568 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd6a8bf9e624b169377e7f9b8ccc761. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.047173 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4de2eeaf84084fbda097aa8c0eef2341" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.048429 12037 tablet_service.cc:1468] Processing CreateTablet for tablet b5b5564d64d645c88a0e2c624b989944 (DEFAULT_TABLE table=default.Table_29b4142505484a25bd89b94f958d6c09 [id=0037901ba0df4140b07a10b24d7f06a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.048666 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b5564d64d645c88a0e2c624b989944. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.050968 12208 raft_consensus.cc:491] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.051069 12208 raft_consensus.cc:513] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.051093 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 2e4822e4ed7a405e8940abf314052185 (DEFAULT_TABLE table=default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.051334 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4822e4ed7a405e8940abf314052185. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.051402 12208 leader_election.cc:290] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.051860 12175 ts_tablet_manager.cc:1905] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.052018 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:00.053267 11717 leader_election.cc:343] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.053658 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 with delete_type TABLET_DATA_DELETED (replaced by tablet 73a40d0ee5034aaea24684739c3f5154) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.053804 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 with delete_type TABLET_DATA_DELETED (replaced by tablet 73a40d0ee5034aaea24684739c3f5154) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.053942 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d8501126146425baa26ba7741963085) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.054052 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 60414f22c3bd4938b11c678197e0b34c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.054288 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d8501126146425baa26ba7741963085) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.055248 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_08f44e189955459ab1825ed53a44b427 [id=29fdfe34ed7648feb4f21f471fd5e154] alter complete (version 2)
I20250625 14:02:00.056711 12167 tablet_bootstrap.cc:492] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.056806 12167 ts_tablet_manager.cc:1397] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:02:00.057303 12167 raft_consensus.cc:357] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.057408 12167 raft_consensus.cc:383] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.057437 12167 raft_consensus.cc:738] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.057556 12167 consensus_queue.cc:260] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.057861 12167 ts_tablet_manager.cc:1428] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.058071 12167 tablet_bootstrap.cc:492] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.058342 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6
I20250625 14:02:00.058846 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.059186 12167 tablet_bootstrap.cc:654] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.059262 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 2e4822e4ed7a405e8940abf314052185 (DEFAULT_TABLE table=default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.059580 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4822e4ed7a405e8940abf314052185. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.060581 12167 tablet_bootstrap.cc:492] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.060652 12167 ts_tablet_manager.cc:1397] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:00.061085 12167 raft_consensus.cc:357] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.061182 12167 raft_consensus.cc:383] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.061223 12167 raft_consensus.cc:738] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.061333 12167 consensus_queue.cc:260] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.061599 12167 ts_tablet_manager.cc:1428] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.061757 12167 tablet_bootstrap.cc:492] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.062779 12167 tablet_bootstrap.cc:654] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.063889 12167 tablet_bootstrap.cc:492] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.063961 12167 ts_tablet_manager.cc:1397] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20250625 14:02:00.064409 12167 raft_consensus.cc:357] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.064517 12167 raft_consensus.cc:383] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.064546 12167 raft_consensus.cc:738] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.064648 12167 consensus_queue.cc:260] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.064893 12167 ts_tablet_manager.cc:1428] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.065043 12167 tablet_bootstrap.cc:492] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.066015 12167 tablet_bootstrap.cc:654] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.066780 12558 raft_consensus.cc:491] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.066891 12558 raft_consensus.cc:513] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.067332 12167 tablet_bootstrap.cc:492] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.067374 12558 leader_election.cc:290] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.067411 12167 ts_tablet_manager.cc:1397] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20250625 14:02:00.067673 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 60414f22c3bd4938b11c678197e0b34c) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.067910 12167 raft_consensus.cc:357] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.068017 12167 raft_consensus.cc:383] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.068058 12167 raft_consensus.cc:738] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.068193 12167 consensus_queue.cc:260] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.068497 12167 ts_tablet_manager.cc:1428] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20250625 14:02:00.068542 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d43d6332c6046b3a9171f93335e72fd consensus state has no leader
I20250625 14:02:00.068678 12167 tablet_bootstrap.cc:492] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.069757 12167 tablet_bootstrap.cc:654] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.070865 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1c05e534c804eb69e0c249a03418941" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.071038 11780 raft_consensus.cc:2391] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:00.071378 12167 tablet_bootstrap.cc:492] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.071477 12167 ts_tablet_manager.cc:1397] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:02:00.071988 12167 raft_consensus.cc:357] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.072113 12167 raft_consensus.cc:383] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.072157 12167 raft_consensus.cc:738] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.072315 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c1c05e534c804eb69e0c249a03418941" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.072327 12167 consensus_queue.cc:260] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.073016 12167 ts_tablet_manager.cc:1428] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.073565 12167 tablet_bootstrap.cc:492] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.074509 12167 tablet_bootstrap.cc:654] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.075326 12175 ts_tablet_manager.cc:1918] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.075439 12175 log.cc:1199] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/5227c93e932a4ed4b3d03990d7ed7b69
I20250625 14:02:00.075742 12175 ts_tablet_manager.cc:1939] T 5227c93e932a4ed4b3d03990d7ed7b69 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.076501 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.077147 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 5227c93e932a4ed4b3d03990d7ed7b69 with delete_type TABLET_DATA_DELETED (replaced by tablet e9de91633ba3404d9002d4f27449ea48) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.077347 12177 tablet_replica.cc:331] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.077493 12177 raft_consensus.cc:2241] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.077657 12177 raft_consensus.cc:2270] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.078296 12177 ts_tablet_manager.cc:1905] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.078848 11855 leader_election.cc:304] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:00.079017 12558 raft_consensus.cc:3058] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.079936 12558 raft_consensus.cc:2747] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.080740 12177 ts_tablet_manager.cc:1918] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.080821 12177 log.cc:1199] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/5227c93e932a4ed4b3d03990d7ed7b69
I20250625 14:02:00.081069 12177 ts_tablet_manager.cc:1939] T 5227c93e932a4ed4b3d03990d7ed7b69 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.083199 12173 ts_tablet_manager.cc:1918] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.083282 12173 log.cc:1199] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/1dc5b8ea4f3b47f19c603c235fa79007
I20250625 14:02:00.083472 12173 ts_tablet_manager.cc:1939] T 1dc5b8ea4f3b47f19c603c235fa79007 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.083793 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.084453 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 7e387f4203ca4c84855bc5b041ce391e (DEFAULT_TABLE table=default.Table_30c713341cf040479971f7d4d4bacde0 [id=7ce06f0d34db46bdb7040f7144bdf5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.084712 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e387f4203ca4c84855bc5b041ce391e. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:00.085465 11520 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.39.190:38199, user_credentials={real_user=slave}} blocked reactor thread for 53537.3us
I20250625 14:02:00.087400 11764 tablet_service.cc:1468] Processing CreateTablet for tablet fe456db1a0d34efab1a711b18637ae48 (DEFAULT_TABLE table=default.Table_3070f1e3d3144cd5b14c7c3542aa8b98 [id=7209c549dbe8462688d7ae6d869728c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.087630 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe456db1a0d34efab1a711b18637ae48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.088644 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ae3b18f018434e4a8b85ea267ae0b343"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.089063 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae3b18f018434e4a8b85ea267ae0b343 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.090021 13121 raft_consensus.cc:491] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.090139 13121 raft_consensus.cc:513] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.090467 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_478843ad04c04773be560cc8ac45cc52" } modify_external_catalogs: true
I20250625 14:02:00.090574 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_478843ad04c04773be560cc8ac45cc52" } modify_external_catalogs: true
I20250625 14:02:00.090601 13121 leader_election.cc:290] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.091673 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "237ca3218ae84a0b8354f328b91dfab4" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.091827 11921 raft_consensus.cc:2391] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:00.092128 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7c68ae7ecff34d34baaffe47c740bac6 (table default.Table_dc38af2e12bd48faa284df718dff16f9 [id=e6793d23bb264d259e9d0218259fea14]) successfully deleted
I20250625 14:02:00.092252 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c2307a7c00204e8fa1a14b5112659d91 (table default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]) successfully deleted
I20250625 14:02:00.094735 11531 catalog_manager.cc:5582] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:00.095073 11531 catalog_manager.cc:5582] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:00.095214 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:02:00.100720 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 9bd4226d952d4dc394c33acae7372347 with delete_type TABLET_DATA_DELETED (replaced by tablet b215f2dc28604d1387e9847a5247564d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.100914 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.100953 12175 tablet_replica.cc:331] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.101120 12175 raft_consensus.cc:2241] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.101280 12175 raft_consensus.cc:2270] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.101676 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 881295234a5b4a089985382765774cd9
I20250625 14:02:00.101980 12175 ts_tablet_manager.cc:1905] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.105908 12175 ts_tablet_manager.cc:1918] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.106135 12175 log.cc:1199] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9bd4226d952d4dc394c33acae7372347
I20250625 14:02:00.106465 12175 ts_tablet_manager.cc:1939] T 9bd4226d952d4dc394c33acae7372347 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.107125 11752 tablet_service.cc:1468] Processing CreateTablet for tablet dfd6a8bf9e624b169377e7f9b8ccc761 (DEFAULT_TABLE table=default.Table_e4fe5899ea124412b41a61ce3e23c37e [id=38c269304b524db7a81238a88562390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.107297 12175 tablet_replica.cc:331] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.107442 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd6a8bf9e624b169377e7f9b8ccc761. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.107437 12175 raft_consensus.cc:2241] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.107545 12175 raft_consensus.cc:2270] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.108072 12175 ts_tablet_manager.cc:1905] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.108170 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 6315917a0af74762a1802b3dd4e02ca8 (DEFAULT_TABLE table=default.Table_be4403815e95486da90977105215b6a3 [id=65e9a81c90e8445da4cf4cb5be472d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.108407 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6315917a0af74762a1802b3dd4e02ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.110551 12175 ts_tablet_manager.cc:1918] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.110651 12175 log.cc:1199] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6d41c8cea082478d9cc16c143b3a3f7a
I20250625 14:02:00.112167 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.112195 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.112391 12175 ts_tablet_manager.cc:1939] T 6d41c8cea082478d9cc16c143b3a3f7a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.113801 12558 raft_consensus.cc:491] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.113870 12173 tablet_replica.cc:331] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.113917 12558 raft_consensus.cc:513] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.114007 12173 raft_consensus.cc:2241] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.114131 12173 raft_consensus.cc:2270] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.114681 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 60414f22c3bd4938b11c678197e0b34c) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.114671 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db5d2263ab724491a7049fb91b0d10fb" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.114964 11780 raft_consensus.cc:2466] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.114985 12558 leader_election.cc:290] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.114920 11764 tablet_service.cc:1468] Processing CreateTablet for tablet b5b5564d64d645c88a0e2c624b989944 (DEFAULT_TABLE table=default.Table_29b4142505484a25bd89b94f958d6c09 [id=0037901ba0df4140b07a10b24d7f06a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.114666 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.115358 11858 leader_election.cc:304] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.115474 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d8501126146425baa26ba7741963085) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.115463 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db5d2263ab724491a7049fb91b0d10fb" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.115532 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 with delete_type TABLET_DATA_DELETED (replaced by tablet 73a40d0ee5034aaea24684739c3f5154) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.115590 12042 raft_consensus.cc:2466] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.115640 12558 raft_consensus.cc:2802] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.115690 12558 raft_consensus.cc:491] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.115736 12558 raft_consensus.cc:3058] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.115772 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.115877 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5b5564d64d645c88a0e2c624b989944. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.115990 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 881295234a5b4a089985382765774cd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.116194 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d with delete_type TABLET_DATA_DELETED (replaced by tablet 714bb5a28ec648f990fa1525a1b50129) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.116353 12175 tablet_replica.cc:331] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.116405 12177 tablet_replica.cc:331] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.116472 12175 raft_consensus.cc:2241] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.116524 12177 raft_consensus.cc:2241] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.116571 12175 raft_consensus.cc:2270] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.116631 12177 raft_consensus.cc:2270] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.116914 12558 raft_consensus.cc:513] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.117130 12175 ts_tablet_manager.cc:1905] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.117128 12177 ts_tablet_manager.cc:1905] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.117295 12558 leader_election.cc:290] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.117581 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.117623 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db5d2263ab724491a7049fb91b0d10fb" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.117723 12042 raft_consensus.cc:3058] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.117949 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet be4378f7781541d7866e6d5c440b13e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.117952 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "db5d2263ab724491a7049fb91b0d10fb" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.118069 11780 raft_consensus.cc:3058] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.118670 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 2e4822e4ed7a405e8940abf314052185 (DEFAULT_TABLE table=default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.119031 12558 raft_consensus.cc:491] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.119031 11780 raft_consensus.cc:2466] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.119110 12558 raft_consensus.cc:513] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:00.119565 11993 leader_election.cc:343] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: da5ed5d8d3ca4342980c893a8653d4a0
I20250625 14:02:00.119647 11993 leader_election.cc:304] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.119668 12177 ts_tablet_manager.cc:1918] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.119736 12177 log.cc:1199] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6d41c8cea082478d9cc16c143b3a3f7a
I20250625 14:02:00.119774 12042 raft_consensus.cc:2466] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.119876 13232 raft_consensus.cc:2747] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.119974 12177 ts_tablet_manager.cc:1939] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.120193 11855 leader_election.cc:304] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.120373 12265 raft_consensus.cc:2802] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.120442 12265 raft_consensus.cc:695] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:00.120576 12265 consensus_queue.cc:237] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.120648 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]) successfully deleted
W20250625 14:02:00.120842 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet ce6e907d627f4f3e8219eaabe4373c6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce6e907d627f4f3e8219eaabe4373c6e already in progress: creating tablet
W20250625 14:02:00.120968 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b6318e27fb194a209c1c80ffcaf24a64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6318e27fb194a209c1c80ffcaf24a64 already in progress: creating tablet
W20250625 14:02:00.121061 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d4eb86621bba4f3a897d4331ef30dc7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4eb86621bba4f3a897d4331ef30dc7f already in progress: creating tablet
W20250625 14:02:00.121151 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 3e56586f5cd745a397bf6ed1a63d070e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e56586f5cd745a397bf6ed1a63d070e already in progress: creating tablet
W20250625 14:02:00.121241 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6980c62d63b34c67ad095ad9ea18a3f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6980c62d63b34c67ad095ad9ea18a3f1 already in progress: creating tablet
I20250625 14:02:00.121368 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9bd4226d952d4dc394c33acae7372347 (table default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]) successfully deleted
I20250625 14:02:00.121441 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6d41c8cea082478d9cc16c143b3a3f7a (table default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]) successfully deleted
W20250625 14:02:00.121529 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 already in progress: creating tablet
I20250625 14:02:00.122263 12173 ts_tablet_manager.cc:1905] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.123061 12172 tablet_bootstrap.cc:492] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.123162 12172 ts_tablet_manager.cc:1397] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.147s user 0.002s sys 0.000s
I20250625 14:02:00.123636 12172 raft_consensus.cc:357] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.123749 12172 raft_consensus.cc:383] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.123780 12172 raft_consensus.cc:738] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.123884 12172 consensus_queue.cc:260] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.124235 12172 ts_tablet_manager.cc:1428] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20250625 14:02:00.124625 11993 leader_election.cc:343] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 7c68ae7ecff34d34baaffe47c740bac6
I20250625 14:02:00.124671 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d41c8cea082478d9cc16c143b3a3f7a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.124709 11993 leader_election.cc:304] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.124785 12056 raft_consensus.cc:2466] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:00.124881 13232 raft_consensus.cc:2747] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:00.125264 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 5a3b7cbb8e624e9da3b12a63a710710d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a3b7cbb8e624e9da3b12a63a710710d already in progress: creating tablet
I20250625 14:02:00.125435 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]) successfully deleted
W20250625 14:02:00.125571 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ce6e907d627f4f3e8219eaabe4373c6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce6e907d627f4f3e8219eaabe4373c6e already in progress: creating tablet
I20250625 14:02:00.125799 12166 tablet_bootstrap.cc:492] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.125846 12167 tablet_bootstrap.cc:492] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
W20250625 14:02:00.125869 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6980c62d63b34c67ad095ad9ea18a3f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6980c62d63b34c67ad095ad9ea18a3f1 already in progress: creating tablet
I20250625 14:02:00.125902 12166 ts_tablet_manager.cc:1397] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.000s
I20250625 14:02:00.125934 12167 ts_tablet_manager.cc:1397] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.001s
I20250625 14:02:00.126271 12166 raft_consensus.cc:357] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.126403 12166 raft_consensus.cc:383] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.126441 12166 raft_consensus.cc:738] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.126488 12167 raft_consensus.cc:357] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.126590 12167 raft_consensus.cc:383] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.126555 12166 consensus_queue.cc:260] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.126626 12167 raft_consensus.cc:738] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.126770 12167 consensus_queue.cc:260] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.126827 12166 ts_tablet_manager.cc:1428] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.127022 12166 tablet_bootstrap.cc:492] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.127072 12167 ts_tablet_manager.cc:1428] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.127250 12167 tablet_bootstrap.cc:492] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.127969 12166 tablet_bootstrap.cc:654] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.128304 12167 tablet_bootstrap.cc:654] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.128747 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 1dc5b8ea4f3b47f19c603c235fa79007 (table default.Table_049d9acf2b4942958531ca1b61d7cde6 [id=1f0beab9905748e48e7c47f72f6ffedd]) successfully deleted
W20250625 14:02:00.128932 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5a3b7cbb8e624e9da3b12a63a710710d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a3b7cbb8e624e9da3b12a63a710710d already in progress: creating tablet
I20250625 14:02:00.128966 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet da5ed5d8d3ca4342980c893a8653d4a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.129379 12558 leader_election.cc:290] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.124912 12173 ts_tablet_manager.cc:1918] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.129873 12173 log.cc:1199] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/5227c93e932a4ed4b3d03990d7ed7b69
I20250625 14:02:00.130172 12173 ts_tablet_manager.cc:1939] T 5227c93e932a4ed4b3d03990d7ed7b69 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.130496 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 881295234a5b4a089985382765774cd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.130836 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "432e55208a0f48b594a2fe564132cbf0" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.130970 11780 raft_consensus.cc:2466] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.131300 12173 tablet_replica.cc:331] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.131433 12173 raft_consensus.cc:2241] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.131531 12173 raft_consensus.cc:2270] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.131983 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 5227c93e932a4ed4b3d03990d7ed7b69 (table default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]) successfully deleted
W20250625 14:02:00.132136 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet ce6e907d627f4f3e8219eaabe4373c6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce6e907d627f4f3e8219eaabe4373c6e already in progress: creating tablet
I20250625 14:02:00.132128 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "432e55208a0f48b594a2fe564132cbf0" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.132254 12056 raft_consensus.cc:2466] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
W20250625 14:02:00.132268 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 3e56586f5cd745a397bf6ed1a63d070e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e56586f5cd745a397bf6ed1a63d070e already in progress: creating tablet
I20250625 14:02:00.132539 11858 leader_election.cc:304] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:02:00.132666 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b6318e27fb194a209c1c80ffcaf24a64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6318e27fb194a209c1c80ffcaf24a64 already in progress: creating tablet
I20250625 14:02:00.133033 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 881295234a5b4a089985382765774cd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.133307 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e4822e4ed7a405e8940abf314052185. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.133795 12600 raft_consensus.cc:2802] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.133846 12600 raft_consensus.cc:491] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.133880 12600 raft_consensus.cc:3058] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.134896 12600 raft_consensus.cc:513] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.135278 12600 leader_election.cc:290] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.136510 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "432e55208a0f48b594a2fe564132cbf0" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.136634 11780 raft_consensus.cc:3058] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.137624 11780 raft_consensus.cc:2466] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.137990 11858 leader_election.cc:304] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.138279 12172 tablet_bootstrap.cc:492] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.138499 12600 raft_consensus.cc:2802] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.138592 12600 raft_consensus.cc:695] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:00.138718 12600 consensus_queue.cc:237] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.139266 12172 tablet_bootstrap.cc:654] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.140517 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 432e55208a0f48b594a2fe564132cbf0 (table default.Table_938fda12129e4e0ba3d066955f7811b4 [id=c1f855079b614aa8b55e8ee6a87570e2]). Expected version 1 got 0
W20250625 14:02:00.132812 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d4eb86621bba4f3a897d4331ef30dc7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4eb86621bba4f3a897d4331ef30dc7f already in progress: creating tablet
I20250625 14:02:00.141122 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "432e55208a0f48b594a2fe564132cbf0" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.141268 12056 raft_consensus.cc:3058] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:00.141404 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 6980c62d63b34c67ad095ad9ea18a3f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6980c62d63b34c67ad095ad9ea18a3f1 already in progress: creating tablet
W20250625 14:02:00.141633 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 already in progress: creating tablet
I20250625 14:02:00.142627 12056 raft_consensus.cc:2466] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.142751 11527 catalog_manager.cc:5582] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
W20250625 14:02:00.145026 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 3e56586f5cd745a397bf6ed1a63d070e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e56586f5cd745a397bf6ed1a63d070e already in progress: creating tablet
I20250625 14:02:00.145175 11717 leader_election.cc:304] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:00.145202 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e63fe2c5df514e2da6f77363d9dec47c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.145537 12208 raft_consensus.cc:2802] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.145598 12208 raft_consensus.cc:695] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
W20250625 14:02:00.145607 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63fe2c5df514e2da6f77363d9dec47c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.145689 12208 consensus_queue.cc:237] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.146486 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_60486ed7afcd496886cbaefa5a6e798f" } new_table_name: "default.Table_e55bc479ac274666945b9ec35a88dae6" modify_external_catalogs: true
I20250625 14:02:00.147007 12175 ts_tablet_manager.cc:1918] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.147092 12175 log.cc:1199] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d3cf1f09ba14436cbdce5a58da0f202d
I20250625 14:02:00.147331 12175 ts_tablet_manager.cc:1939] T d3cf1f09ba14436cbdce5a58da0f202d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.148244 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d3cf1f09ba14436cbdce5a58da0f202d (table default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]) successfully deleted
W20250625 14:02:00.148517 11717 leader_election.cc:343] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 6d41c8cea082478d9cc16c143b3a3f7a
I20250625 14:02:00.148913 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "237ca3218ae84a0b8354f328b91dfab4" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.149763 11993 leader_election.cc:304] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.149979 13232 raft_consensus.cc:3058] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.150589 11717 leader_election.cc:304] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:00.150566 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 9bd4226d952d4dc394c33acae7372347 with delete_type TABLET_DATA_DELETED (replaced by tablet b215f2dc28604d1387e9847a5247564d) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:00.150724 11717 raft_consensus.cc:2684] T 6d41c8cea082478d9cc16c143b3a3f7a P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:00.151494 13232 raft_consensus.cc:2747] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.152189 12175 tablet_replica.cc:331] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.152415 12175 raft_consensus.cc:2241] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.152582 12175 raft_consensus.cc:2270] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.153247 12175 ts_tablet_manager.cc:1905] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:00.153709 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d4eb86621bba4f3a897d4331ef30dc7f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4eb86621bba4f3a897d4331ef30dc7f already in progress: creating tablet
W20250625 14:02:00.154208 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b6318e27fb194a209c1c80ffcaf24a64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6318e27fb194a209c1c80ffcaf24a64 already in progress: creating tablet
I20250625 14:02:00.154438 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6d41c8cea082478d9cc16c143b3a3f7a (table default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]) successfully deleted
W20250625 14:02:00.154574 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 881295234a5b4a089985382765774cd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 881295234a5b4a089985382765774cd9 already in progress: creating tablet
W20250625 14:02:00.154783 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 already in progress: creating tablet
I20250625 14:02:00.154757 12208 consensus_queue.cc:1035] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.155328 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet be4378f7781541d7866e6d5c440b13e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.155589 12177 tablet_replica.cc:331] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.155800 12177 raft_consensus.cc:2241] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.155992 12177 raft_consensus.cc:2270] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.156541 12175 ts_tablet_manager.cc:1918] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.156737 12177 ts_tablet_manager.cc:1905] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.156968 12175 log.cc:1199] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/be4378f7781541d7866e6d5c440b13e6
I20250625 14:02:00.157323 12175 ts_tablet_manager.cc:1939] T be4378f7781541d7866e6d5c440b13e6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.158449 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 3809e6ad12ac474ca625910be01de97a (DEFAULT_TABLE table=default.Table_60486ed7afcd496886cbaefa5a6e798f [id=dcfe3e550638499b98207ed397fa7a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.158790 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3809e6ad12ac474ca625910be01de97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.161305 12177 ts_tablet_manager.cc:1918] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.161398 12177 log.cc:1199] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9bd4226d952d4dc394c33acae7372347
I20250625 14:02:00.161614 12177 ts_tablet_manager.cc:1939] T 9bd4226d952d4dc394c33acae7372347 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.162339 11764 tablet_service.cc:1468] Processing CreateTablet for tablet a10104a980ff438aa52d4bd2bc5a4277 (DEFAULT_TABLE table=default.Table_06824299bef54c86acdac5b99cc218d8 [id=b3c75716a0244d3b9e63041ceef84f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.162353 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 899b47cc4b9e4afc854dccac27d7fec0 (DEFAULT_TABLE table=default.Table_9e69770668a04547a020086532fb0af9 [id=a8ce0f687b9240e4ab1bb04c014b7f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.162510 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 7fe89f83d1bd4beab31544e8dd45a448 (DEFAULT_TABLE table=default.Table_5e70bbb4cf7547faa9581674e5c46cc2 [id=26170d4dcfda42fd8e177027cb5ceb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.162660 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10104a980ff438aa52d4bd2bc5a4277. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.162803 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899b47cc4b9e4afc854dccac27d7fec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.163008 11750 tablet_service.cc:1468] Processing CreateTablet for tablet e9de91633ba3404d9002d4f27449ea48 (DEFAULT_TABLE table=default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.163210 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe89f83d1bd4beab31544e8dd45a448. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.163023 11760 tablet_service.cc:1468] Processing CreateTablet for tablet cba459a70a404cdead8d487e6b9f2eb7 (DEFAULT_TABLE table=default.Table_87b14d45472a4fcd9d299d7071ec42fd [id=5847927d6c4248b5809fcb8236c59a6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.163153 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 6463a93315844e359273bc7e5907cac3 (DEFAULT_TABLE table=default.Table_847e7405f014463eb6b720987a1447a2 [id=2d5e90c8f33d4a4096502526a29f5c34]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:00.164965 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3809e6ad12ac474ca625910be01de97a consensus state has no leader
I20250625 14:02:00.165503 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba459a70a404cdead8d487e6b9f2eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.166054 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9bd4226d952d4dc394c33acae7372347 (table default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]) successfully deleted
I20250625 14:02:00.166129 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7eea033a0ebc4712a45ee52653e09a47" } modify_external_catalogs: true
I20250625 14:02:00.166247 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7eea033a0ebc4712a45ee52653e09a47" } modify_external_catalogs: true
I20250625 14:02:00.167524 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 3809e6ad12ac474ca625910be01de97a (DEFAULT_TABLE table=default.Table_60486ed7afcd496886cbaefa5a6e798f [id=dcfe3e550638499b98207ed397fa7a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.167796 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3809e6ad12ac474ca625910be01de97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.167819 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 3809e6ad12ac474ca625910be01de97a (DEFAULT_TABLE table=default.Table_60486ed7afcd496886cbaefa5a6e798f [id=dcfe3e550638499b98207ed397fa7a1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.168136 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3809e6ad12ac474ca625910be01de97a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.168620 11893 tablet_service.cc:1468] Processing CreateTablet for tablet a10104a980ff438aa52d4bd2bc5a4277 (DEFAULT_TABLE table=default.Table_06824299bef54c86acdac5b99cc218d8 [id=b3c75716a0244d3b9e63041ceef84f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.168843 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10104a980ff438aa52d4bd2bc5a4277. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.170207 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 4a66ca083967486a9b9e3f0885186125 (DEFAULT_TABLE table=default.Table_01aa57734c14479888e1455726901848 [id=116dbbda20c24b93b3eb465e1e6b963c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.170454 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66ca083967486a9b9e3f0885186125. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.172658 12034 tablet_service.cc:1468] Processing CreateTablet for tablet a10104a980ff438aa52d4bd2bc5a4277 (DEFAULT_TABLE table=default.Table_06824299bef54c86acdac5b99cc218d8 [id=b3c75716a0244d3b9e63041ceef84f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.172912 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10104a980ff438aa52d4bd2bc5a4277. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.173383 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9de91633ba3404d9002d4f27449ea48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.173753 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 93d666f4b403435287f4157bda971193 (table default.Table_43bcd95133e249cc987155fe5045e4ea [id=27af5f3cf87a4e71937c303a90e3d366]). Expected version 1 got 0
I20250625 14:02:00.173836 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 432e55208a0f48b594a2fe564132cbf0 (table default.Table_938fda12129e4e0ba3d066955f7811b4 [id=c1f855079b614aa8b55e8ee6a87570e2]). Expected version 1 got 0
I20250625 14:02:00.175269 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 4a66ca083967486a9b9e3f0885186125 (DEFAULT_TABLE table=default.Table_01aa57734c14479888e1455726901848 [id=116dbbda20c24b93b3eb465e1e6b963c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.175539 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66ca083967486a9b9e3f0885186125. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.177634 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6463a93315844e359273bc7e5907cac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.178161 12208 consensus_queue.cc:1035] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.179625 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 899b47cc4b9e4afc854dccac27d7fec0 (DEFAULT_TABLE table=default.Table_9e69770668a04547a020086532fb0af9 [id=a8ce0f687b9240e4ab1bb04c014b7f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.179875 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899b47cc4b9e4afc854dccac27d7fec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.183549 12177 tablet_replica.cc:331] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.183585 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 899b47cc4b9e4afc854dccac27d7fec0 (DEFAULT_TABLE table=default.Table_9e69770668a04547a020086532fb0af9 [id=a8ce0f687b9240e4ab1bb04c014b7f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.183887 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899b47cc4b9e4afc854dccac27d7fec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.183871 12177 raft_consensus.cc:2241] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.184116 12177 raft_consensus.cc:2270] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.184726 12177 ts_tablet_manager.cc:1905] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.188407 12177 ts_tablet_manager.cc:1918] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.189373 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 7fe89f83d1bd4beab31544e8dd45a448 (DEFAULT_TABLE table=default.Table_5e70bbb4cf7547faa9581674e5c46cc2 [id=26170d4dcfda42fd8e177027cb5ceb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.189671 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe89f83d1bd4beab31544e8dd45a448. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.189657 11524 catalog_manager.cc:5582] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:00.189899 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 432e55208a0f48b594a2fe564132cbf0 (table default.Table_938fda12129e4e0ba3d066955f7811b4 [id=c1f855079b614aa8b55e8ee6a87570e2]). Expected version 1 got 0
I20250625 14:02:00.191715 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d74f27d998b14ee890272812b718e468
I20250625 14:02:00.193387 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_938fda12129e4e0ba3d066955f7811b4" } new_table_name: "default.Table_3b71d8796f7d48eb9dca00adb7224232" modify_external_catalogs: true
I20250625 14:02:00.194749 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 7fe89f83d1bd4beab31544e8dd45a448 (DEFAULT_TABLE table=default.Table_5e70bbb4cf7547faa9581674e5c46cc2 [id=26170d4dcfda42fd8e177027cb5ceb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.194752 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b07b7a38e2f545e1ab85d255b7755f84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.195066 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe89f83d1bd4beab31544e8dd45a448. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:00.195128 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b07b7a38e2f545e1ab85d255b7755f84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.196249 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f756287c134b4c38ab1d827f5ca750fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.196569 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f756287c134b4c38ab1d827f5ca750fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.197618 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_99867a76f7444c73b03daf2d410e0156" } modify_external_catalogs: true
I20250625 14:02:00.197731 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_99867a76f7444c73b03daf2d410e0156" } modify_external_catalogs: true
I20250625 14:02:00.198825 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_0f101fb3f05348f8a75533a4ce961e14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.199187 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f101fb3f05348f8a75533a4ce961e14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.199388 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c7d281ee1d5647d999a0702ce64779dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.199681 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7d281ee1d5647d999a0702ce64779dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.199870 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ed61cf3246304810aa1b1096735c602b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.200153 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed61cf3246304810aa1b1096735c602b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.204569 13232 consensus_queue.cc:1035] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.207914 12177 log.cc:1199] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/be4378f7781541d7866e6d5c440b13e6
I20250625 14:02:00.208055 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a36ed3e126ef4edfa69fcffb098d0e4f
I20250625 14:02:00.193502 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet d74f27d998b14ee890272812b718e468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.199927 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 73a40d0ee5034aaea24684739c3f5154 (DEFAULT_TABLE table=default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.208923 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a40d0ee5034aaea24684739c3f5154. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.209446 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 6463a93315844e359273bc7e5907cac3 (DEFAULT_TABLE table=default.Table_847e7405f014463eb6b720987a1447a2 [id=2d5e90c8f33d4a4096502526a29f5c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.209589 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 6463a93315844e359273bc7e5907cac3 (DEFAULT_TABLE table=default.Table_847e7405f014463eb6b720987a1447a2 [id=2d5e90c8f33d4a4096502526a29f5c34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.209846 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6463a93315844e359273bc7e5907cac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.209997 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6463a93315844e359273bc7e5907cac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.200430 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b (DEFAULT_TABLE table=default.Table_ae3b18f018434e4a8b85ea267ae0b343 [id=5611ff8989764ec59ea7fb030f050031]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.210577 11895 tablet_service.cc:1468] Processing CreateTablet for tablet cba459a70a404cdead8d487e6b9f2eb7 (DEFAULT_TABLE table=default.Table_87b14d45472a4fcd9d299d7071ec42fd [id=5847927d6c4248b5809fcb8236c59a6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.210752 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.210793 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba459a70a404cdead8d487e6b9f2eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.200559 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 66e71a05333f425aa3c82a817269eb48 (DEFAULT_TABLE table=default.Table_8aaa44063346451f85e8a9b9742de378 [id=5083149497314b798d32d8cc76917b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.212152 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e71a05333f425aa3c82a817269eb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.200645 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 60414f22c3bd4938b11c678197e0b34c (DEFAULT_TABLE table=default.Table_6d0b9ebb9ed4411394d69c7220244814 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.213537 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60414f22c3bd4938b11c678197e0b34c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.200860 11760 tablet_service.cc:1468] Processing CreateTablet for tablet a95691b366be4e5e8b697bca3dede838 (DEFAULT_TABLE table=default.Table_4cb1c030a37648f0aaffe6805c232499 [id=2f09f58674bc4a0c9fa7099c141c7da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.214818 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95691b366be4e5e8b697bca3dede838. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.215422 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 31157f3bd20f4db5a0baa05b61d92f87 (table default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7]). Expected version 1 got 0
I20250625 14:02:00.201267 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 9d8501126146425baa26ba7741963085 (DEFAULT_TABLE table=default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.216363 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8501126146425baa26ba7741963085. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.193353 11757 tablet_service.cc:1468] Processing CreateTablet for tablet ffa9f78bdf1a478bb201d672fc9e92d4 (DEFAULT_TABLE table=default.Table_e63fe2c5df514e2da6f77363d9dec47c [id=585ca10918184c6cb00eef025d133250]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.217747 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa9f78bdf1a478bb201d672fc9e92d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.218703 13121 raft_consensus.cc:491] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.218834 13121 raft_consensus.cc:513] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.219378 13121 leader_election.cc:290] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:00.221066 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d666f4b403435287f4157bda971193" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:02:00.221549 11993 leader_election.cc:343] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.221629 13232 consensus_queue.cc:1035] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.221908 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.226190 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 0f6c287461864f6dba5f47711eb69fae from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.227312 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet fb8c57c541114222b81dff868b1529f6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.227490 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 31157f3bd20f4db5a0baa05b61d92f87 (table default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7]). Expected version 1 got 0
I20250625 14:02:00.228302 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_aed5f4ab57624e84b4109fefaa440e45" } new_table_name: "default.Table_16248c1613424ffabcdbfd0173d5678b" modify_external_catalogs: true
I20250625 14:02:00.228547 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d666f4b403435287f4157bda971193" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:00.229123 11990 leader_election.cc:343] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.229225 11990 leader_election.cc:304] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.229529 13121 raft_consensus.cc:2747] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.230667 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3e08079d38cf40059efef8250ccd265a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.230724 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3070f1e3d3144cd5b14c7c3542aa8b98" } new_table_name: "default.Table_a1847486e8ab4e649e6909889d91d4cd" modify_external_catalogs: true
W20250625 14:02:00.231204 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e08079d38cf40059efef8250ccd265a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.234289 12172 tablet_bootstrap.cc:492] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.234437 12172 ts_tablet_manager.cc:1397] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.000s
I20250625 14:02:00.234858 12172 raft_consensus.cc:357] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.234963 12172 raft_consensus.cc:383] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.234993 12172 raft_consensus.cc:738] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.235105 12172 consensus_queue.cc:260] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.235356 12172 ts_tablet_manager.cc:1428] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.235529 12172 tablet_bootstrap.cc:492] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.236392 12172 tablet_bootstrap.cc:654] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.242043 13121 raft_consensus.cc:491] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.242163 13121 raft_consensus.cc:513] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:00.242573 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2f25aaee07242329014de1834ca881d consensus state has no leader
I20250625 14:02:00.242622 13121 leader_election.cc:290] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.243264 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3e8c6789c3b14bc88c2538c34d72a3a4" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.243330 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet fb8c57c541114222b81dff868b1529f6
I20250625 14:02:00.243613 11525 catalog_manager.cc:6652] ReplaceTablet: tablet fb8c57c541114222b81dff868b1529f6 deleted and replaced by tablet 42dc321e5fd740268dd3b9f19e8231fa
W20250625 14:02:00.243920 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe456db1a0d34efab1a711b18637ae48 consensus state has no leader
I20250625 14:02:00.244156 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3e8c6789c3b14bc88c2538c34d72a3a4" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.244243 12177 ts_tablet_manager.cc:1939] T be4378f7781541d7866e6d5c440b13e6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.244436 11919 raft_consensus.cc:2391] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:00.244776 11990 leader_election.cc:304] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.244958 13121 raft_consensus.cc:3058] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.246145 13121 raft_consensus.cc:2747] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.246435 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet fb8c57c541114222b81dff868b1529f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 42dc321e5fd740268dd3b9f19e8231fa) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.247416 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet be4378f7781541d7866e6d5c440b13e6 (table default.Table_c0aa8bb1b9b2417aa42dddc6bc8d31b0 [id=033b59dd293a483e9ecda65417ceecf4]) successfully deleted
I20250625 14:02:00.248090 12177 tablet_replica.cc:331] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.248236 12177 raft_consensus.cc:2241] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.248374 12177 raft_consensus.cc:2270] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.248777 12177 ts_tablet_manager.cc:1905] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.251070 12034 tablet_service.cc:1468] Processing CreateTablet for tablet cba459a70a404cdead8d487e6b9f2eb7 (DEFAULT_TABLE table=default.Table_87b14d45472a4fcd9d299d7071ec42fd [id=5847927d6c4248b5809fcb8236c59a6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.251132 12172 tablet_bootstrap.cc:492] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.251225 12172 ts_tablet_manager.cc:1397] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20250625 14:02:00.251489 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba459a70a404cdead8d487e6b9f2eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.251724 12172 raft_consensus.cc:357] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.251850 12172 raft_consensus.cc:383] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.251899 12172 raft_consensus.cc:738] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.252040 12172 consensus_queue.cc:260] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.252336 12172 ts_tablet_manager.cc:1428] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.252552 12172 tablet_bootstrap.cc:492] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.253517 12172 tablet_bootstrap.cc:654] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.254645 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 4a66ca083967486a9b9e3f0885186125 (DEFAULT_TABLE table=default.Table_01aa57734c14479888e1455726901848 [id=116dbbda20c24b93b3eb465e1e6b963c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.254880 11753 tablet_service.cc:1468] Processing CreateTablet for tablet e70872e37db54f33a1b7104bcadb3bfe (DEFAULT_TABLE table=default.Table_b07b7a38e2f545e1ab85d255b7755f84 [id=ebba5b70b3ec45e5a3357f1ac8825cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.255468 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 73d3bdd12c6c486ab7bca3b7965851c4 (DEFAULT_TABLE table=default.Table_f756287c134b4c38ab1d827f5ca750fa [id=212f614d4ce643e0972f2792fa076c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.256337 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0f6c287461864f6dba5f47711eb69fae
I20250625 14:02:00.256668 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 0f6c287461864f6dba5f47711eb69fae deleted and replaced by tablet 59556a6da95144f88aa806a7febd6a58
I20250625 14:02:00.258080 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f6c287461864f6dba5f47711eb69fae with delete_type TABLET_DATA_DELETED (replaced by tablet 59556a6da95144f88aa806a7febd6a58) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.260278 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70872e37db54f33a1b7104bcadb3bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.262833 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d3bdd12c6c486ab7bca3b7965851c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.264725 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a66ca083967486a9b9e3f0885186125. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.266697 12177 ts_tablet_manager.cc:1918] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.266850 12177 log.cc:1199] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d74f27d998b14ee890272812b718e468
I20250625 14:02:00.266850 11895 tablet_service.cc:1468] Processing CreateTablet for tablet e9de91633ba3404d9002d4f27449ea48 (DEFAULT_TABLE table=default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.266961 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet be4378f7781541d7866e6d5c440b13e6 (table default.Table_c0aa8bb1b9b2417aa42dddc6bc8d31b0 [id=033b59dd293a483e9ecda65417ceecf4]) successfully deleted
W20250625 14:02:00.267129 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 881295234a5b4a089985382765774cd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 881295234a5b4a089985382765774cd9 already in progress: creating tablet
I20250625 14:02:00.267239 12177 ts_tablet_manager.cc:1939] T d74f27d998b14ee890272812b718e468 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.267421 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9de91633ba3404d9002d4f27449ea48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.268174 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.268450 12177 tablet_replica.cc:331] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.268467 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 7c68ae7ecff34d34baaffe47c740bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.268524 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet c2307a7c00204e8fa1a14b5112659d91 with delete_type TABLET_DATA_DELETED (replaced by tablet 7491e070e86346b681817fb19d4608f9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.268532 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d74f27d998b14ee890272812b718e468 (table default.Table_7eea033a0ebc4712a45ee52653e09a47 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]) successfully deleted
I20250625 14:02:00.268589 12177 raft_consensus.cc:2241] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:00.268771 12177 raft_consensus.cc:2270] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:00.268751 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a36ed3e126ef4edfa69fcffb098d0e4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36ed3e126ef4edfa69fcffb098d0e4f already in progress: creating tablet
I20250625 14:02:00.268816 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d41c8cea082478d9cc16c143b3a3f7a with delete_type TABLET_DATA_DELETED (replaced by tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.269161 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet cc9e2afd5bc443398293d0ed572f6c05 with delete_type TABLET_DATA_DELETED (replaced by tablet a05b09a3225f45db841978b7b9b1fe51) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.269171 12177 ts_tablet_manager.cc:1905] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.270764 12172 tablet_bootstrap.cc:492] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.270848 12172 ts_tablet_manager.cc:1397] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250625 14:02:00.270797 11524 catalog_manager.cc:5582] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:00.271353 12172 raft_consensus.cc:357] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.271471 12172 raft_consensus.cc:383] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.271503 12172 raft_consensus.cc:738] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.271507 12177 ts_tablet_manager.cc:1918] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.271589 12177 log.cc:1199] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/fb8c57c541114222b81dff868b1529f6
I20250625 14:02:00.271651 12172 consensus_queue.cc:260] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.271978 12172 ts_tablet_manager.cc:1428] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.272138 12172 tablet_bootstrap.cc:492] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.272279 13121 consensus_queue.cc:1035] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.273105 12172 tablet_bootstrap.cc:654] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.276464 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]). Expected version 1 got 0
I20250625 14:02:00.277755 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet d74f27d998b14ee890272812b718e468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.278553 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet d74f27d998b14ee890272812b718e468 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.273723 12177 ts_tablet_manager.cc:1939] T fb8c57c541114222b81dff868b1529f6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.275264 11764 tablet_service.cc:1468] Processing CreateTablet for tablet a30b1d5e2baa47b99722ca28f5f92999 (DEFAULT_TABLE table=default.Table_0f101fb3f05348f8a75533a4ce961e14 [id=20bb90be3498475f97d7616348fa2311]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.278523 11893 tablet_service.cc:1468] Processing CreateTablet for tablet ffa9f78bdf1a478bb201d672fc9e92d4 (DEFAULT_TABLE table=default.Table_e63fe2c5df514e2da6f77363d9dec47c [id=585ca10918184c6cb00eef025d133250]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.278848 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30b1d5e2baa47b99722ca28f5f92999. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.278852 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa9f78bdf1a478bb201d672fc9e92d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.279062 12037 tablet_service.cc:1468] Processing CreateTablet for tablet ffa9f78bdf1a478bb201d672fc9e92d4 (DEFAULT_TABLE table=default.Table_e63fe2c5df514e2da6f77363d9dec47c [id=585ca10918184c6cb00eef025d133250]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.279323 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa9f78bdf1a478bb201d672fc9e92d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.275496 11753 tablet_service.cc:1468] Processing CreateTablet for tablet e93e37ffd0804212999cc2bf8770c39c (DEFAULT_TABLE table=default.Table_ed61cf3246304810aa1b1096735c602b [id=cabcf5d77a8e451ab385b7b7a2212563]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.281217 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93e37ffd0804212999cc2bf8770c39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.281805 12175 tablet_replica.cc:331] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.282030 12175 raft_consensus.cc:2241] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:00.282228 12175 raft_consensus.cc:2270] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.282655 12175 ts_tablet_manager.cc:1905] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.275707 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 42dc321e5fd740268dd3b9f19e8231fa (DEFAULT_TABLE table=default.Table_899a1eb5d58f478a87063fafb95aa819 [id=83f715a6270c49f7b0986d2b05d73b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.284126 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42dc321e5fd740268dd3b9f19e8231fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.285051 12175 ts_tablet_manager.cc:1918] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.285122 12175 log.cc:1199] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d74f27d998b14ee890272812b718e468
I20250625 14:02:00.285419 12175 ts_tablet_manager.cc:1939] T d74f27d998b14ee890272812b718e468 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.286041 12172 tablet_bootstrap.cc:492] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.286134 12172 ts_tablet_manager.cc:1397] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:00.286638 12172 raft_consensus.cc:357] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.286751 12172 raft_consensus.cc:383] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.286801 12172 raft_consensus.cc:738] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.286921 12172 consensus_queue.cc:260] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.287196 12172 ts_tablet_manager.cc:1428] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.287392 12172 tablet_bootstrap.cc:492] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.288481 12172 tablet_bootstrap.cc:654] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.290283 12173 ts_tablet_manager.cc:1905] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.291165 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_30d2b65a1ea44e8095e36aea0cc2de45" } new_table_name: "default.Table_e319c6aae5194eb79ac913a7be44ce20" modify_external_catalogs: true
I20250625 14:02:00.291838 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8174031405c64209bd73d2acaf79cf10" } modify_external_catalogs: true
I20250625 14:02:00.291967 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8174031405c64209bd73d2acaf79cf10" } modify_external_catalogs: true
I20250625 14:02:00.292203 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_89bc204107184f1aae8f924ca65ecd16" } modify_external_catalogs: true
I20250625 14:02:00.292315 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_89bc204107184f1aae8f924ca65ecd16" } modify_external_catalogs: true
I20250625 14:02:00.293454 13121 raft_consensus.cc:491] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.293552 13121 raft_consensus.cc:513] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.293939 13121 leader_election.cc:290] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.294529 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1df220bf9c8447c5ac4ad35a145a8796" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.275838 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 91669e7574f54b41a13c6f80583cd12b (DEFAULT_TABLE table=default.Table_3e08079d38cf40059efef8250ccd265a [id=0d992c33ce0b423c929715138cdb2237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.294667 11921 raft_consensus.cc:2466] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:00.294873 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91669e7574f54b41a13c6f80583cd12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.294986 11990 leader_election.cc:304] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.295181 13121 raft_consensus.cc:2802] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.295243 13121 raft_consensus.cc:491] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.295277 13121 raft_consensus.cc:3058] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.275877 11760 tablet_service.cc:1468] Processing CreateTablet for tablet b4929957b34544549ed3996de581bfbb (DEFAULT_TABLE table=default.Table_c7d281ee1d5647d999a0702ce64779dc [id=3c0002033ae044b5abb9a9adc198b603]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.295629 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4929957b34544549ed3996de581bfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.296293 13121 raft_consensus.cc:513] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.296711 13121 leader_election.cc:290] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.296923 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1df220bf9c8447c5ac4ad35a145a8796" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.297051 11780 raft_consensus.cc:2466] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:00.297091 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1df220bf9c8447c5ac4ad35a145a8796" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.297166 11784 raft_consensus.cc:3058] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.298123 11784 raft_consensus.cc:2466] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:00.298547 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1df220bf9c8447c5ac4ad35a145a8796" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:00.298681 11921 raft_consensus.cc:3058] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.299742 11921 raft_consensus.cc:2466] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:00.300282 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c035179702eb4c5f884ec0bdf2261562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.300465 11993 leader_election.cc:304] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
W20250625 14:02:00.300742 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c035179702eb4c5f884ec0bdf2261562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.300896 13121 raft_consensus.cc:2802] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.301008 13121 raft_consensus.cc:695] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:00.301162 13121 consensus_queue.cc:237] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.301774 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a8c0fd4a04d048d99042fe2c45a547b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.302179 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8c0fd4a04d048d99042fe2c45a547b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.304634 13334 consensus_queue.cc:1035] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:00.304883 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be019f453cab42fa88936c587ca623fa consensus state has no leader
I20250625 14:02:00.305753 13334 consensus_queue.cc:1035] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.307008 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_056ad2bdca0a4a0bbd86417dcb233492"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.307410 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_056ad2bdca0a4a0bbd86417dcb233492 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.310133 13121 consensus_queue.cc:1035] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.310609 12172 tablet_bootstrap.cc:492] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.310706 12172 ts_tablet_manager.cc:1397] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:02:00.311321 12172 raft_consensus.cc:357] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.311440 12172 raft_consensus.cc:383] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.311477 12172 raft_consensus.cc:738] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.311614 12172 consensus_queue.cc:260] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.311918 12172 ts_tablet_manager.cc:1428] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.312110 12172 tablet_bootstrap.cc:492] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.312115 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3f92afb1db03462ba4957327934a6f31" } modify_external_catalogs: true
I20250625 14:02:00.312237 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3f92afb1db03462ba4957327934a6f31" } modify_external_catalogs: true
I20250625 14:02:00.313148 12172 tablet_bootstrap.cc:654] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.316561 13121 consensus_queue.cc:1035] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.318639 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b (DEFAULT_TABLE table=default.Table_ae3b18f018434e4a8b85ea267ae0b343 [id=5611ff8989764ec59ea7fb030f050031]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.318939 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.317113 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b (DEFAULT_TABLE table=default.Table_ae3b18f018434e4a8b85ea267ae0b343 [id=5611ff8989764ec59ea7fb030f050031]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.319883 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.321566 13121 consensus_queue.cc:1035] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.322641 12558 raft_consensus.cc:491] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.322721 12558 raft_consensus.cc:513] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.323093 12558 leader_election.cc:290] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.323818 12167 tablet_bootstrap.cc:492] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.323917 12167 ts_tablet_manager.cc:1397] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.197s user 0.002s sys 0.000s
I20250625 14:02:00.323917 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 60414f22c3bd4938b11c678197e0b34c (DEFAULT_TABLE table=default.Table_6d0b9ebb9ed4411394d69c7220244814 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.324196 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60414f22c3bd4938b11c678197e0b34c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.324234 11902 tablet_service.cc:1468] Processing CreateTablet for tablet a95691b366be4e5e8b697bca3dede838 (DEFAULT_TABLE table=default.Table_4cb1c030a37648f0aaffe6805c232499 [id=2f09f58674bc4a0c9fa7099c141c7da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.324338 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 73a40d0ee5034aaea24684739c3f5154 (DEFAULT_TABLE table=default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.324448 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95691b366be4e5e8b697bca3dede838. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.324616 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a40d0ee5034aaea24684739c3f5154. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.324596 12167 raft_consensus.cc:357] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.324716 12167 raft_consensus.cc:383] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.324746 12167 raft_consensus.cc:738] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.324841 12167 consensus_queue.cc:260] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.325148 12167 ts_tablet_manager.cc:1428] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.325320 12167 tablet_bootstrap.cc:492] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.326753 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51440ec50d1c4dc89644b0be321d6f73" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.326872 12056 raft_consensus.cc:2466] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.327395 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51440ec50d1c4dc89644b0be321d6f73" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.327522 11780 raft_consensus.cc:2466] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.327658 11855 leader_election.cc:304] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.327917 12036 tablet_service.cc:1468] Processing CreateTablet for tablet a95691b366be4e5e8b697bca3dede838 (DEFAULT_TABLE table=default.Table_4cb1c030a37648f0aaffe6805c232499 [id=2f09f58674bc4a0c9fa7099c141c7da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.328039 12558 raft_consensus.cc:2802] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.328094 12558 raft_consensus.cc:491] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.328145 12558 raft_consensus.cc:3058] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.328191 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95691b366be4e5e8b697bca3dede838. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.328222 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 73a40d0ee5034aaea24684739c3f5154 (DEFAULT_TABLE table=default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.328413 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a40d0ee5034aaea24684739c3f5154. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.329053 12558 raft_consensus.cc:513] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.329427 12558 leader_election.cc:290] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.329962 12167 tablet_bootstrap.cc:654] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.330816 13121 raft_consensus.cc:491] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.330899 13121 raft_consensus.cc:513] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.330940 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51440ec50d1c4dc89644b0be321d6f73" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.331044 12056 raft_consensus.cc:3058] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.331295 13121 leader_election.cc:290] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.332027 12056 raft_consensus.cc:2466] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.332120 12167 tablet_bootstrap.cc:492] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.332281 12167 ts_tablet_manager.cc:1397] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20250625 14:02:00.332348 11855 leader_election.cc:304] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.332543 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4de2eeaf84084fbda097aa8c0eef2341" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.332683 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 66e71a05333f425aa3c82a817269eb48 (DEFAULT_TABLE table=default.Table_8aaa44063346451f85e8a9b9742de378 [id=5083149497314b798d32d8cc76917b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.332705 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 60414f22c3bd4938b11c678197e0b34c (DEFAULT_TABLE table=default.Table_6d0b9ebb9ed4411394d69c7220244814 [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.332937 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60414f22c3bd4938b11c678197e0b34c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.332948 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e71a05333f425aa3c82a817269eb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.333091 12167 raft_consensus.cc:357] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.333180 12167 raft_consensus.cc:383] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.333211 12167 raft_consensus.cc:738] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.333369 12167 consensus_queue.cc:260] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.333566 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4de2eeaf84084fbda097aa8c0eef2341" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.333652 12167 ts_tablet_manager.cc:1428] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.334173 12167 tablet_bootstrap.cc:492] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.335103 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "51440ec50d1c4dc89644b0be321d6f73" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.335242 11781 raft_consensus.cc:3058] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.335284 12558 raft_consensus.cc:2802] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.335364 12558 raft_consensus.cc:695] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:00.335496 12558 consensus_queue.cc:237] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.332682 11920 raft_consensus.cc:2391] T 4de2eeaf84084fbda097aa8c0eef2341 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:00.336687 11990 leader_election.cc:304] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.336779 11781 raft_consensus.cc:2466] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.337083 13121 raft_consensus.cc:3058] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.338003 13121 raft_consensus.cc:2747] T 4de2eeaf84084fbda097aa8c0eef2341 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.338239 12167 tablet_bootstrap.cc:654] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.338939 12034 tablet_service.cc:1468] Processing CreateTablet for tablet e9de91633ba3404d9002d4f27449ea48 (DEFAULT_TABLE table=default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.340701 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9de91633ba3404d9002d4f27449ea48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.340817 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet c4c32692666047fe9a18a75e66365e16 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.340889 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet fb8c57c541114222b81dff868b1529f6 (table default.Table_899a1eb5d58f478a87063fafb95aa819 [id=83f715a6270c49f7b0986d2b05d73b44]) successfully deleted
W20250625 14:02:00.341043 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 0f6c287461864f6dba5f47711eb69fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f6c287461864f6dba5f47711eb69fae already in progress: creating tablet
I20250625 14:02:00.341315 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 4f651f79ee034dd28e44092b7de29bf3 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.343314 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 66e71a05333f425aa3c82a817269eb48 (DEFAULT_TABLE table=default.Table_8aaa44063346451f85e8a9b9742de378 [id=5083149497314b798d32d8cc76917b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.343752 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 9d8501126146425baa26ba7741963085 (DEFAULT_TABLE table=default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.344025 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8501126146425baa26ba7741963085. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.344871 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.345098 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 9d8501126146425baa26ba7741963085 (DEFAULT_TABLE table=default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.345302 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.345451 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.346700 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8501126146425baa26ba7741963085. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.346843 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet fb8c57c541114222b81dff868b1529f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 42dc321e5fd740268dd3b9f19e8231fa) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.347604 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 73d3bdd12c6c486ab7bca3b7965851c4 (DEFAULT_TABLE table=default.Table_f756287c134b4c38ab1d827f5ca750fa [id=212f614d4ce643e0972f2792fa076c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.347754 12056 raft_consensus.cc:1273] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:00.347889 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d3bdd12c6c486ab7bca3b7965851c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.349392 11781 raft_consensus.cc:1273] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:00.349541 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet fb8c57c541114222b81dff868b1529f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 42dc321e5fd740268dd3b9f19e8231fa) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.349891 12558 consensus_queue.cc:1035] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.350183 12265 consensus_queue.cc:1035] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.350914 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e71a05333f425aa3c82a817269eb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.353534 11892 tablet_service.cc:1468] Processing CreateTablet for tablet e70872e37db54f33a1b7104bcadb3bfe (DEFAULT_TABLE table=default.Table_b07b7a38e2f545e1ab85d255b7755f84 [id=ebba5b70b3ec45e5a3357f1ac8825cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.353675 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet fee20f2812d34d188b7181e6da00f823
I20250625 14:02:00.354377 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 73d3bdd12c6c486ab7bca3b7965851c4 (DEFAULT_TABLE table=default.Table_f756287c134b4c38ab1d827f5ca750fa [id=212f614d4ce643e0972f2792fa076c59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.354539 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70872e37db54f33a1b7104bcadb3bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.355988 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d3bdd12c6c486ab7bca3b7965851c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.356417 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet fee20f2812d34d188b7181e6da00f823 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.356962 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d2ab8a595872457fa3c4f0042a350248"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.357367 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2ab8a595872457fa3c4f0042a350248 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:00.358234 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet fee20f2812d34d188b7181e6da00f823 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fee20f2812d34d188b7181e6da00f823 already in progress: creating tablet
I20250625 14:02:00.360350 12953 tablet.cc:1722] T 432e55208a0f48b594a2fe564132cbf0 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:00.361052 13244 tablet.cc:1722] T 432e55208a0f48b594a2fe564132cbf0 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:00.362416 12034 tablet_service.cc:1468] Processing CreateTablet for tablet e70872e37db54f33a1b7104bcadb3bfe (DEFAULT_TABLE table=default.Table_b07b7a38e2f545e1ab85d255b7755f84 [id=ebba5b70b3ec45e5a3357f1ac8825cd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.362733 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70872e37db54f33a1b7104bcadb3bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.362905 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f6c287461864f6dba5f47711eb69fae with delete_type TABLET_DATA_DELETED (replaced by tablet 59556a6da95144f88aa806a7febd6a58) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.364743 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f6c287461864f6dba5f47711eb69fae with delete_type TABLET_DATA_DELETED (replaced by tablet 59556a6da95144f88aa806a7febd6a58) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.366575 11525 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]). Expected version 1 got 0
I20250625 14:02:00.366736 11525 catalog_manager.cc:5582] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:00.367080 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 59556a6da95144f88aa806a7febd6a58 (DEFAULT_TABLE table=default.Table_6913356853b04dcdbb871b449e350ffb [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.367393 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59556a6da95144f88aa806a7febd6a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.367739 12173 ts_tablet_manager.cc:1918] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.367810 12173 log.cc:1199] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/da5ed5d8d3ca4342980c893a8653d4a0
I20250625 14:02:00.368050 12173 ts_tablet_manager.cc:1939] T da5ed5d8d3ca4342980c893a8653d4a0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.371052 12172 tablet_bootstrap.cc:492] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.371158 12172 ts_tablet_manager.cc:1397] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
I20250625 14:02:00.371760 12172 raft_consensus.cc:357] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.371904 12172 raft_consensus.cc:383] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.371944 12172 raft_consensus.cc:738] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.372116 12172 consensus_queue.cc:260] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.372596 12172 ts_tablet_manager.cc:1428] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.372803 12172 tablet_bootstrap.cc:492] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.374764 12172 tablet_bootstrap.cc:654] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.374953 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c4c32692666047fe9a18a75e66365e16
I20250625 14:02:00.375203 11528 catalog_manager.cc:6652] ReplaceTablet: tablet c4c32692666047fe9a18a75e66365e16 deleted and replaced by tablet f8f4f4c9b85c4c08a386347b4164efa7
I20250625 14:02:00.378278 12172 tablet_bootstrap.cc:492] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.378412 12172 ts_tablet_manager.cc:1397] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20250625 14:02:00.378450 11528 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]). Expected version 1 got 0
I20250625 14:02:00.379256 12172 raft_consensus.cc:357] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.380353 12172 raft_consensus.cc:383] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.380403 12172 raft_consensus.cc:738] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.380807 12175 tablet_replica.cc:331] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.381002 12175 raft_consensus.cc:2241] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.381280 12175 raft_consensus.cc:2270] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.381790 12175 ts_tablet_manager.cc:1905] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.383788 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3e51886fcb0d40efbfbff1e57fc55cf0" } new_table_name: "default.Table_360fe7f59412486a937f42de9bb0bf9a" modify_external_catalogs: true
I20250625 14:02:00.384174 12175 ts_tablet_manager.cc:1918] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.384248 12175 log.cc:1199] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/1df220bf9c8447c5ac4ad35a145a8796
I20250625 14:02:00.384481 12175 ts_tablet_manager.cc:1939] T 1df220bf9c8447c5ac4ad35a145a8796 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.385210 12175 tablet_replica.cc:331] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.385510 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 84a1eb4471544de9afbb5b35d0071dcc
I20250625 14:02:00.386054 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4f651f79ee034dd28e44092b7de29bf3
I20250625 14:02:00.386355 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 4f651f79ee034dd28e44092b7de29bf3 deleted and replaced by tablet 06d9ec116e8e4206940860c88c23eed2
I20250625 14:02:00.387701 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 91669e7574f54b41a13c6f80583cd12b (DEFAULT_TABLE table=default.Table_3e08079d38cf40059efef8250ccd265a [id=0d992c33ce0b423c929715138cdb2237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.388070 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91669e7574f54b41a13c6f80583cd12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.388852 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 717254244e9b4cf399c231a37480a3a1
I20250625 14:02:00.383457 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet c4c32692666047fe9a18a75e66365e16 with delete_type TABLET_DATA_DELETED (replaced by tablet f8f4f4c9b85c4c08a386347b4164efa7) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.392776 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 with delete_type TABLET_DATA_DELETED (replaced by tablet 06d9ec116e8e4206940860c88c23eed2) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.380549 12172 consensus_queue.cc:260] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.390971 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.393116 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 717254244e9b4cf399c231a37480a3a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.393203 12172 ts_tablet_manager.cc:1428] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20250625 14:02:00.393383 12172 tablet_bootstrap.cc:492] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:00.394451 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c4c32692666047fe9a18a75e66365e16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4c32692666047fe9a18a75e66365e16 already in progress: creating tablet
W20250625 14:02:00.395531 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4f651f79ee034dd28e44092b7de29bf3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f651f79ee034dd28e44092b7de29bf3 already in progress: creating tablet
W20250625 14:02:00.395704 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 84a1eb4471544de9afbb5b35d0071dcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84a1eb4471544de9afbb5b35d0071dcc already in progress: creating tablet
W20250625 14:02:00.395823 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 717254244e9b4cf399c231a37480a3a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717254244e9b4cf399c231a37480a3a1 already in progress: creating tablet
W20250625 14:02:00.395946 11520 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet bf421457ab6c481f9fd6e18a9572ba5f (table default.Table_d61d2d203bec435bb70dc93c563fd08f [id=50267944f4e24298b94151d9f1a1563f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bf421457ab6c481f9fd6e18a9572ba5f consensus state has no leader
I20250625 14:02:00.398167 12173 tablet_replica.cc:331] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.398355 12173 raft_consensus.cc:2241] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:00.398521 12173 pending_rounds.cc:70] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:00.398557 12173 pending_rounds.cc:77] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523052755066880 op_type: NO_OP noop_request { }
I20250625 14:02:00.398619 12173 raft_consensus.cc:2887] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:00.398679 12173 raft_consensus.cc:2270] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.399219 12172 tablet_bootstrap.cc:654] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.400744 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3ef297edd2b74ada8037c6bc3018ccb8" } modify_external_catalogs: true
I20250625 14:02:00.400868 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3ef297edd2b74ada8037c6bc3018ccb8" } modify_external_catalogs: true
I20250625 14:02:00.403566 12167 tablet_bootstrap.cc:492] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.403586 12172 tablet_bootstrap.cc:492] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.403663 12167 ts_tablet_manager.cc:1397] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.000s
I20250625 14:02:00.403779 12172 ts_tablet_manager.cc:1397] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20250625 14:02:00.404114 12167 raft_consensus.cc:357] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.404258 12167 raft_consensus.cc:383] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.404296 12167 raft_consensus.cc:738] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.404417 12167 consensus_queue.cc:260] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.404479 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 128dab7ad46048cc91fc20ddc1431d57 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.404700 12167 ts_tablet_manager.cc:1428] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.404866 12167 tablet_bootstrap.cc:492] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.405834 12167 tablet_bootstrap.cc:654] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.408711 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_3b71d8796f7d48eb9dca00adb7224232 [id=c1f855079b614aa8b55e8ee6a87570e2] alter complete (version 2)
I20250625 14:02:00.413775 12172 raft_consensus.cc:357] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.414709 12173 ts_tablet_manager.cc:1905] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.414789 13241 tablet.cc:1722] T 432e55208a0f48b594a2fe564132cbf0 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:00.415807 12172 raft_consensus.cc:383] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.415863 12172 raft_consensus.cc:738] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.415997 12172 consensus_queue.cc:260] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.417804 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b9a788be0b8640dc9d6d06fa86580f6b
I20250625 14:02:00.418615 13121 raft_consensus.cc:491] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.418709 13121 raft_consensus.cc:513] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.419042 13121 leader_election.cc:290] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:00.419679 11990 leader_election.cc:343] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: d3cf1f09ba14436cbdce5a58da0f202d
I20250625 14:02:00.420167 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3cf1f09ba14436cbdce5a58da0f202d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.420293 11781 raft_consensus.cc:2466] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:00.420655 11993 leader_election.cc:304] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:00.420951 12172 ts_tablet_manager.cc:1428] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.017s user 0.000s sys 0.001s
I20250625 14:02:00.420967 13121 raft_consensus.cc:2802] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.421017 13121 raft_consensus.cc:491] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.421051 13121 raft_consensus.cc:3058] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.421166 12172 tablet_bootstrap.cc:492] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.421808 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.422060 13121 raft_consensus.cc:513] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.422447 13121 leader_election.cc:290] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:00.424010 11990 leader_election.cc:343] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: d3cf1f09ba14436cbdce5a58da0f202d
I20250625 14:02:00.424474 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0d17996fd693448e97e67565ee825f38" } modify_external_catalogs: true
I20250625 14:02:00.424602 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0d17996fd693448e97e67565ee825f38" } modify_external_catalogs: true
I20250625 14:02:00.425824 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a1847486e8ab4e649e6909889d91d4cd" } new_table_name: "default.Table_79e56ade55d141c3a4c20177f5e8abda" modify_external_catalogs: true
W20250625 14:02:00.426131 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b9a788be0b8640dc9d6d06fa86580f6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a788be0b8640dc9d6d06fa86580f6b already in progress: creating tablet
I20250625 14:02:00.426483 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f5427083312e42a9b3320e8d5639dc1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.426870 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5427083312e42a9b3320e8d5639dc1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.426966 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4b8ec3648e404bb1912ff6fb5556c97a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.427294 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b8ec3648e404bb1912ff6fb5556c97a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.427599 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d3cf1f09ba14436cbdce5a58da0f202d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.427706 11781 raft_consensus.cc:3058] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.428752 11781 raft_consensus.cc:2466] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:00.429216 12034 tablet_service.cc:1468] Processing CreateTablet for tablet a30b1d5e2baa47b99722ca28f5f92999 (DEFAULT_TABLE table=default.Table_0f101fb3f05348f8a75533a4ce961e14 [id=20bb90be3498475f97d7616348fa2311]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.429450 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30b1d5e2baa47b99722ca28f5f92999. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.431027 12208 raft_consensus.cc:491] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.431123 12208 raft_consensus.cc:513] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.431509 12208 leader_election.cc:290] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.433168 11993 leader_election.cc:304] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:00.433177 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d666f4b403435287f4157bda971193" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.433336 12042 raft_consensus.cc:2466] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:00.433418 13121 raft_consensus.cc:2802] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.433491 13121 raft_consensus.cc:695] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:00.433602 13121 consensus_queue.cc:237] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:00.433952 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe456db1a0d34efab1a711b18637ae48 consensus state has no leader
I20250625 14:02:00.434448 12034 tablet_service.cc:1468] Processing CreateTablet for tablet e93e37ffd0804212999cc2bf8770c39c (DEFAULT_TABLE table=default.Table_ed61cf3246304810aa1b1096735c602b [id=cabcf5d77a8e451ab385b7b7a2212563]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.434792 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93e37ffd0804212999cc2bf8770c39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.436367 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_70428e9afd4743d6be12e15dc759b401"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.436762 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70428e9afd4743d6be12e15dc759b401 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.437747 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2303b18799734fd38bfdd72a4f2a2348"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.438050 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2303b18799734fd38bfdd72a4f2a2348 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.440111 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 292e9c27637d410ea487761f50bdee88
I20250625 14:02:00.440658 11717 leader_election.cc:304] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:00.440786 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 6d2adc01621f40b8bebd532ad491df2f (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.441150 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2adc01621f40b8bebd532ad491df2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.441195 13334 raft_consensus.cc:2802] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.441252 13334 raft_consensus.cc:491] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.441294 13334 raft_consensus.cc:3058] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.442263 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1048fffd9fb1451d97ec6c51a7b3a2ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.442693 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1048fffd9fb1451d97ec6c51a7b3a2ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.442747 13334 raft_consensus.cc:513] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.443140 13334 leader_election.cc:290] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.444154 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d666f4b403435287f4157bda971193" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.444290 12042 raft_consensus.cc:3058] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.445442 12042 raft_consensus.cc:2466] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:00.447016 11717 leader_election.cc:304] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:00.447345 12208 raft_consensus.cc:2802] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.447444 12208 raft_consensus.cc:695] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:00.447588 12208 consensus_queue.cc:237] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.449329 12172 tablet_bootstrap.cc:654] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.450783 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a6705ab73c6b41b983cb216b9ecf344f" } new_table_name: "default.Table_3e48d799a62948839f3467f7aafcbc0e" modify_external_catalogs: true
I20250625 14:02:00.449373 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 292e9c27637d410ea487761f50bdee88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.452667 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cf7e033c21a74df9b4b8690ce30c808a" } new_table_name: "default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe" modify_external_catalogs: true
I20250625 14:02:00.452764 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1e9b59f503d94b5cbb6c623f66e91d46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.453121 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e9b59f503d94b5cbb6c623f66e91d46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:00.454151 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 292e9c27637d410ea487761f50bdee88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 292e9c27637d410ea487761f50bdee88 already in progress: creating tablet
I20250625 14:02:00.455576 12208 consensus_queue.cc:1035] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.458498 13241 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:00.459028 13244 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:00.459721 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:02:00.466938 12172 tablet_bootstrap.cc:492] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.467058 12172 ts_tablet_manager.cc:1397] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.000s
I20250625 14:02:00.467604 12172 raft_consensus.cc:357] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.467726 12172 raft_consensus.cc:383] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.467761 12172 raft_consensus.cc:738] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.467957 12172 consensus_queue.cc:260] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.468319 12172 ts_tablet_manager.cc:1428] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:00.468524 12172 tablet_bootstrap.cc:492] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.468990 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 39b41ff066cb499fae9b71ca1f2f9d2b from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.469663 12172 tablet_bootstrap.cc:654] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.471573 12172 tablet_bootstrap.cc:492] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.471679 12172 ts_tablet_manager.cc:1397] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:00.472177 12172 raft_consensus.cc:357] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.472213 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 3d5c9b7412d148a38fd61eb4629db359 (DEFAULT_TABLE table=default.Table_a8c0fd4a04d048d99042fe2c45a547b3 [id=7e9285e4315b44d8b6b08f143261c14f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.472295 12172 raft_consensus.cc:383] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.472337 12172 raft_consensus.cc:738] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.472479 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5c9b7412d148a38fd61eb4629db359. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.472460 12172 consensus_queue.cc:260] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.472743 12172 ts_tablet_manager.cc:1428] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.472965 12172 tablet_bootstrap.cc:492] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.474237 12172 tablet_bootstrap.cc:654] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.475407 12172 tablet_bootstrap.cc:492] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.475502 12172 ts_tablet_manager.cc:1397] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:00.475921 12172 raft_consensus.cc:357] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.476032 12172 raft_consensus.cc:383] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.476065 12172 raft_consensus.cc:738] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.476183 12172 consensus_queue.cc:260] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.476469 12172 ts_tablet_manager.cc:1428] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:00.476686 12172 tablet_bootstrap.cc:492] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.477624 12172 tablet_bootstrap.cc:654] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.475407 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 51b8945fea564468a76b4aa7feb90844 (DEFAULT_TABLE table=default.Table_c035179702eb4c5f884ec0bdf2261562 [id=7ec4ea02f115465fbb6fab1fee07fa26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.478221 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b8945fea564468a76b4aa7feb90844. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.479285 12172 tablet_bootstrap.cc:492] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.479368 12172 ts_tablet_manager.cc:1397] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:00.479853 12172 raft_consensus.cc:357] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.479950 12172 raft_consensus.cc:383] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.479981 12172 raft_consensus.cc:738] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.480094 12172 consensus_queue.cc:260] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.480412 12172 ts_tablet_manager.cc:1428] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.480574 12172 tablet_bootstrap.cc:492] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.481568 12172 tablet_bootstrap.cc:654] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:00.482393 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a951fa8b0cab485f9c221367c029fa4a consensus state has no leader
W20250625 14:02:00.482388 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9ed052ae88e4b679ac55177a3bbab88 consensus state has no leader
I20250625 14:02:00.487300 13121 raft_consensus.cc:491] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.487404 13121 raft_consensus.cc:513] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.487798 13121 leader_election.cc:290] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:00.488674 11990 leader_election.cc:343] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: c2307a7c00204e8fa1a14b5112659d91
I20250625 14:02:00.490716 12208 consensus_queue.cc:1035] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.490898 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:02:00.491046 12172 tablet_bootstrap.cc:492] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.491211 12172 ts_tablet_manager.cc:1397] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:02:00.491298 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 096c166fc3b84bcf94b1565683bdbb38 (DEFAULT_TABLE table=default.Table_d2ab8a595872457fa3c4f0042a350248 [id=71999d8db1e744eda5c69d85dcd9fd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.491544 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096c166fc3b84bcf94b1565683bdbb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.491729 12172 raft_consensus.cc:357] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.491830 12172 raft_consensus.cc:383] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.491860 12172 raft_consensus.cc:738] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.491983 12172 consensus_queue.cc:260] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.492311 12172 ts_tablet_manager.cc:1428] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.492497 12172 tablet_bootstrap.cc:492] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.493574 12172 tablet_bootstrap.cc:654] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.491032 11752 tablet_service.cc:1468] Processing CreateTablet for tablet eb0b39be1dc840589bdd06609e082fda (DEFAULT_TABLE table=default.Table_2303b18799734fd38bfdd72a4f2a2348 [id=f9fa89a2028d4c18a95898ea61c2978a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.494382 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0b39be1dc840589bdd06609e082fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.494824 12172 tablet_bootstrap.cc:492] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.494921 12172 ts_tablet_manager.cc:1397] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:00.495420 12172 raft_consensus.cc:357] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.495533 12172 raft_consensus.cc:383] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.495574 12172 raft_consensus.cc:738] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.495712 12172 consensus_queue.cc:260] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.495975 12172 ts_tablet_manager.cc:1428] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.496166 12172 tablet_bootstrap.cc:492] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.496359 11753 tablet_service.cc:1468] Processing CreateTablet for tablet f8f4f4c9b85c4c08a386347b4164efa7 (DEFAULT_TABLE table=default.Table_312ca07ca7b941c4a2dae1ae52c46b56 [id=44291c78dc3e4c0b9f1e81a9b8907e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.496582 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f4f4c9b85c4c08a386347b4164efa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.497359 12172 tablet_bootstrap.cc:654] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.498180 12034 tablet_service.cc:1468] Processing CreateTablet for tablet b4929957b34544549ed3996de581bfbb (DEFAULT_TABLE table=default.Table_c7d281ee1d5647d999a0702ce64779dc [id=3c0002033ae044b5abb9a9adc198b603]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.498515 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4929957b34544549ed3996de581bfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.500205 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 42dc321e5fd740268dd3b9f19e8231fa (DEFAULT_TABLE table=default.Table_899a1eb5d58f478a87063fafb95aa819 [id=83f715a6270c49f7b0986d2b05d73b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.500458 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42dc321e5fd740268dd3b9f19e8231fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.500808 11753 tablet_service.cc:1468] Processing CreateTablet for tablet a946bcadbab746a69df1a7b35682331e (DEFAULT_TABLE table=default.Table_4b8ec3648e404bb1912ff6fb5556c97a [id=fc78e469e09e4620815c1118b0aadfd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.501034 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a946bcadbab746a69df1a7b35682331e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.501768 12173 ts_tablet_manager.cc:1918] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:00.501833 12173 log.cc:1199] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/1df220bf9c8447c5ac4ad35a145a8796
I20250625 14:02:00.502650 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet fee20f2812d34d188b7181e6da00f823 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.503057 11756 tablet_service.cc:1468] Processing CreateTablet for tablet daa6fd92afb34a70a671b8801173b5f4 (DEFAULT_TABLE table=default.Table_70428e9afd4743d6be12e15dc759b401 [id=e87be68518224b468229f8c803bf60de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.503523 12172 tablet_bootstrap.cc:492] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.503631 12172 ts_tablet_manager.cc:1397] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250625 14:02:00.504127 12172 raft_consensus.cc:357] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.504247 12172 raft_consensus.cc:383] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.504276 12172 raft_consensus.cc:738] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.504313 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 06d9ec116e8e4206940860c88c23eed2 (DEFAULT_TABLE table=default.Table_c055b1e8e56d4bd595e2312996eb6b5e [id=45522461146c457ebfe600569a8c8524]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.504395 12172 consensus_queue.cc:260] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.504678 12172 ts_tablet_manager.cc:1428] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.504856 12172 tablet_bootstrap.cc:492] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:00.504878 11993 leader_election.cc:343] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: c2307a7c00204e8fa1a14b5112659d91
I20250625 14:02:00.504971 11993 leader_election.cc:304] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.505105 11760 tablet_service.cc:1468] Processing CreateTablet for tablet afdd722b50584e65a098028c71ee2f9d (DEFAULT_TABLE table=default.Table_f5427083312e42a9b3320e8d5639dc1a [id=49f2455b7bdf45aaa23b218da1bd27de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.505930 12172 tablet_bootstrap.cc:654] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.505991 13121 raft_consensus.cc:2747] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.506245 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 59556a6da95144f88aa806a7febd6a58 (DEFAULT_TABLE table=default.Table_6913356853b04dcdbb871b449e350ffb [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.506600 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59556a6da95144f88aa806a7febd6a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.506630 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet c4c32692666047fe9a18a75e66365e16 with delete_type TABLET_DATA_DELETED (replaced by tablet f8f4f4c9b85c4c08a386347b4164efa7) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.507457 12172 tablet_bootstrap.cc:492] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.507550 12172 ts_tablet_manager.cc:1397] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:02:00.507647 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 39b41ff066cb499fae9b71ca1f2f9d2b
I20250625 14:02:00.507982 11531 catalog_manager.cc:6652] ReplaceTablet: tablet 39b41ff066cb499fae9b71ca1f2f9d2b deleted and replaced by tablet 6ed17f7f72e4461ba9334e82a001649f
I20250625 14:02:00.508010 12172 raft_consensus.cc:357] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.508114 12172 raft_consensus.cc:383] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.508154 12172 raft_consensus.cc:738] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.508298 12172 consensus_queue.cc:260] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.508680 12172 ts_tablet_manager.cc:1428] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.509469 12172 tablet_bootstrap.cc:492] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.510052 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdd722b50584e65a098028c71ee2f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.510247 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa6fd92afb34a70a671b8801173b5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.510885 12172 tablet_bootstrap.cc:654] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.512296 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d9ec116e8e4206940860c88c23eed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.512415 12172 tablet_bootstrap.cc:492] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.512487 12172 ts_tablet_manager.cc:1397] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20250625 14:02:00.512787 13121 raft_consensus.cc:491] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.512872 13121 raft_consensus.cc:513] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.512950 12172 raft_consensus.cc:357] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.513033 12172 raft_consensus.cc:383] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.513062 12172 raft_consensus.cc:738] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.513156 12172 consensus_queue.cc:260] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.513314 13121 leader_election.cc:290] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:00.513442 12172 ts_tablet_manager.cc:1428] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.513648 12172 tablet_bootstrap.cc:492] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:00.514827 11990 leader_election.cc:343] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: cc9e2afd5bc443398293d0ed572f6c05
I20250625 14:02:00.514976 12172 tablet_bootstrap.cc:654] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.515677 13137 raft_consensus.cc:491] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.515753 13137 raft_consensus.cc:513] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.516098 13137 leader_election.cc:290] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.518052 12172 tablet_bootstrap.cc:492] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.518147 12172 ts_tablet_manager.cc:1397] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20250625 14:02:00.518682 12172 raft_consensus.cc:357] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.518783 12172 raft_consensus.cc:383] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250625 14:02:00.518785 11993 leader_election.cc:343] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: cc9e2afd5bc443398293d0ed572f6c05
I20250625 14:02:00.518821 12172 raft_consensus.cc:738] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.518859 11993 leader_election.cc:304] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.518925 12172 consensus_queue.cc:260] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.519146 13121 raft_consensus.cc:2747] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.519250 12172 ts_tablet_manager.cc:1428] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:00.519413 12172 tablet_bootstrap.cc:492] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.520444 12172 tablet_bootstrap.cc:654] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.521147 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c751d05cac1d4d65965e0aca2a94c14a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.521870 11717 leader_election.cc:343] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.522518 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_216035509d754cd4ac22e6f099da4b0b" } new_table_name: "default.Table_03ef2dedc3ec4970b6e31ab7ece17acb" modify_external_catalogs: true
I20250625 14:02:00.522774 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.525324 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 39b41ff066cb499fae9b71ca1f2f9d2b with delete_type TABLET_DATA_DELETED (replaced by tablet 6ed17f7f72e4461ba9334e82a001649f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.526168 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet fa2ccf77288144e5b81513dede9d4302 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.526369 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 with delete_type TABLET_DATA_DELETED (replaced by tablet 06d9ec116e8e4206940860c88c23eed2) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.526752 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d74f27d998b14ee890272812b718e468 (table default.Table_7eea033a0ebc4712a45ee52653e09a47 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]) successfully deleted
W20250625 14:02:00.527002 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 39b41ff066cb499fae9b71ca1f2f9d2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39b41ff066cb499fae9b71ca1f2f9d2b already in progress: creating tablet
I20250625 14:02:00.527269 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 1df220bf9c8447c5ac4ad35a145a8796 (table default.Table_6e519c7cc312409181ac8bca5e400b80 [id=5ead0c4cbc05488789ec165f1dd645fb]) successfully deleted
W20250625 14:02:00.527403 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a36ed3e126ef4edfa69fcffb098d0e4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36ed3e126ef4edfa69fcffb098d0e4f already in progress: creating tablet
I20250625 14:02:00.529410 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 31157f3bd20f4db5a0baa05b61d92f87 (table default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7]). Expected version 1 got 0
I20250625 14:02:00.533489 12172 tablet_bootstrap.cc:492] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.533610 12172 ts_tablet_manager.cc:1397] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20250625 14:02:00.534116 12172 raft_consensus.cc:357] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.534243 12172 raft_consensus.cc:383] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.534274 12172 raft_consensus.cc:738] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.534412 12172 consensus_queue.cc:260] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.534693 12172 ts_tablet_manager.cc:1428] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.534864 12172 tablet_bootstrap.cc:492] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.535929 12172 tablet_bootstrap.cc:654] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.540288 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 3be69a38ec234025af3e9c2c54dca57e (DEFAULT_TABLE table=default.Table_1e9b59f503d94b5cbb6c623f66e91d46 [id=7a50f67d28664178a59dc7f7113d1d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.540612 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be69a38ec234025af3e9c2c54dca57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.542788 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7190e5448275492787c262ebd30282c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.543605 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7190e5448275492787c262ebd30282c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.545017 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf8fffe67524910aa0386ac88b5cff0 (DEFAULT_TABLE table=default.Table_1048fffd9fb1451d97ec6c51a7b3a2ec [id=40114223674f4ea9949ac4486d03e147]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.545312 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf8fffe67524910aa0386ac88b5cff0. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:00.547628 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a4c8610a88347b4ad024e8f3ccc2bdf consensus state has no leader
I20250625 14:02:00.550503 13137 consensus_queue.cc:1035] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.555738 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9b8a6b5a7ff34d5486a1887a30984012"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.557022 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b8a6b5a7ff34d5486a1887a30984012 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.557251 13137 raft_consensus.cc:491] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.557369 13137 raft_consensus.cc:513] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.557744 13137 leader_election.cc:290] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.558248 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fb1f0297ff443818507584b4ab00ddf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.558707 11717 leader_election.cc:343] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.560379 13137 raft_consensus.cc:491] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.560479 13137 raft_consensus.cc:513] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.560863 13137 leader_election.cc:290] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:00.561475 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e15bd70671f8458db5b9e52423189eda" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.562672 11717 leader_election.cc:343] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.563025 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6669033348ee4fa6bce045320700534b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.563503 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6669033348ee4fa6bce045320700534b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.567757 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_634b6d869acd4da2bd66aff2b24c393c" } modify_external_catalogs: true
I20250625 14:02:00.567943 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_634b6d869acd4da2bd66aff2b24c393c" } modify_external_catalogs: true
I20250625 14:02:00.575645 12173 ts_tablet_manager.cc:1939] T 1df220bf9c8447c5ac4ad35a145a8796 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.399691 12166 tablet_bootstrap.cc:492] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.576712 12166 ts_tablet_manager.cc:1397] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.450s user 0.002s sys 0.000s
I20250625 14:02:00.405872 11892 tablet_service.cc:1468] Processing CreateTablet for tablet a30b1d5e2baa47b99722ca28f5f92999 (DEFAULT_TABLE table=default.Table_0f101fb3f05348f8a75533a4ce961e14 [id=20bb90be3498475f97d7616348fa2311]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.576967 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30b1d5e2baa47b99722ca28f5f92999. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.577246 12166 raft_consensus.cc:357] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.577373 12166 raft_consensus.cc:383] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.577404 12166 raft_consensus.cc:738] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.577525 12166 consensus_queue.cc:260] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.577785 12166 ts_tablet_manager.cc:1428] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:00.578001 12166 tablet_bootstrap.cc:492] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.579195 12166 tablet_bootstrap.cc:654] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.432451 11902 tablet_service.cc:1468] Processing CreateTablet for tablet e93e37ffd0804212999cc2bf8770c39c (DEFAULT_TABLE table=default.Table_ed61cf3246304810aa1b1096735c602b [id=cabcf5d77a8e451ab385b7b7a2212563]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.579828 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e93e37ffd0804212999cc2bf8770c39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.579907 12173 tablet_replica.cc:331] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.387022 12175 raft_consensus.cc:2241] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.580879 12175 raft_consensus.cc:2270] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.581286 12175 ts_tablet_manager.cc:1905] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.583524 12175 ts_tablet_manager.cc:1918] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.583590 12175 log.cc:1199] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/fb8c57c541114222b81dff868b1529f6
I20250625 14:02:00.583832 12175 ts_tablet_manager.cc:1939] T fb8c57c541114222b81dff868b1529f6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.432929 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d666f4b403435287f4157bda971193" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.584450 11919 raft_consensus.cc:2466] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:00.443943 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "93d666f4b403435287f4157bda971193" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:00.584682 11920 raft_consensus.cc:3058] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.584961 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 717254244e9b4cf399c231a37480a3a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.585412 12173 raft_consensus.cc:2241] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.585548 12173 raft_consensus.cc:2270] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.585592 11920 raft_consensus.cc:2466] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:00.466356 12953 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:00.498119 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 42dc321e5fd740268dd3b9f19e8231fa (DEFAULT_TABLE table=default.Table_899a1eb5d58f478a87063fafb95aa819 [id=83f715a6270c49f7b0986d2b05d73b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.586154 12167 tablet_bootstrap.cc:492] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.500625 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet fee20f2812d34d188b7181e6da00f823 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.586241 12167 ts_tablet_manager.cc:1397] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.181s user 0.002s sys 0.000s
I20250625 14:02:00.503532 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 59556a6da95144f88aa806a7febd6a58 (DEFAULT_TABLE table=default.Table_6913356853b04dcdbb871b449e350ffb [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.517778 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c751d05cac1d4d65965e0aca2a94c14a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.518680 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet c4c32692666047fe9a18a75e66365e16 with delete_type TABLET_DATA_DELETED (replaced by tablet f8f4f4c9b85c4c08a386347b4164efa7) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.526103 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:00.586805 11717 leader_election.cc:343] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.586818 12167 raft_consensus.cc:357] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.586889 11717 leader_election.cc:304] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.586928 12167 raft_consensus.cc:383] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.586970 12167 raft_consensus.cc:738] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.587083 12208 raft_consensus.cc:2747] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.587102 12167 consensus_queue.cc:260] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.587383 12167 ts_tablet_manager.cc:1428] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.587565 12167 tablet_bootstrap.cc:492] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.526633 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 with delete_type TABLET_DATA_DELETED (replaced by tablet 06d9ec116e8e4206940860c88c23eed2) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.558259 11921 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fb1f0297ff443818507584b4ab00ddf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.562685 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e15bd70671f8458db5b9e52423189eda" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:00.588186 11717 leader_election.cc:343] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.574116 12265 consensus_queue.cc:1035] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20250625 14:02:00.588261 11717 leader_election.cc:304] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.387511 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 91669e7574f54b41a13c6f80583cd12b (DEFAULT_TABLE table=default.Table_3e08079d38cf40059efef8250ccd265a [id=0d992c33ce0b423c929715138cdb2237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.588498 12208 raft_consensus.cc:2747] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.588634 12167 tablet_bootstrap.cc:654] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.478719 11893 tablet_service.cc:1468] Processing CreateTablet for tablet b4929957b34544549ed3996de581bfbb (DEFAULT_TABLE table=default.Table_c7d281ee1d5647d999a0702ce64779dc [id=3c0002033ae044b5abb9a9adc198b603]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.594631 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.594769 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 292e9c27637d410ea487761f50bdee88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:00.594972 11717 leader_election.cc:343] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.595064 11717 leader_election.cc:304] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.595422 12238 raft_consensus.cc:2747] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.598421 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.598489 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 717254244e9b4cf399c231a37480a3a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.598555 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 6d2adc01621f40b8bebd532ad491df2f (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.598766 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 292e9c27637d410ea487761f50bdee88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.598848 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2adc01621f40b8bebd532ad491df2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.598803 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 6d2adc01621f40b8bebd532ad491df2f (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.601732 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 3d5c9b7412d148a38fd61eb4629db359 (DEFAULT_TABLE table=default.Table_a8c0fd4a04d048d99042fe2c45a547b3 [id=7e9285e4315b44d8b6b08f143261c14f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.601969 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5c9b7412d148a38fd61eb4629db359. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.602960 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d8227e0205bb4b9fa9b8047558cf9a1c
I20250625 14:02:00.604375 12173 ts_tablet_manager.cc:1905] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.604434 13244 tablet.cc:1722] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:00.604616 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 3d5c9b7412d148a38fd61eb4629db359 (DEFAULT_TABLE table=default.Table_a8c0fd4a04d048d99042fe2c45a547b3 [id=7e9285e4315b44d8b6b08f143261c14f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.605798 13241 tablet.cc:1722] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:00.607224 12600 consensus_queue.cc:1035] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.607539 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d2bbefbdbd3541e183f3c3412e226554"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.607976 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2bbefbdbd3541e183f3c3412e226554 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.613677 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 51b8945fea564468a76b4aa7feb90844 (DEFAULT_TABLE table=default.Table_c035179702eb4c5f884ec0bdf2261562 [id=7ec4ea02f115465fbb6fab1fee07fa26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.614687 12037 tablet_service.cc:1468] Processing CreateTablet for tablet eb0b39be1dc840589bdd06609e082fda (DEFAULT_TABLE table=default.Table_2303b18799734fd38bfdd72a4f2a2348 [id=f9fa89a2028d4c18a95898ea61c2978a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.614874 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 096c166fc3b84bcf94b1565683bdbb38 (DEFAULT_TABLE table=default.Table_d2ab8a595872457fa3c4f0042a350248 [id=71999d8db1e744eda5c69d85dcd9fd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.615469 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 51b8945fea564468a76b4aa7feb90844 (DEFAULT_TABLE table=default.Table_c035179702eb4c5f884ec0bdf2261562 [id=7ec4ea02f115465fbb6fab1fee07fa26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.615793 12027 tablet_service.cc:1468] Processing CreateTablet for tablet f8f4f4c9b85c4c08a386347b4164efa7 (DEFAULT_TABLE table=default.Table_312ca07ca7b941c4a2dae1ae52c46b56 [id=44291c78dc3e4c0b9f1e81a9b8907e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.616103 11900 tablet_service.cc:1468] Processing CreateTablet for tablet eb0b39be1dc840589bdd06609e082fda (DEFAULT_TABLE table=default.Table_2303b18799734fd38bfdd72a4f2a2348 [id=f9fa89a2028d4c18a95898ea61c2978a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.616179 11889 tablet_service.cc:1468] Processing CreateTablet for tablet a946bcadbab746a69df1a7b35682331e (DEFAULT_TABLE table=default.Table_4b8ec3648e404bb1912ff6fb5556c97a [id=fc78e469e09e4620815c1118b0aadfd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.616369 12021 tablet_service.cc:1468] Processing CreateTablet for tablet a946bcadbab746a69df1a7b35682331e (DEFAULT_TABLE table=default.Table_4b8ec3648e404bb1912ff6fb5556c97a [id=fc78e469e09e4620815c1118b0aadfd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.617460 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0b39be1dc840589bdd06609e082fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.617543 12172 tablet_bootstrap.cc:492] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.617655 12172 ts_tablet_manager.cc:1397] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.000s
I20250625 14:02:00.618211 12172 raft_consensus.cc:357] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.618369 12172 raft_consensus.cc:383] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.618410 12172 raft_consensus.cc:738] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.618558 12172 consensus_queue.cc:260] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.618574 12238 raft_consensus.cc:491] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.618695 12238 raft_consensus.cc:513] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.618866 12172 ts_tablet_manager.cc:1428] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.619042 12172 tablet_bootstrap.cc:492] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.619068 12238 leader_election.cc:290] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.619974 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096c166fc3b84bcf94b1565683bdbb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.620039 12172 tablet_bootstrap.cc:654] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.620224 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f4f4c9b85c4c08a386347b4164efa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.621809 12238 raft_consensus.cc:491] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.621891 12238 raft_consensus.cc:513] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.622275 12238 leader_election.cc:290] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.622582 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b8945fea564468a76b4aa7feb90844. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.622747 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a946bcadbab746a69df1a7b35682331e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.623449 12037 tablet_service.cc:1468] Processing CreateTablet for tablet afdd722b50584e65a098028c71ee2f9d (DEFAULT_TABLE table=default.Table_f5427083312e42a9b3320e8d5639dc1a [id=49f2455b7bdf45aaa23b218da1bd27de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.623665 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdd722b50584e65a098028c71ee2f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.623873 11898 tablet_service.cc:1468] Processing CreateTablet for tablet afdd722b50584e65a098028c71ee2f9d (DEFAULT_TABLE table=default.Table_f5427083312e42a9b3320e8d5639dc1a [id=49f2455b7bdf45aaa23b218da1bd27de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.623873 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 06d9ec116e8e4206940860c88c23eed2 (DEFAULT_TABLE table=default.Table_c055b1e8e56d4bd595e2312996eb6b5e [id=45522461146c457ebfe600569a8c8524]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.624078 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 39b41ff066cb499fae9b71ca1f2f9d2b with delete_type TABLET_DATA_DELETED (replaced by tablet 6ed17f7f72e4461ba9334e82a001649f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.624145 11901 tablet_service.cc:1468] Processing CreateTablet for tablet daa6fd92afb34a70a671b8801173b5f4 (DEFAULT_TABLE table=default.Table_70428e9afd4743d6be12e15dc759b401 [id=e87be68518224b468229f8c803bf60de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.624403 12036 tablet_service.cc:1468] Processing CreateTablet for tablet daa6fd92afb34a70a671b8801173b5f4 (DEFAULT_TABLE table=default.Table_70428e9afd4743d6be12e15dc759b401 [id=e87be68518224b468229f8c803bf60de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.624608 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa6fd92afb34a70a671b8801173b5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.624577 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet da5ed5d8d3ca4342980c893a8653d4a0 (table default.Table_0d953c5d6072467bab1a7d797eb13dc6 [id=ddedb1af9caa48b898f29c930bbf6bc3]) successfully deleted
I20250625 14:02:00.624922 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 06d9ec116e8e4206940860c88c23eed2 (DEFAULT_TABLE table=default.Table_c055b1e8e56d4bd595e2312996eb6b5e [id=45522461146c457ebfe600569a8c8524]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:00.624729 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 881295234a5b4a089985382765774cd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 881295234a5b4a089985382765774cd9 already in progress: creating tablet
I20250625 14:02:00.625033 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet 39b41ff066cb499fae9b71ca1f2f9d2b with delete_type TABLET_DATA_DELETED (replaced by tablet 6ed17f7f72e4461ba9334e82a001649f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.625137 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d9ec116e8e4206940860c88c23eed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.625372 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 1df220bf9c8447c5ac4ad35a145a8796 (table default.Table_6e519c7cc312409181ac8bca5e400b80 [id=5ead0c4cbc05488789ec165f1dd645fb]) successfully deleted
I20250625 14:02:00.627946 12173 ts_tablet_manager.cc:1918] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.628016 12173 log.cc:1199] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7c68ae7ecff34d34baaffe47c740bac6
I20250625 14:02:00.628883 12167 tablet_bootstrap.cc:492] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.628993 12167 ts_tablet_manager.cc:1397] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20250625 14:02:00.629458 12167 raft_consensus.cc:357] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.629562 12167 raft_consensus.cc:383] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.629604 12167 raft_consensus.cc:738] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.629724 12167 consensus_queue.cc:260] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.630046 12167 ts_tablet_manager.cc:1428] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.630247 12167 tablet_bootstrap.cc:492] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.631425 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96fcc61e48e549618197d34346ea5b16" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.631909 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9ed052ae88e4b679ac55177a3bbab88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.632319 11717 leader_election.cc:343] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:00.632448 11717 leader_election.cc:343] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.634835 12167 tablet_bootstrap.cc:654] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.634887 13334 raft_consensus.cc:491] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.635010 13334 raft_consensus.cc:513] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.635421 13334 leader_election.cc:290] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.636292 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "140c1810e98741479c3754729409b46c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.636588 11717 leader_election.cc:343] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.637051 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 096c166fc3b84bcf94b1565683bdbb38 (DEFAULT_TABLE table=default.Table_d2ab8a595872457fa3c4f0042a350248 [id=71999d8db1e744eda5c69d85dcd9fd46]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.637307 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d with delete_type TABLET_DATA_DELETED (replaced by tablet 714bb5a28ec648f990fa1525a1b50129) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.642007 12173 ts_tablet_manager.cc:1939] T 7c68ae7ecff34d34baaffe47c740bac6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.643779 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "140c1810e98741479c3754729409b46c" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:00.644356 11717 leader_election.cc:343] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.644438 11717 leader_election.cc:304] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.644834 13137 consensus_queue.cc:1035] T 4de2eeaf84084fbda097aa8c0eef2341 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.644887 13334 raft_consensus.cc:2747] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.645622 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9ed052ae88e4b679ac55177a3bbab88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.646297 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96fcc61e48e549618197d34346ea5b16" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:00.646853 11717 leader_election.cc:343] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.646956 11717 leader_election.cc:304] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.647243 12208 raft_consensus.cc:2747] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:00.647243 11717 leader_election.cc:343] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.647434 11717 leader_election.cc:304] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.647642 13335 raft_consensus.cc:2747] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.647806 12953 tablet.cc:1722] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:00.649799 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet d8227e0205bb4b9fa9b8047558cf9a1c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.650583 12172 tablet_bootstrap.cc:492] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.650696 12172 ts_tablet_manager.cc:1397] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:02:00.651265 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf8fffe67524910aa0386ac88b5cff0 (DEFAULT_TABLE table=default.Table_1048fffd9fb1451d97ec6c51a7b3a2ec [id=40114223674f4ea9949ac4486d03e147]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.651260 12172 raft_consensus.cc:357] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.651371 12172 raft_consensus.cc:383] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.651402 12172 raft_consensus.cc:738] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.651571 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf8fffe67524910aa0386ac88b5cff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.651532 12172 consensus_queue.cc:260] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.651872 12172 ts_tablet_manager.cc:1428] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.652101 12172 tablet_bootstrap.cc:492] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.653318 12172 tablet_bootstrap.cc:654] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.654433 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91669e7574f54b41a13c6f80583cd12b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.657805 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59556a6da95144f88aa806a7febd6a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.657963 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a946bcadbab746a69df1a7b35682331e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.658154 12173 tablet_replica.cc:331] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.658288 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 3be69a38ec234025af3e9c2c54dca57e (DEFAULT_TABLE table=default.Table_1e9b59f503d94b5cbb6c623f66e91d46 [id=7a50f67d28664178a59dc7f7113d1d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.658378 12173 raft_consensus.cc:2241] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.658494 12173 raft_consensus.cc:2270] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.658579 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be69a38ec234025af3e9c2c54dca57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.658938 12173 ts_tablet_manager.cc:1905] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.649904 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet fb8c57c541114222b81dff868b1529f6 (table default.Table_899a1eb5d58f478a87063fafb95aa819 [id=83f715a6270c49f7b0986d2b05d73b44]) successfully deleted
I20250625 14:02:00.661196 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d9ec116e8e4206940860c88c23eed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.662463 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4929957b34544549ed3996de581bfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.662639 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa6fd92afb34a70a671b8801173b5f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.662820 11892 tablet_service.cc:1468] Processing CreateTablet for tablet f8f4f4c9b85c4c08a386347b4164efa7 (DEFAULT_TABLE table=default.Table_312ca07ca7b941c4a2dae1ae52c46b56 [id=44291c78dc3e4c0b9f1e81a9b8907e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.663050 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f4f4c9b85c4c08a386347b4164efa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.664669 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2adc01621f40b8bebd532ad491df2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.666524 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb0b39be1dc840589bdd06609e082fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.668609 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b8945fea564468a76b4aa7feb90844. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.669018 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 3be69a38ec234025af3e9c2c54dca57e (DEFAULT_TABLE table=default.Table_1e9b59f503d94b5cbb6c623f66e91d46 [id=7a50f67d28664178a59dc7f7113d1d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.669241 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be69a38ec234025af3e9c2c54dca57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.670286 11893 tablet_service.cc:1515] Processing DeleteTablet for tablet d8227e0205bb4b9fa9b8047558cf9a1c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.670636 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 9cf8fffe67524910aa0386ac88b5cff0 (DEFAULT_TABLE table=default.Table_1048fffd9fb1451d97ec6c51a7b3a2ec [id=40114223674f4ea9949ac4486d03e147]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.672919 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a8c0fd4a04d048d99042fe2c45a547b3" } modify_external_catalogs: true
I20250625 14:02:00.672966 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c2a2490948a24ff68ac7093e9fc54954" } modify_external_catalogs: true
I20250625 14:02:00.673055 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a8c0fd4a04d048d99042fe2c45a547b3" } modify_external_catalogs: true
I20250625 14:02:00.673082 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c2a2490948a24ff68ac7093e9fc54954" } modify_external_catalogs: true
I20250625 14:02:00.673492 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet b9a788be0b8640dc9d6d06fa86580f6b from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.673781 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 4f651f79ee034dd28e44092b7de29bf3 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.673751 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_116f4ad3308c453886c2f4677959cd83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.673974 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet c940a9f7ada54b48940e90c822c84735 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:00.674158 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_116f4ad3308c453886c2f4677959cd83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.674652 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2037e3cc66de4c68bc580a95e021e860" } modify_external_catalogs: true
I20250625 14:02:00.674732 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2037e3cc66de4c68bc580a95e021e860" } modify_external_catalogs: true
I20250625 14:02:00.675053 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_56262f7334bf48819421af1329c18542" } new_table_name: "default.Table_3b2a6658d99941f893979414a2301394" modify_external_catalogs: true
I20250625 14:02:00.675628 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fa719388db36434cbfd373ed001644c9" } new_table_name: "default.Table_6599fe84caa14c35abca12303dad90fc" modify_external_catalogs: true
I20250625 14:02:00.675649 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet d8227e0205bb4b9fa9b8047558cf9a1c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:00.678560 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d8227e0205bb4b9fa9b8047558cf9a1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8227e0205bb4b9fa9b8047558cf9a1c already in progress: creating tablet
I20250625 14:02:00.683238 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c940a9f7ada54b48940e90c822c84735
W20250625 14:02:00.683379 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6b4698a9bb24468485d1e64e41aae8f3 has no consensus state
W20250625 14:02:00.683403 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 837e98e4e48a465fa9c3e697ae34c9ea consensus state has no leader
I20250625 14:02:00.683597 11525 catalog_manager.cc:6652] ReplaceTablet: tablet c940a9f7ada54b48940e90c822c84735 deleted and replaced by tablet 6b4698a9bb24468485d1e64e41aae8f3
I20250625 14:02:00.683596 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1dfc0921c4484867bf51830bb4924a19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.683789 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c147de4a592443e78b2ef153e8783ed6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.683971 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dfc0921c4484867bf51830bb4924a19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:00.684010 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c147de4a592443e78b2ef153e8783ed6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.684034 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a15909878962425e8ac28f041e57b699"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.684384 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a15909878962425e8ac28f041e57b699 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.683624 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_14d8a31a1e8b4fa5a08673620892fc67" } modify_external_catalogs: true
I20250625 14:02:00.684741 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_14d8a31a1e8b4fa5a08673620892fc67" } modify_external_catalogs: true
I20250625 14:02:00.685205 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42dc321e5fd740268dd3b9f19e8231fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.687592 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7c68ae7ecff34d34baaffe47c740bac6 (table default.Table_dc38af2e12bd48faa284df718dff16f9 [id=e6793d23bb264d259e9d0218259fea14]) successfully deleted
I20250625 14:02:00.687706 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 096c166fc3b84bcf94b1565683bdbb38. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.687825 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdd722b50584e65a098028c71ee2f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.688014 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf8fffe67524910aa0386ac88b5cff0. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:00.688818 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 0f6c287461864f6dba5f47711eb69fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f6c287461864f6dba5f47711eb69fae already in progress: creating tablet
I20250625 14:02:00.689214 13335 raft_consensus.cc:491] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.689323 13335 raft_consensus.cc:513] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.689735 13335 leader_election.cc:290] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:00.690014 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5c9b7412d148a38fd61eb4629db359. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.690263 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e9476529c1b7401683c02e146f54a228" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.690486 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet c940a9f7ada54b48940e90c822c84735 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b4698a9bb24468485d1e64e41aae8f3) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:00.690759 11717 leader_election.cc:343] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.690944 12175 tablet_replica.cc:331] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.691088 12175 raft_consensus.cc:2241] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.691325 12175 raft_consensus.cc:2270] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.691692 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet c940a9f7ada54b48940e90c822c84735 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b4698a9bb24468485d1e64e41aae8f3) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.691704 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e9476529c1b7401683c02e146f54a228" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.691778 12175 ts_tablet_manager.cc:1905] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:00.692005 11717 leader_election.cc:343] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.692080 11717 leader_election.cc:304] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.692237 13335 raft_consensus.cc:2747] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.694284 12175 ts_tablet_manager.cc:1918] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:00.694576 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet c940a9f7ada54b48940e90c822c84735 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b4698a9bb24468485d1e64e41aae8f3) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.694752 12177 tablet_replica.cc:331] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.694891 12177 raft_consensus.cc:2241] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:02:00.694957 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet fee20f2812d34d188b7181e6da00f823 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fee20f2812d34d188b7181e6da00f823 already in progress: creating tablet
I20250625 14:02:00.695040 12167 tablet_bootstrap.cc:492] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.695106 12177 raft_consensus.cc:2270] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.695122 12167 ts_tablet_manager.cc:1397] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
W20250625 14:02:00.695129 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c4c32692666047fe9a18a75e66365e16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4c32692666047fe9a18a75e66365e16 already in progress: creating tablet
W20250625 14:02:00.695235 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 84a1eb4471544de9afbb5b35d0071dcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84a1eb4471544de9afbb5b35d0071dcc already in progress: creating tablet
W20250625 14:02:00.695336 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 4f651f79ee034dd28e44092b7de29bf3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f651f79ee034dd28e44092b7de29bf3 already in progress: creating tablet
W20250625 14:02:00.695423 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b9a788be0b8640dc9d6d06fa86580f6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a788be0b8640dc9d6d06fa86580f6b already in progress: creating tablet
W20250625 14:02:00.695521 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 717254244e9b4cf399c231a37480a3a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717254244e9b4cf399c231a37480a3a1 already in progress: creating tablet
I20250625 14:02:00.695523 12177 ts_tablet_manager.cc:1905] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:00.695619 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 292e9c27637d410ea487761f50bdee88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 292e9c27637d410ea487761f50bdee88 already in progress: creating tablet
W20250625 14:02:00.695719 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 39b41ff066cb499fae9b71ca1f2f9d2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39b41ff066cb499fae9b71ca1f2f9d2b already in progress: creating tablet
I20250625 14:02:00.695664 12167 raft_consensus.cc:357] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.695789 12167 raft_consensus.cc:383] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250625 14:02:00.695817 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d8227e0205bb4b9fa9b8047558cf9a1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8227e0205bb4b9fa9b8047558cf9a1c already in progress: creating tablet
I20250625 14:02:00.695827 12167 raft_consensus.cc:738] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.695950 12167 consensus_queue.cc:260] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.696254 12167 ts_tablet_manager.cc:1428] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.696472 12167 tablet_bootstrap.cc:492] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.697352 12167 tablet_bootstrap.cc:654] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.697816 12177 ts_tablet_manager.cc:1918] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:00.697888 12177 log.cc:1199] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c940a9f7ada54b48940e90c822c84735
I20250625 14:02:00.698140 12177 ts_tablet_manager.cc:1939] T c940a9f7ada54b48940e90c822c84735 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.702428 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_3b2a6658d99941f893979414a2301394 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]) successfully deleted
I20250625 14:02:00.703799 12172 tablet_bootstrap.cc:492] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.703910 12172 ts_tablet_manager.cc:1397] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20250625 14:02:00.704063 12173 ts_tablet_manager.cc:1918] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.704151 12173 log.cc:1199] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c2307a7c00204e8fa1a14b5112659d91
I20250625 14:02:00.704370 12173 ts_tablet_manager.cc:1939] T c2307a7c00204e8fa1a14b5112659d91 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.704425 12172 raft_consensus.cc:357] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.704547 12172 raft_consensus.cc:383] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.704586 12172 raft_consensus.cc:738] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.704761 12172 consensus_queue.cc:260] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.705080 12172 ts_tablet_manager.cc:1428] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.705286 12172 tablet_bootstrap.cc:492] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.701224 12166 tablet_bootstrap.cc:492] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.706667 12166 ts_tablet_manager.cc:1397] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.129s user 0.002s sys 0.000s
I20250625 14:02:00.706905 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_96dbeba001d841fc816db28e08ce97ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.707188 12166 raft_consensus.cc:357] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.707296 12166 raft_consensus.cc:383] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.707330 12166 raft_consensus.cc:738] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:02:00.707335 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96dbeba001d841fc816db28e08ce97ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.707456 12166 consensus_queue.cc:260] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.707753 12166 ts_tablet_manager.cc:1428] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:00.707834 12175 log.cc:1199] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c940a9f7ada54b48940e90c822c84735
I20250625 14:02:00.708084 12166 tablet_bootstrap.cc:492] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.708911 12166 tablet_bootstrap.cc:654] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.709357 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7190e5448275492787c262ebd30282c5" } new_table_name: "default.Table_ee455592e1bf4f1596f36d91b207154f" modify_external_catalogs: true
I20250625 14:02:00.709395 13335 raft_consensus.cc:491] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.709489 13335 raft_consensus.cc:513] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.709865 13335 leader_election.cc:290] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.710625 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_57c928ae62334708914b5df36f2b8f4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.710953 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57c928ae62334708914b5df36f2b8f4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.712688 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "21908df7bb384e9782b97abe6f06b0f5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.713532 12173 tablet_replica.cc:331] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.714011 12175 ts_tablet_manager.cc:1939] T c940a9f7ada54b48940e90c822c84735 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.714192 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c2307a7c00204e8fa1a14b5112659d91 (table default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]) successfully deleted
I20250625 14:02:00.714479 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 93d666f4b403435287f4157bda971193 (table default.Table_43bcd95133e249cc987155fe5045e4ea [id=27af5f3cf87a4e71937c303a90e3d366]). Expected version 1 got 0
I20250625 14:02:00.714912 12173 raft_consensus.cc:2241] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.715039 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 6ed17f7f72e4461ba9334e82a001649f (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.715353 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed17f7f72e4461ba9334e82a001649f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.714425 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "21908df7bb384e9782b97abe6f06b0f5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:00.715783 11717 leader_election.cc:343] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.714273 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]). Expected version 1 got 0
W20250625 14:02:00.716825 11717 leader_election.cc:343] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.716902 11717 leader_election.cc:304] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.716889 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]). Expected version 1 got 0
I20250625 14:02:00.717038 13335 raft_consensus.cc:2747] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.717110 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:02:00.715056 12173 raft_consensus.cc:2270] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.718714 12172 tablet_bootstrap.cc:654] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.718926 11524 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 31157f3bd20f4db5a0baa05b61d92f87 (table default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7]). Expected version 1 got 0
I20250625 14:02:00.719147 11524 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_fd4614a0de7d438f82751d3ed54210cd [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 1 got 0
I20250625 14:02:00.719297 11524 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:02:00.719475 11524 catalog_manager.cc:5582] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:00.719564 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_390418f3372f4207a237db157de126ab" } new_table_name: "default.Table_ec61af86da054876a97a43f9e1e13a61" modify_external_catalogs: true
I20250625 14:02:00.719666 11524 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 93d666f4b403435287f4157bda971193 (table default.Table_43bcd95133e249cc987155fe5045e4ea [id=27af5f3cf87a4e71937c303a90e3d366]). Expected version 1 got 0
I20250625 14:02:00.719806 11524 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]). Expected version 1 got 0
I20250625 14:02:00.719895 11524 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]). Expected version 1 got 0
I20250625 14:02:00.723039 12173 ts_tablet_manager.cc:1905] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.726122 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3d5c9b7412d148a38fd61eb4629db359
I20250625 14:02:00.726390 12167 tablet_bootstrap.cc:492] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.726435 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 47ed422d7a274075b5e44cd9a59e370f
I20250625 14:02:00.726490 12167 ts_tablet_manager.cc:1397] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250625 14:02:00.726604 12172 tablet_bootstrap.cc:492] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.726692 12172 ts_tablet_manager.cc:1397] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.001s
I20250625 14:02:00.726933 12167 raft_consensus.cc:357] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.727039 12167 raft_consensus.cc:383] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.727070 12167 raft_consensus.cc:738] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.727205 12167 consensus_queue.cc:260] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.727197 12172 raft_consensus.cc:357] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.727315 12172 raft_consensus.cc:383] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.727349 12172 raft_consensus.cc:738] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.727504 12167 ts_tablet_manager.cc:1428] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.727470 12172 consensus_queue.cc:260] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.727617 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b3819dec2c834c40846dcb3a11fa4f5f
I20250625 14:02:00.727702 12167 tablet_bootstrap.cc:492] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.727722 12172 ts_tablet_manager.cc:1428] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.727909 12172 tablet_bootstrap.cc:492] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.728459 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 6ed17f7f72e4461ba9334e82a001649f (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.728586 12167 tablet_bootstrap.cc:654] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.728739 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed17f7f72e4461ba9334e82a001649f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:00.728765 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ea3aa2ef74f467dbb4238f58028a270 has no consensus state
I20250625 14:02:00.728833 12172 tablet_bootstrap.cc:654] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.731303 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ccf9474414824e6c84c2e81c52bb802a
I20250625 14:02:00.731797 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.731814 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 6ed17f7f72e4461ba9334e82a001649f (DEFAULT_TABLE table=default.Table_77847d143a98441197cbf9363315fb78 [id=8552513f5edd40dca6228124871400db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.732070 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed17f7f72e4461ba9334e82a001649f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.732646 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 3d5c9b7412d148a38fd61eb4629db359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.733260 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.734126 12166 tablet_bootstrap.cc:492] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.734236 12166 ts_tablet_manager.cc:1397] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20250625 14:02:00.734786 12166 raft_consensus.cc:357] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.734890 12166 raft_consensus.cc:383] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.734946 12166 raft_consensus.cc:738] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.735096 12166 consensus_queue.cc:260] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.735201 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 47ed422d7a274075b5e44cd9a59e370f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.735219 12173 ts_tablet_manager.cc:1918] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.735286 12173 log.cc:1199] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6d41c8cea082478d9cc16c143b3a3f7a
I20250625 14:02:00.735347 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.735445 12166 ts_tablet_manager.cc:1428] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.735502 12173 ts_tablet_manager.cc:1939] T 6d41c8cea082478d9cc16c143b3a3f7a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.735642 12166 tablet_bootstrap.cc:492] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.736856 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 3d5c9b7412d148a38fd61eb4629db359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.736946 12166 tablet_bootstrap.cc:654] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.737527 13335 raft_consensus.cc:491] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.737613 13335 raft_consensus.cc:513] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.738052 13335 leader_election.cc:290] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.737020 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 3d5c9b7412d148a38fd61eb4629db359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.738225 12166 tablet_bootstrap.cc:492] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.738332 12166 ts_tablet_manager.cc:1397] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:00.738701 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f2c3d6fe97d4cb3b52e2ffea14e615b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.738793 12166 raft_consensus.cc:357] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.738869 12166 raft_consensus.cc:383] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.738898 12166 raft_consensus.cc:738] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.739017 12166 consensus_queue.cc:260] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.739320 12166 ts_tablet_manager.cc:1428] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20250625 14:02:00.739300 11717 leader_election.cc:343] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.739491 12166 tablet_bootstrap.cc:492] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.739912 12600 consensus_queue.cc:1035] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.740501 12166 tablet_bootstrap.cc:654] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:00.740489 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 47ed422d7a274075b5e44cd9a59e370f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47ed422d7a274075b5e44cd9a59e370f already in progress: creating tablet
I20250625 14:02:00.741252 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2f2c3d6fe97d4cb3b52e2ffea14e615b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.741775 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 47ed422d7a274075b5e44cd9a59e370f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.741791 13335 raft_consensus.cc:491] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.741871 13335 raft_consensus.cc:513] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.742237 13335 leader_election.cc:290] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:00.744484 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_3b2a6658d99941f893979414a2301394 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]) successfully deleted
W20250625 14:02:00.744751 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b3819dec2c834c40846dcb3a11fa4f5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3819dec2c834c40846dcb3a11fa4f5f already in progress: creating tablet
I20250625 14:02:00.745169 12166 tablet_bootstrap.cc:492] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.745158 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6d41c8cea082478d9cc16c143b3a3f7a (table default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]) successfully deleted
I20250625 14:02:00.745258 12166 ts_tablet_manager.cc:1397] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:02:00.744239 12173 tablet_replica.cc:331] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.745325 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 47ed422d7a274075b5e44cd9a59e370f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.745440 12173 raft_consensus.cc:2241] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.745546 12173 raft_consensus.cc:2270] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.745747 12166 raft_consensus.cc:357] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.745838 12166 raft_consensus.cc:383] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.745867 12166 raft_consensus.cc:738] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.745930 12173 ts_tablet_manager.cc:1905] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.745982 12166 consensus_queue.cc:260] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.746274 12166 ts_tablet_manager.cc:1428] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.747028 13335 raft_consensus.cc:491] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.747117 13335 raft_consensus.cc:513] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.747486 13335 leader_election.cc:290] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.748150 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet ccf9474414824e6c84c2e81c52bb802a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:00.748602 11717 leader_election.cc:343] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.748674 11717 leader_election.cc:304] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.749058 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet ccf9474414824e6c84c2e81c52bb802a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.749192 13335 raft_consensus.cc:2747] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.749224 12167 tablet_bootstrap.cc:492] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.749264 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 93d666f4b403435287f4157bda971193 (table default.Table_43bcd95133e249cc987155fe5045e4ea [id=27af5f3cf87a4e71937c303a90e3d366]). Expected version 1 got 0
I20250625 14:02:00.749310 12167 ts_tablet_manager.cc:1397] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20250625 14:02:00.749840 12167 raft_consensus.cc:357] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.749943 12167 raft_consensus.cc:383] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.749979 12167 raft_consensus.cc:738] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.749936 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet ccf9474414824e6c84c2e81c52bb802a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.750105 12167 consensus_queue.cc:260] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.751650 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e1ad291ba0da4f3fa70aa9548ef71d01" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.752445 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_152685b1e6a74938b9531031675cb9d3 [id=03079048fe6d402892c777db10632ff7] alter complete (version 1)
I20250625 14:02:00.753216 12167 ts_tablet_manager.cc:1428] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:00.753475 12167 tablet_bootstrap.cc:492] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:02:00.754591 11717 leader_election.cc:343] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.754863 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4199634a8be4e359cc9707d4754cac9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.754992 12042 raft_consensus.cc:2466] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:00.755596 12166 tablet_bootstrap.cc:492] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.755542 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e1ad291ba0da4f3fa70aa9548ef71d01" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.755908 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4199634a8be4e359cc9707d4754cac9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.756045 11920 raft_consensus.cc:2466] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:00.756906 12167 tablet_bootstrap.cc:654] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.756906 12166 tablet_bootstrap.cc:654] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:00.757546 11717 leader_election.cc:343] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.757622 11717 leader_election.cc:304] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.757799 11717 leader_election.cc:304] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.758095 13335 raft_consensus.cc:2747] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.758210 13335 raft_consensus.cc:2802] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.758275 13335 raft_consensus.cc:491] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.758342 13335 raft_consensus.cc:3058] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:00.759377 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 3d5c9b7412d148a38fd61eb4629db359 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d5c9b7412d148a38fd61eb4629db359 already in progress: creating tablet
I20250625 14:02:00.759431 13335 raft_consensus.cc:513] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:00.759691 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 47ed422d7a274075b5e44cd9a59e370f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47ed422d7a274075b5e44cd9a59e370f already in progress: creating tablet
I20250625 14:02:00.759788 13335 leader_election.cc:290] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.761252 12166 tablet_bootstrap.cc:492] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.761302 13334 raft_consensus.cc:491] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.761360 12166 ts_tablet_manager.cc:1397] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:02:00.761381 13334 raft_consensus.cc:513] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.761739 13334 leader_election.cc:290] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:00.761991 13121 raft_consensus.cc:491] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.762094 13121 raft_consensus.cc:513] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.762526 13121 leader_election.cc:290] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.762784 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4199634a8be4e359cc9707d4754cac9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.762882 12042 raft_consensus.cc:3058] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.763011 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4199634a8be4e359cc9707d4754cac9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:00.763084 11917 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "295ddb94cd4f489c9d53875bd1578474" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.763127 11920 raft_consensus.cc:3058] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.763109 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34bdfb2527c14c7985bc790dcb4d0657" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.763525 12166 raft_consensus.cc:357] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.763607 12166 raft_consensus.cc:383] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.763635 12166 raft_consensus.cc:738] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.763777 12166 consensus_queue.cc:260] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.763960 12042 raft_consensus.cc:2466] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:00.764130 12166 ts_tablet_manager.cc:1428] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:00.764150 11920 raft_consensus.cc:2466] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:00.764171 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "295ddb94cd4f489c9d53875bd1578474" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.764540 11717 leader_election.cc:343] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.764704 11717 leader_election.cc:304] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:02:00.764973 11717 leader_election.cc:343] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.765034 11717 leader_election.cc:304] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.765281 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34bdfb2527c14c7985bc790dcb4d0657" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.765393 12208 raft_consensus.cc:2802] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.765429 13334 raft_consensus.cc:2747] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.765491 12208 raft_consensus.cc:695] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:00.765393 11781 raft_consensus.cc:2466] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:00.765612 12208 consensus_queue.cc:237] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.766254 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_360fe7f59412486a937f42de9bb0bf9a [id=62132df62b3a42fb9886592b9b885d31] alter complete (version 3)
I20250625 14:02:00.766497 12167 tablet_bootstrap.cc:492] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.766583 12167 ts_tablet_manager.cc:1397] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:00.767055 12167 raft_consensus.cc:357] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.767149 12167 raft_consensus.cc:383] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.767177 12167 raft_consensus.cc:738] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.767319 12167 consensus_queue.cc:260] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.768739 12167 ts_tablet_manager.cc:1428] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:00.769089 12167 tablet_bootstrap.cc:492] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:02:00.769412 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b3819dec2c834c40846dcb3a11fa4f5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3819dec2c834c40846dcb3a11fa4f5f already in progress: creating tablet
I20250625 14:02:00.769510 11918 raft_consensus.cc:2466] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:00.769584 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 3d5c9b7412d148a38fd61eb4629db359 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d5c9b7412d148a38fd61eb4629db359 already in progress: creating tablet
W20250625 14:02:00.769695 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ccf9474414824e6c84c2e81c52bb802a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccf9474414824e6c84c2e81c52bb802a already in progress: creating tablet
I20250625 14:02:00.769929 11990 leader_election.cc:304] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.770212 13121 raft_consensus.cc:2802] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.770265 13121 raft_consensus.cc:491] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.770376 13121 raft_consensus.cc:3058] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.770586 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ebcb19662b564c958aca93f4b956a713"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.770998 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebcb19662b564c958aca93f4b956a713 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.771479 13121 raft_consensus.cc:513] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.771838 13121 leader_election.cc:290] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.773198 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_be63dac05c624f438a43ab9a8f12cfe3" } new_table_name: "default.Table_67c0588df36842488fcf1789bb9e0c88" modify_external_catalogs: true
I20250625 14:02:00.773602 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 1df220bf9c8447c5ac4ad35a145a8796 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.773767 12177 tablet_replica.cc:331] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.773909 12177 raft_consensus.cc:2241] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.774017 12166 tablet_bootstrap.cc:492] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.774015 12177 raft_consensus.cc:2270] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.774399 12177 ts_tablet_manager.cc:1905] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.773972 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34bdfb2527c14c7985bc790dcb4d0657" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:00.775249 11918 raft_consensus.cc:3058] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.775439 12166 tablet_bootstrap.cc:654] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.775758 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 594d394be3f54a3bb2b7d4705e1877d5 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.770264 12167 tablet_bootstrap.cc:654] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.776373 11918 raft_consensus.cc:2466] T 34bdfb2527c14c7985bc790dcb4d0657 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
W20250625 14:02:00.776724 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet ccf9474414824e6c84c2e81c52bb802a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccf9474414824e6c84c2e81c52bb802a already in progress: creating tablet
I20250625 14:02:00.776866 12177 ts_tablet_manager.cc:1918] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.776933 12177 log.cc:1199] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/1df220bf9c8447c5ac4ad35a145a8796
I20250625 14:02:00.777144 12177 ts_tablet_manager.cc:1939] T 1df220bf9c8447c5ac4ad35a145a8796 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.777153 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet be4378f7781541d7866e6d5c440b13e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.777575 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet a4199634a8be4e359cc9707d4754cac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.777626 12166 tablet_bootstrap.cc:492] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.777707 12166 ts_tablet_manager.cc:1397] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:00.778236 11990 leader_election.cc:304] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.778218 12166 raft_consensus.cc:357] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.778335 12166 raft_consensus.cc:383] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.778365 12166 raft_consensus.cc:738] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.778477 12166 consensus_queue.cc:260] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.778517 13121 raft_consensus.cc:2802] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.778594 13121 raft_consensus.cc:695] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:00.778759 12166 ts_tablet_manager.cc:1428] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.778712 13121 consensus_queue.cc:237] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.780699 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 9bd4226d952d4dc394c33acae7372347 with delete_type TABLET_DATA_DELETED (replaced by tablet b215f2dc28604d1387e9847a5247564d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.782253 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet d3cf1f09ba14436cbdce5a58da0f202d with delete_type TABLET_DATA_DELETED (replaced by tablet 714bb5a28ec648f990fa1525a1b50129) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.782222 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1f75a3a066b14db6b75d2a209efd27e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.782640 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f75a3a066b14db6b75d2a209efd27e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.783620 12167 tablet_bootstrap.cc:492] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.783703 12167 ts_tablet_manager.cc:1397] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20250625 14:02:00.783960 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 140c1810e98741479c3754729409b46c with delete_type TABLET_DATA_DELETED (replaced by tablet 3e56586f5cd745a397bf6ed1a63d070e) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:00.784197 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdbebbb725564dc98c30ce4bbd3af8db consensus state has no leader
I20250625 14:02:00.784235 12167 raft_consensus.cc:357] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.784336 12167 raft_consensus.cc:383] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.784371 12167 raft_consensus.cc:738] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.784480 12167 consensus_queue.cc:260] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.784759 12167 ts_tablet_manager.cc:1428] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.784945 12167 tablet_bootstrap.cc:492] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.785353 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 44dd83c53b15400d94bb7b1a8784569a) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.785769 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f40caafd5e4557af321454d28fa2ab with delete_type TABLET_DATA_DELETED (replaced by tablet dfbf6959677547a6a2582b73b2be4c03) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.786151 12167 tablet_bootstrap.cc:654] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.786679 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet a4199634a8be4e359cc9707d4754cac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.787326 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e5c492cb21c45f391aa20780f680d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.787834 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "34bdfb2527c14c7985bc790dcb4d0657" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.787976 11781 raft_consensus.cc:3058] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.787995 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet c751d05cac1d4d65965e0aca2a94c14a with delete_type TABLET_DATA_DELETED (replaced by tablet 288e0c1644a34b8dabc06ccdda9f0fa9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.789011 11781 raft_consensus.cc:2466] T 34bdfb2527c14c7985bc790dcb4d0657 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:00.791033 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]). Expected version 3 got 0
I20250625 14:02:00.791167 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a4ca3d5203a64d99912765b83af97c09 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]). Expected version 1 got 0
I20250625 14:02:00.792704 12166 tablet_bootstrap.cc:492] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.793785 12166 tablet_bootstrap.cc:654] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.793853 12173 ts_tablet_manager.cc:1918] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.794849 12173 log.cc:1199] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/cc9e2afd5bc443398293d0ed572f6c05
I20250625 14:02:00.795095 12173 ts_tablet_manager.cc:1939] T cc9e2afd5bc443398293d0ed572f6c05 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.795110 12172 tablet_bootstrap.cc:492] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.795199 12172 ts_tablet_manager.cc:1397] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.001s
I20250625 14:02:00.795830 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet cc9e2afd5bc443398293d0ed572f6c05 (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:02:00.796241 12172 raft_consensus.cc:357] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.796346 12172 raft_consensus.cc:383] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.796383 12172 raft_consensus.cc:738] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.796514 12172 consensus_queue.cc:260] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.796788 12173 tablet_replica.cc:331] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.796802 12172 ts_tablet_manager.cc:1428] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.796922 12173 raft_consensus.cc:2241] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.796986 13241 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7
I20250625 14:02:00.797039 12173 raft_consensus.cc:2270] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.797469 13352 raft_consensus.cc:491] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.797551 13352 raft_consensus.cc:513] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.797904 13352 leader_election.cc:290] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.799768 12173 ts_tablet_manager.cc:1905] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.800072 12172 tablet_bootstrap.cc:492] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:00.800088 11990 leader_election.cc:343] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: be4378f7781541d7866e6d5c440b13e6
I20250625 14:02:00.801229 12172 tablet_bootstrap.cc:654] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.802954 12177 tablet_replica.cc:331] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.803174 12177 raft_consensus.cc:2241] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.803333 12177 raft_consensus.cc:2270] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.803735 12172 tablet_bootstrap.cc:492] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.803754 12177 ts_tablet_manager.cc:1905] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.803830 12172 ts_tablet_manager.cc:1397] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:00.804364 12172 raft_consensus.cc:357] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.804468 12172 raft_consensus.cc:383] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.804507 12172 raft_consensus.cc:738] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.804903 12173 ts_tablet_manager.cc:1918] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.804996 12173 log.cc:1199] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d74f27d998b14ee890272812b718e468
I20250625 14:02:00.805253 12173 ts_tablet_manager.cc:1939] T d74f27d998b14ee890272812b718e468 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.805768 12558 consensus_queue.cc:1035] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.805982 12173 tablet_replica.cc:331] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.806109 12172 consensus_queue.cc:260] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.806336 12173 raft_consensus.cc:2241] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.806466 12173 raft_consensus.cc:2270] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.806849 12173 ts_tablet_manager.cc:1905] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.806877 12172 ts_tablet_manager.cc:1428] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:00.807075 12172 tablet_bootstrap.cc:492] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.807830 12177 ts_tablet_manager.cc:1918] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.807911 12177 log.cc:1199] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d3cf1f09ba14436cbdce5a58da0f202d
I20250625 14:02:00.808127 12177 ts_tablet_manager.cc:1939] T d3cf1f09ba14436cbdce5a58da0f202d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.808210 12172 tablet_bootstrap.cc:654] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.808439 12177 tablet_replica.cc:331] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.808566 12177 raft_consensus.cc:2241] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.808658 12177 raft_consensus.cc:2270] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.809088 12173 ts_tablet_manager.cc:1918] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:00.809152 12173 log.cc:1199] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/fb8c57c541114222b81dff868b1529f6
I20250625 14:02:00.809396 12173 ts_tablet_manager.cc:1939] T fb8c57c541114222b81dff868b1529f6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.809948 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d74f27d998b14ee890272812b718e468 (table default.Table_7eea033a0ebc4712a45ee52653e09a47 [id=06f86a5adb9a4fccb3756ff3fc5aef9c]) successfully deleted
W20250625 14:02:00.810125 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a36ed3e126ef4edfa69fcffb098d0e4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a36ed3e126ef4edfa69fcffb098d0e4f already in progress: creating tablet
I20250625 14:02:00.810253 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet fb8c57c541114222b81dff868b1529f6 (table default.Table_899a1eb5d58f478a87063fafb95aa819 [id=83f715a6270c49f7b0986d2b05d73b44]) successfully deleted
I20250625 14:02:00.810811 12172 tablet_bootstrap.cc:492] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.811540 12172 ts_tablet_manager.cc:1397] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:00.811707 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 1df220bf9c8447c5ac4ad35a145a8796 (table default.Table_6e519c7cc312409181ac8bca5e400b80 [id=5ead0c4cbc05488789ec165f1dd645fb]) successfully deleted
I20250625 14:02:00.812270 12172 raft_consensus.cc:357] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.812381 12172 raft_consensus.cc:383] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.812414 12172 raft_consensus.cc:738] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.812549 12172 consensus_queue.cc:260] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:00.813127 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 0f6c287461864f6dba5f47711eb69fae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f6c287461864f6dba5f47711eb69fae already in progress: creating tablet
I20250625 14:02:00.813393 12173 tablet_replica.cc:331] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.813529 12173 raft_consensus.cc:2241] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:02:00.813634 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet fee20f2812d34d188b7181e6da00f823 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fee20f2812d34d188b7181e6da00f823 already in progress: creating tablet
I20250625 14:02:00.813714 12173 pending_rounds.cc:70] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:00.813755 12173 pending_rounds.cc:77] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523053297356800 op_type: NO_OP noop_request { }
I20250625 14:02:00.813822 12173 raft_consensus.cc:2887] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:00.813889 12173 raft_consensus.cc:2270] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:00.814013 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c4c32692666047fe9a18a75e66365e16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4c32692666047fe9a18a75e66365e16 already in progress: creating tablet
W20250625 14:02:00.814241 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 84a1eb4471544de9afbb5b35d0071dcc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84a1eb4471544de9afbb5b35d0071dcc already in progress: creating tablet
I20250625 14:02:00.814451 12173 ts_tablet_manager.cc:1905] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:00.814446 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4f651f79ee034dd28e44092b7de29bf3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f651f79ee034dd28e44092b7de29bf3 already in progress: creating tablet
W20250625 14:02:00.814639 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 717254244e9b4cf399c231a37480a3a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717254244e9b4cf399c231a37480a3a1 already in progress: creating tablet
I20250625 14:02:00.812901 12172 ts_tablet_manager.cc:1428] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:00.815315 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b9a788be0b8640dc9d6d06fa86580f6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a788be0b8640dc9d6d06fa86580f6b already in progress: creating tablet
W20250625 14:02:00.815505 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 292e9c27637d410ea487761f50bdee88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 292e9c27637d410ea487761f50bdee88 already in progress: creating tablet
I20250625 14:02:00.814976 12172 tablet_bootstrap.cc:492] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:00.815773 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 39b41ff066cb499fae9b71ca1f2f9d2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39b41ff066cb499fae9b71ca1f2f9d2b already in progress: creating tablet
I20250625 14:02:00.816648 12172 tablet_bootstrap.cc:654] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.816859 12173 ts_tablet_manager.cc:1918] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:00.816936 12173 log.cc:1199] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d3cf1f09ba14436cbdce5a58da0f202d
I20250625 14:02:00.817255 12173 ts_tablet_manager.cc:1939] T d3cf1f09ba14436cbdce5a58da0f202d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.817564 12953 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7
I20250625 14:02:00.817674 12172 tablet_bootstrap.cc:492] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.817747 12172 ts_tablet_manager.cc:1397] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:00.818127 11525 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_ec61af86da054876a97a43f9e1e13a61 [id=05ba3fb82ea74715a67dbefb3018db83] alter complete (version 7)
I20250625 14:02:00.818197 12173 tablet_replica.cc:331] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.818339 12173 raft_consensus.cc:2241] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.818423 12172 raft_consensus.cc:357] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.818526 12172 raft_consensus.cc:383] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.818562 12172 raft_consensus.cc:738] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.818573 12173 raft_consensus.cc:2270] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.818663 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.818893 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet e9476529c1b7401683c02e146f54a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.818958 12173 ts_tablet_manager.cc:1905] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.818670 12172 consensus_queue.cc:260] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.819161 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 295ddb94cd4f489c9d53875bd1578474 with delete_type TABLET_DATA_DELETED (replaced by tablet 881295234a5b4a089985382765774cd9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.819281 12172 ts_tablet_manager.cc:1428] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.819396 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.819460 12172 tablet_bootstrap.cc:492] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.819624 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.819857 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet e15bd70671f8458db5b9e52423189eda with delete_type TABLET_DATA_DELETED (replaced by tablet 1d596792632e4e32be161450f46b4168) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.820104 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 44dd83c53b15400d94bb7b1a8784569a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.820458 12172 tablet_bootstrap.cc:654] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.821060 12173 ts_tablet_manager.cc:1918] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:00.821137 12173 log.cc:1199] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c940a9f7ada54b48940e90c822c84735
I20250625 14:02:00.821849 13244 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7
I20250625 14:02:00.822119 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d3cf1f09ba14436cbdce5a58da0f202d (table default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]) successfully deleted
W20250625 14:02:00.822444 11993 leader_election.cc:343] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: be4378f7781541d7866e6d5c440b13e6
I20250625 14:02:00.822535 11993 leader_election.cc:304] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:00.822808 13352 raft_consensus.cc:2747] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.822899 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d3cf1f09ba14436cbdce5a58da0f202d (table default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f [id=bdc2377687234802984c679833d91825]) successfully deleted
W20250625 14:02:00.823082 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d8227e0205bb4b9fa9b8047558cf9a1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8227e0205bb4b9fa9b8047558cf9a1c already in progress: creating tablet
I20250625 14:02:00.824345 12172 tablet_bootstrap.cc:492] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.824451 12172 ts_tablet_manager.cc:1397] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:00.825027 12172 raft_consensus.cc:357] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.825152 12172 raft_consensus.cc:383] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.825191 12172 raft_consensus.cc:738] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.825330 12172 consensus_queue.cc:260] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.825677 12172 ts_tablet_manager.cc:1428] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.825843 12172 tablet_bootstrap.cc:492] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.826853 12172 tablet_bootstrap.cc:654] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.827081 12173 ts_tablet_manager.cc:1939] T c940a9f7ada54b48940e90c822c84735 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.828610 12177 ts_tablet_manager.cc:1905] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.830725 12177 ts_tablet_manager.cc:1918] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.830827 12177 log.cc:1199] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/140c1810e98741479c3754729409b46c
I20250625 14:02:00.831066 12177 ts_tablet_manager.cc:1939] T 140c1810e98741479c3754729409b46c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.831367 12177 tablet_replica.cc:331] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.831506 12177 raft_consensus.cc:2241] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.831626 12177 raft_consensus.cc:2270] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.831735 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c940a9f7ada54b48940e90c822c84735 (table default.Table_3b2a6658d99941f893979414a2301394 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]) successfully deleted
W20250625 14:02:00.832131 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b3819dec2c834c40846dcb3a11fa4f5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3819dec2c834c40846dcb3a11fa4f5f already in progress: creating tablet
W20250625 14:02:00.832561 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 3d5c9b7412d148a38fd61eb4629db359 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d5c9b7412d148a38fd61eb4629db359 already in progress: creating tablet
W20250625 14:02:00.832753 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 47ed422d7a274075b5e44cd9a59e370f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47ed422d7a274075b5e44cd9a59e370f already in progress: creating tablet
W20250625 14:02:00.833078 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet ccf9474414824e6c84c2e81c52bb802a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccf9474414824e6c84c2e81c52bb802a already in progress: creating tablet
I20250625 14:02:00.833123 12173 tablet_replica.cc:331] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.833379 12173 raft_consensus.cc:2241] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.833580 12173 raft_consensus.cc:2270] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.831709 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 140c1810e98741479c3754729409b46c (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
I20250625 14:02:00.834335 12173 ts_tablet_manager.cc:1905] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.834853 12177 ts_tablet_manager.cc:1905] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.836724 12172 tablet_bootstrap.cc:492] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:00.836848 12172 ts_tablet_manager.cc:1397] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:02:00.837185 12173 ts_tablet_manager.cc:1918] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.837271 12173 log.cc:1199] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/be4378f7781541d7866e6d5c440b13e6
I20250625 14:02:00.837407 12172 raft_consensus.cc:357] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.837512 12173 ts_tablet_manager.cc:1939] T be4378f7781541d7866e6d5c440b13e6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.837514 12172 raft_consensus.cc:383] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.837581 12177 ts_tablet_manager.cc:1918] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.837604 12172 raft_consensus.cc:738] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.837932 12172 consensus_queue.cc:260] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:00.838270 12172 ts_tablet_manager.cc:1428] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.838541 12172 tablet_bootstrap.cc:492] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:00.839543 12172 tablet_bootstrap.cc:654] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.837718 12177 log.cc:1199] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/21908df7bb384e9782b97abe6f06b0f5
I20250625 14:02:00.840406 12177 ts_tablet_manager.cc:1939] T 21908df7bb384e9782b97abe6f06b0f5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.840759 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet c1c05e534c804eb69e0c249a03418941 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.841025 12558 raft_consensus.cc:491] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.841125 12558 raft_consensus.cc:513] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.841547 12558 leader_election.cc:290] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.841599 12166 tablet_bootstrap.cc:492] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.841676 12166 ts_tablet_manager.cc:1397] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20250625 14:02:00.842260 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c751d05cac1d4d65965e0aca2a94c14a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.842420 11781 raft_consensus.cc:2466] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.842612 12166 raft_consensus.cc:357] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.842621 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c751d05cac1d4d65965e0aca2a94c14a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.842707 12166 raft_consensus.cc:383] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.842739 12166 raft_consensus.cc:738] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.842743 12047 raft_consensus.cc:2466] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.842865 12166 consensus_queue.cc:260] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.842916 11858 leader_election.cc:304] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.843164 12166 ts_tablet_manager.cc:1428] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20250625 14:02:00.843333 12166 tablet_bootstrap.cc:492] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.844723 12177 tablet_replica.cc:331] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.844723 12558 raft_consensus.cc:2802] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.844785 12558 raft_consensus.cc:491] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.844779 12173 tablet_replica.cc:331] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.844834 12558 raft_consensus.cc:3058] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.844934 12173 raft_consensus.cc:2241] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.844940 12177 raft_consensus.cc:2241] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.845042 12177 raft_consensus.cc:2270] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.845046 12173 raft_consensus.cc:2270] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.845386 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet be4378f7781541d7866e6d5c440b13e6 (table default.Table_c0aa8bb1b9b2417aa42dddc6bc8d31b0 [id=033b59dd293a483e9ecda65417ceecf4]) successfully deleted
I20250625 14:02:00.845530 12177 ts_tablet_manager.cc:1905] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.845613 12173 ts_tablet_manager.cc:1905] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.845923 12558 raft_consensus.cc:513] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.846261 12558 leader_election.cc:290] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.846984 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c751d05cac1d4d65965e0aca2a94c14a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.847111 12047 raft_consensus.cc:3058] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.847450 12166 tablet_bootstrap.cc:654] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.847978 12167 tablet_bootstrap.cc:492] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.848070 12167 ts_tablet_manager.cc:1397] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.000s
I20250625 14:02:00.848070 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c751d05cac1d4d65965e0aca2a94c14a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.848187 11781 raft_consensus.cc:3058] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.848295 12047 raft_consensus.cc:2466] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.848562 12167 raft_consensus.cc:357] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.848663 12167 raft_consensus.cc:383] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.848699 12167 raft_consensus.cc:738] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.848711 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c1c05e534c804eb69e0c249a03418941
I20250625 14:02:00.848829 12167 consensus_queue.cc:260] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.849063 11529 catalog_manager.cc:6652] ReplaceTablet: tablet c1c05e534c804eb69e0c249a03418941 deleted and replaced by tablet d588175174d64966a2f268d8cab437bc
I20250625 14:02:00.849110 12167 ts_tablet_manager.cc:1428] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.849334 12167 tablet_bootstrap.cc:492] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.849450 11781 raft_consensus.cc:2466] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.850500 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet c1c05e534c804eb69e0c249a03418941 with delete_type TABLET_DATA_DELETED (replaced by tablet d588175174d64966a2f268d8cab437bc) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.851514 13335 raft_consensus.cc:491] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.851776 13335 raft_consensus.cc:513] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.852051 12173 ts_tablet_manager.cc:1918] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.852110 12173 log.cc:1199] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a4199634a8be4e359cc9707d4754cac9
I20250625 14:02:00.852209 13335 leader_election.cc:290] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.852337 12173 ts_tablet_manager.cc:1939] T a4199634a8be4e359cc9707d4754cac9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.853652 12177 ts_tablet_manager.cc:1918] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.853802 12177 log.cc:1199] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f2f40caafd5e4557af321454d28fa2ab
I20250625 14:02:00.853973 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a4199634a8be4e359cc9707d4754cac9 (table default.Table_d996cc697ed246c7b1118cdd14e3450c [id=f5c7890a67b34de29d7bb56262c9e0c3]) successfully deleted
I20250625 14:02:00.854154 12177 ts_tablet_manager.cc:1939] T f2f40caafd5e4557af321454d28fa2ab P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.854434 12167 tablet_bootstrap.cc:654] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.854611 12173 tablet_replica.cc:331] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.854755 12173 raft_consensus.cc:2241] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.854875 12173 raft_consensus.cc:2270] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.855278 12177 tablet_replica.cc:331] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.855403 12173 ts_tablet_manager.cc:1905] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.855526 12177 raft_consensus.cc:2241] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:00.855715 12177 pending_rounds.cc:70] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:00.855798 12177 pending_rounds.cc:77] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523054657843200 op_type: NO_OP noop_request { }
I20250625 14:02:00.855934 12177 raft_consensus.cc:2887] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:00.856065 12177 raft_consensus.cc:2270] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.851303 11855 leader_election.cc:304] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.851430 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet c1c05e534c804eb69e0c249a03418941 with delete_type TABLET_DATA_DELETED (replaced by tablet d588175174d64966a2f268d8cab437bc) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.856702 12175 tablet_replica.cc:331] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.856871 12175 raft_consensus.cc:2241] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.856988 12175 raft_consensus.cc:2270] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.857312 12558 raft_consensus.cc:2802] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.857404 12558 raft_consensus.cc:695] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:00.857535 12558 consensus_queue.cc:237] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.857685 12175 ts_tablet_manager.cc:1905] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.860047 12175 ts_tablet_manager.cc:1918] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:00.860131 12175 log.cc:1199] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c1c05e534c804eb69e0c249a03418941
I20250625 14:02:00.860095 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3e56586f5cd745a397bf6ed1a63d070e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.860396 12175 ts_tablet_manager.cc:1939] T c1c05e534c804eb69e0c249a03418941 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.860757 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 21908df7bb384e9782b97abe6f06b0f5 (table default.Table_99ef32b961ed4799869db0bddb6346de [id=55cc2676447f4267a1b31fb53a7705dd]) successfully deleted
I20250625 14:02:00.860800 12173 ts_tablet_manager.cc:1918] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.860867 12173 log.cc:1199] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9bd4226d952d4dc394c33acae7372347
I20250625 14:02:00.861066 12173 ts_tablet_manager.cc:1939] T 9bd4226d952d4dc394c33acae7372347 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.861372 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f2f40caafd5e4557af321454d28fa2ab (table default.Table_bb1104be50d8484ab10c1efe62b44b88 [id=70d3fc86e64847b9b7edd7945c195dc6]) successfully deleted
I20250625 14:02:00.861480 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3e56586f5cd745a397bf6ed1a63d070e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.861781 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]) successfully deleted
I20250625 14:02:00.861974 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet c1c05e534c804eb69e0c249a03418941 with delete_type TABLET_DATA_DELETED (replaced by tablet d588175174d64966a2f268d8cab437bc) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:00.862296 11717 leader_election.cc:343] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:00.862471 11717 leader_election.cc:343] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.862517 11717 leader_election.cc:304] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.862639 13335 raft_consensus.cc:2747] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.863032 12173 tablet_replica.cc:331] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.863180 12173 raft_consensus.cc:2241] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:00.863359 12173 raft_consensus.cc:2270] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.863631 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9bd4226d952d4dc394c33acae7372347 (table default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]) successfully deleted
I20250625 14:02:00.864001 12173 ts_tablet_manager.cc:1905] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.864535 12167 tablet_bootstrap.cc:492] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:00.864616 12167 ts_tablet_manager.cc:1397] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.001s
I20250625 14:02:00.865087 12167 raft_consensus.cc:357] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.865192 12167 raft_consensus.cc:383] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.865223 12167 raft_consensus.cc:738] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.865334 12167 consensus_queue.cc:260] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.865602 12167 ts_tablet_manager.cc:1428] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:00.865787 12167 tablet_bootstrap.cc:492] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:00.867591 12167 tablet_bootstrap.cc:654] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.868772 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet fae1eddf1156499aa346502f7a200125 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.868897 12166 tablet_bootstrap.cc:492] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:00.868995 12166 ts_tablet_manager.cc:1397] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20250625 14:02:00.868930 11533 catalog_manager.cc:5582] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:00.869555 12166 raft_consensus.cc:357] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.869627 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.869669 12166 raft_consensus.cc:383] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:00.869702 12166 raft_consensus.cc:738] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:00.869837 12166 consensus_queue.cc:260] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.870146 12166 ts_tablet_manager.cc:1428] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:00.870374 12166 tablet_bootstrap.cc:492] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:00.870606 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 75562ea1650c4bdcbf38574465f62ce2 (DEFAULT_TABLE table=default.Table_c147de4a592443e78b2ef153e8783ed6 [id=93904e68de784a798391f426f62e28bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.870877 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75562ea1650c4bdcbf38574465f62ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.871605 12166 tablet_bootstrap.cc:654] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:00.873829 12173 ts_tablet_manager.cc:1918] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:00.873951 12173 log.cc:1199] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c1c05e534c804eb69e0c249a03418941
I20250625 14:02:00.874265 12173 ts_tablet_manager.cc:1939] T c1c05e534c804eb69e0c249a03418941 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.874578 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 75562ea1650c4bdcbf38574465f62ce2 (DEFAULT_TABLE table=default.Table_c147de4a592443e78b2ef153e8783ed6 [id=93904e68de784a798391f426f62e28bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.874836 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 1543af6914f44570a055b91f50062670 (DEFAULT_TABLE table=default.Table_9b8a6b5a7ff34d5486a1887a30984012 [id=e52939d3952f44d3a68a118d3e58a1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.874935 12024 tablet_service.cc:1468] Processing CreateTablet for tablet 2a7f037177d848aea7d2944fc2a5542d (DEFAULT_TABLE table=default.Table_116f4ad3308c453886c2f4677959cd83 [id=6942ace3779642069ec3a616db6123d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.874961 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 416051713df3450380929ca7e3cd8ba9 (DEFAULT_TABLE table=default.Table_1dfc0921c4484867bf51830bb4924a19 [id=c87a6d7cda824e0b84cba6b6de0b05fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.875176 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 5ea3aa2ef74f467dbb4238f58028a270 (DEFAULT_TABLE table=default.Table_ee455592e1bf4f1596f36d91b207154f [id=bce509beb3474d97805654e806eebdf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.874836 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 6b4698a9bb24468485d1e64e41aae8f3 (DEFAULT_TABLE table=default.Table_3b2a6658d99941f893979414a2301394 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.875419 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4 (DEFAULT_TABLE table=default.Table_6669033348ee4fa6bce045320700534b [id=5e8ec1bbbe4c4b3ba7d22d5907942c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.875665 12028 tablet_service.cc:1468] Processing CreateTablet for tablet c1204bd717034944942e317ca50466a9 (DEFAULT_TABLE table=default.Table_a15909878962425e8ac28f041e57b699 [id=2423be9f2597425aa4df59cb52a712a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.875918 12026 tablet_service.cc:1468] Processing CreateTablet for tablet d687605912a544fc945eb45e30ce0f1d (DEFAULT_TABLE table=default.Table_d2bbefbdbd3541e183f3c3412e226554 [id=e8a8f7b51e4544b59447cf3829ef7251]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.876366 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4698a9bb24468485d1e64e41aae8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.877357 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fb8735736377472582a9ec36a82e90e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.877833 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb8735736377472582a9ec36a82e90e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.877826 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 416051713df3450380929ca7e3cd8ba9 (DEFAULT_TABLE table=default.Table_1dfc0921c4484867bf51830bb4924a19 [id=c87a6d7cda824e0b84cba6b6de0b05fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.878196 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416051713df3450380929ca7e3cd8ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.878520 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_711bc5a641614b02bfd29d577629b3b1" } modify_external_catalogs: true
I20250625 14:02:00.878619 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_711bc5a641614b02bfd29d577629b3b1" } modify_external_catalogs: true
I20250625 14:02:00.879964 12177 ts_tablet_manager.cc:1905] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.881433 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 75562ea1650c4bdcbf38574465f62ce2 (DEFAULT_TABLE table=default.Table_c147de4a592443e78b2ef153e8783ed6 [id=93904e68de784a798391f426f62e28bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.881731 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75562ea1650c4bdcbf38574465f62ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.882977 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 6b4698a9bb24468485d1e64e41aae8f3 (DEFAULT_TABLE table=default.Table_3b2a6658d99941f893979414a2301394 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.883268 11422 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu with pid 11430
I20250625 14:02:00.884384 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 6b4698a9bb24468485d1e64e41aae8f3 (DEFAULT_TABLE table=default.Table_3b2a6658d99941f893979414a2301394 [id=fd301ff410ac4d2ca79e2eed57e9d9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.884649 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 1543af6914f44570a055b91f50062670 (DEFAULT_TABLE table=default.Table_9b8a6b5a7ff34d5486a1887a30984012 [id=e52939d3952f44d3a68a118d3e58a1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.884707 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet a4199634a8be4e359cc9707d4754cac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.884919 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 2a7f037177d848aea7d2944fc2a5542d (DEFAULT_TABLE table=default.Table_116f4ad3308c453886c2f4677959cd83 [id=6942ace3779642069ec3a616db6123d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.884989 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 416051713df3450380929ca7e3cd8ba9 (DEFAULT_TABLE table=default.Table_1dfc0921c4484867bf51830bb4924a19 [id=c87a6d7cda824e0b84cba6b6de0b05fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.885241 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 5ea3aa2ef74f467dbb4238f58028a270 (DEFAULT_TABLE table=default.Table_ee455592e1bf4f1596f36d91b207154f [id=bce509beb3474d97805654e806eebdf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.885700 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4698a9bb24468485d1e64e41aae8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.886932 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1543af6914f44570a055b91f50062670. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.888303 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1543af6914f44570a055b91f50062670. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.888482 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 594d394be3f54a3bb2b7d4705e1877d5
I20250625 14:02:00.888773 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 594d394be3f54a3bb2b7d4705e1877d5 deleted and replaced by tablet b778a1b075794c0a86992066a14d5e11
I20250625 14:02:00.890617 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 140c1810e98741479c3754729409b46c with delete_type TABLET_DATA_DELETED (replaced by tablet 3e56586f5cd745a397bf6ed1a63d070e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.890758 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e5c492cb21c45f391aa20780f680d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.890820 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7f037177d848aea7d2944fc2a5542d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.891018 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4 (DEFAULT_TABLE table=default.Table_6669033348ee4fa6bce045320700534b [id=5e8ec1bbbe4c4b3ba7d22d5907942c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.891122 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 594d394be3f54a3bb2b7d4705e1877d5 with delete_type TABLET_DATA_DELETED (replaced by tablet b778a1b075794c0a86992066a14d5e11) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.891256 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.891266 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 140c1810e98741479c3754729409b46c with delete_type TABLET_DATA_DELETED (replaced by tablet 3e56586f5cd745a397bf6ed1a63d070e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.891352 13121 raft_consensus.cc:491] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.891362 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e5c492cb21c45f391aa20780f680d5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.891448 13121 raft_consensus.cc:513] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.891722 12173 tablet_replica.cc:331] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.891829 13121 leader_election.cc:290] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.891840 12173 raft_consensus.cc:2241] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:02:00.891952 13121 raft_consensus.cc:668] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20250625 14:02:00.891961 12173 raft_consensus.cc:2270] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.892568 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96fcc61e48e549618197d34346ea5b16" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:00.892903 11990 leader_election.cc:343] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.892958 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet c751d05cac1d4d65965e0aca2a94c14a with delete_type TABLET_DATA_DELETED (replaced by tablet 288e0c1644a34b8dabc06ccdda9f0fa9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.893209 12173 ts_tablet_manager.cc:1905] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.893385 11897 tablet_service.cc:1468] Processing CreateTablet for tablet c1204bd717034944942e317ca50466a9 (DEFAULT_TABLE table=default.Table_a15909878962425e8ac28f041e57b699 [id=2423be9f2597425aa4df59cb52a712a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.893599 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1204bd717034944942e317ca50466a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.893777 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea3aa2ef74f467dbb4238f58028a270. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.893937 11901 tablet_service.cc:1468] Processing CreateTablet for tablet d687605912a544fc945eb45e30ce0f1d (DEFAULT_TABLE table=default.Table_d2bbefbdbd3541e183f3c3412e226554 [id=e8a8f7b51e4544b59447cf3829ef7251]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.894155 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d687605912a544fc945eb45e30ce0f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.895061 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a38a4acaaaac4b67a46b3eb0eb079312" } new_table_name: "default.Table_c2fa6c9333664dedaedb249e523d7f55" modify_external_catalogs: true
I20250625 14:02:00.895581 12173 ts_tablet_manager.cc:1918] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.895640 12173 log.cc:1199] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/140c1810e98741479c3754729409b46c
I20250625 14:02:00.895839 12173 ts_tablet_manager.cc:1939] T 140c1810e98741479c3754729409b46c P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.896591 12173 tablet_replica.cc:331] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.896728 12173 raft_consensus.cc:2241] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.896819 12173 raft_consensus.cc:2270] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.896931 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416051713df3450380929ca7e3cd8ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.897336 12173 ts_tablet_manager.cc:1905] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.898505 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]) successfully deleted
W20250625 14:02:00.898654 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 594d394be3f54a3bb2b7d4705e1877d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 594d394be3f54a3bb2b7d4705e1877d5 already in progress: creating tablet
I20250625 14:02:00.898793 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 140c1810e98741479c3754729409b46c (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
I20250625 14:02:00.899288 12173 ts_tablet_manager.cc:1918] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.899346 12173 log.cc:1199] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/2e5c492cb21c45f391aa20780f680d5f
I20250625 14:02:00.899605 12173 ts_tablet_manager.cc:1939] T 2e5c492cb21c45f391aa20780f680d5f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.900722 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5f7bbc6f086d49d7830d47d9db4ebf7b
I20250625 14:02:00.901508 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9e3ac56046254085872f6bb408f6dcce" } new_table_name: "default.Table_de445b22ad884186ad267d577630e845" modify_external_catalogs: true
I20250625 14:02:00.903652 12175 tablet_replica.cc:331] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.903585 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c3c339b91e554ca48078afe01a438fd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.903788 12175 raft_consensus.cc:2241] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.903888 12175 raft_consensus.cc:2270] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:00.903987 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3c339b91e554ca48078afe01a438fd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.904580 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.904924 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c55446b42ca8451480daa20ae8f25a22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.905082 12175 ts_tablet_manager.cc:1905] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:00.905270 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c55446b42ca8451480daa20ae8f25a22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.905470 13335 raft_consensus.cc:491] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.905587 13335 raft_consensus.cc:513] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.905726 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.905977 13335 leader_election.cc:290] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.906118 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 594d394be3f54a3bb2b7d4705e1877d5 with delete_type TABLET_DATA_DELETED (replaced by tablet b778a1b075794c0a86992066a14d5e11) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.907784 12558 raft_consensus.cc:491] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.907907 12558 raft_consensus.cc:513] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.908224 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416051713df3450380929ca7e3cd8ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.908360 12558 leader_election.cc:290] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.908397 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1204bd717034944942e317ca50466a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.910771 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d687605912a544fc945eb45e30ce0f1d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:00.911023 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13a2c2f498e24f47a12181a89dcbd769 consensus state has no leader
I20250625 14:02:00.911270 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e254b12c2c1c4aa2a47102fc27509dc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.911633 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e254b12c2c1c4aa2a47102fc27509dc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.912796 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.914340 12173 tablet_replica.cc:331] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.914491 12173 raft_consensus.cc:2241] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.914590 12173 raft_consensus.cc:2270] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.914696 13232 raft_consensus.cc:491] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.914765 13232 raft_consensus.cc:513] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.914906 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 2e5c492cb21c45f391aa20780f680d5f (table default.Table_e28b81e130be4741a8b96e733248cf1a [id=e7b04afa1b174d9ebd5d9a72d25605df]) successfully deleted
I20250625 14:02:00.915112 13232 leader_election.cc:290] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:00.915489 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7f037177d848aea7d2944fc2a5542d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.915513 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "21908df7bb384e9782b97abe6f06b0f5" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.915640 11918 raft_consensus.cc:2466] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:00.915944 11990 leader_election.cc:304] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.916363 12173 ts_tablet_manager.cc:1905] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.917687 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea3aa2ef74f467dbb4238f58028a270. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.918277 12175 ts_tablet_manager.cc:1918] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.918414 12175 log.cc:1199] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/a4199634a8be4e359cc9707d4754cac9
I20250625 14:02:00.918991 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fb1f0297ff443818507584b4ab00ddf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.919095 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75562ea1650c4bdcbf38574465f62ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.919135 11781 raft_consensus.cc:2466] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.919653 12173 ts_tablet_manager.cc:1918] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.919710 12173 log.cc:1199] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c751d05cac1d4d65965e0aca2a94c14a
W20250625 14:02:00.919875 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8cf54c149e444987817228977ac06c2d consensus state has no leader
I20250625 14:02:00.919909 12173 ts_tablet_manager.cc:1939] T c751d05cac1d4d65965e0aca2a94c14a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:00.910737 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fb1f0297ff443818507584b4ab00ddf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.921286 12047 raft_consensus.cc:2466] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.921463 13232 raft_consensus.cc:2802] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.921511 13232 raft_consensus.cc:491] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.921557 13232 raft_consensus.cc:3058] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.922283 13232 raft_consensus.cc:513] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.922794 13232 leader_election.cc:290] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:00.923099 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet d53e9ef9d5f64cb893a552ab0784c120 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.920279 12558 raft_consensus.cc:491] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.923723 12558 raft_consensus.cc:513] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.923888 12175 ts_tablet_manager.cc:1939] T a4199634a8be4e359cc9707d4754cac9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.924177 12558 leader_election.cc:290] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.921168 12265 raft_consensus.cc:491] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.924412 12265 raft_consensus.cc:513] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.924464 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "21908df7bb384e9782b97abe6f06b0f5" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:00.924540 11918 raft_consensus.cc:3058] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.924676 12175 tablet_replica.cc:331] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.924757 12265 leader_election.cc:290] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.924821 12175 raft_consensus.cc:2241] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.924894 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c751d05cac1d4d65965e0aca2a94c14a (table default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]) successfully deleted
I20250625 14:02:00.925017 12175 raft_consensus.cc:2270] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:00.925046 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f7bbc6f086d49d7830d47d9db4ebf7b already in progress: creating tablet
I20250625 14:02:00.925551 11918 raft_consensus.cc:2466] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:00.925621 12175 ts_tablet_manager.cc:1905] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.921625 11855 leader_election.cc:304] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.925879 11990 leader_election.cc:304] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.926417 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e5c492cb21c45f391aa20780f680d5f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.926548 12265 raft_consensus.cc:2802] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.926555 11781 raft_consensus.cc:2466] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.926599 12265 raft_consensus.cc:491] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.926637 12265 raft_consensus.cc:3058] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.926736 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0542b05b9bd5489995ff972289d4b9c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.926859 11782 raft_consensus.cc:2466] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.927021 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4 (DEFAULT_TABLE table=default.Table_6669033348ee4fa6bce045320700534b [id=5e8ec1bbbe4c4b3ba7d22d5907942c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.927156 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3822190b351d490d9f98f42c7e7d6682"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:00.927548 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3822190b351d490d9f98f42c7e7d6682 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.927649 12265 raft_consensus.cc:513] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.928079 12265 leader_election.cc:290] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.928478 11858 leader_election.cc:304] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.928529 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6d2f84fbfffb428d8c49c42421d9bb77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.928643 11858 leader_election.cc:304] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.928799 12600 raft_consensus.cc:2802] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.928846 12600 raft_consensus.cc:491] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.928893 12600 raft_consensus.cc:3058] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:00.928879 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d2f84fbfffb428d8c49c42421d9bb77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.929445 12175 ts_tablet_manager.cc:1918] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.929514 12175 log.cc:1199] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/140c1810e98741479c3754729409b46c
I20250625 14:02:00.929728 12175 ts_tablet_manager.cc:1939] T 140c1810e98741479c3754729409b46c P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.929848 12600 raft_consensus.cc:513] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.930240 12600 leader_election.cc:290] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.930362 12600 raft_consensus.cc:2802] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.930408 12600 raft_consensus.cc:491] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.930456 12600 raft_consensus.cc:3058] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.931560 12600 raft_consensus.cc:513] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.931923 12600 leader_election.cc:290] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.932255 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_daa46b6e09604fbe821817cc42384742" } modify_external_catalogs: true
I20250625 14:02:00.932366 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_daa46b6e09604fbe821817cc42384742" } modify_external_catalogs: true
I20250625 14:02:00.932483 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0542b05b9bd5489995ff972289d4b9c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.932606 11855 leader_election.cc:343] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 2e5c492cb21c45f391aa20780f680d5f
I20250625 14:02:00.932623 12047 raft_consensus.cc:2466] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:00.932693 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9cb2c3718ef74831b6cf225009595b1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.932845 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b4698a9bb24468485d1e64e41aae8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.933063 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0542b05b9bd5489995ff972289d4b9c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.933162 12042 raft_consensus.cc:3058] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.933167 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d2dc78ca4ab140898fcf05498f5a7003" } modify_external_catalogs: true
I20250625 14:02:00.933283 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d2dc78ca4ab140898fcf05498f5a7003" } modify_external_catalogs: true
I20250625 14:02:00.934041 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4cb1c030a37648f0aaffe6805c232499" } new_table_name: "default.Table_9b10f90014114258a8dbc17cfd7929b9" modify_external_catalogs: true
I20250625 14:02:00.934402 12042 raft_consensus.cc:2466] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.935338 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fb1f0297ff443818507584b4ab00ddf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:00.935418 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.935446 12056 raft_consensus.cc:3058] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.935551 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e5c492cb21c45f391aa20780f680d5f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.935667 11781 raft_consensus.cc:3058] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.935740 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0542b05b9bd5489995ff972289d4b9c5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.935820 11784 raft_consensus.cc:3058] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.936426 12056 raft_consensus.cc:2466] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.936571 11784 raft_consensus.cc:2466] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.936642 11781 raft_consensus.cc:2466] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
W20250625 14:02:00.936755 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cb2c3718ef74831b6cf225009595b1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.936982 11858 leader_election.cc:304] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.937510 12558 raft_consensus.cc:2802] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.937597 12558 raft_consensus.cc:695] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:00.937616 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5fb1f0297ff443818507584b4ab00ddf" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.937722 11782 raft_consensus.cc:3058] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.937739 12558 consensus_queue.cc:237] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.937201 11858 leader_election.cc:304] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:00.938618 12558 raft_consensus.cc:2802] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.938666 11782 raft_consensus.cc:2466] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:00.938688 12558 raft_consensus.cc:695] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:00.938804 12558 consensus_queue.cc:237] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.939340 12177 ts_tablet_manager.cc:1918] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:00.939417 12177 log.cc:1199] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a4199634a8be4e359cc9707d4754cac9
I20250625 14:02:00.939495 13232 raft_consensus.cc:2802] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.939589 13232 raft_consensus.cc:695] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:00.939662 12177 ts_tablet_manager.cc:1939] T a4199634a8be4e359cc9707d4754cac9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.939716 13232 consensus_queue.cc:237] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.940521 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dca578face4f4457a35e41ae7c8e62d9" } modify_external_catalogs: true
I20250625 14:02:00.940642 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dca578face4f4457a35e41ae7c8e62d9" } modify_external_catalogs: true
I20250625 14:02:00.940814 11858 leader_election.cc:304] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:02:00.941190 11855 leader_election.cc:343] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 2e5c492cb21c45f391aa20780f680d5f
I20250625 14:02:00.941502 12265 raft_consensus.cc:2802] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.941581 12265 raft_consensus.cc:695] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:00.941699 12265 consensus_queue.cc:237] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.942984 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.943017 11753 tablet_service.cc:1468] Processing CreateTablet for tablet d687605912a544fc945eb45e30ce0f1d (DEFAULT_TABLE table=default.Table_d2bbefbdbd3541e183f3c3412e226554 [id=e8a8f7b51e4544b59447cf3829ef7251]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.943308 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d687605912a544fc945eb45e30ce0f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.944371 13335 raft_consensus.cc:491] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.944448 13335 raft_consensus.cc:513] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.944815 13335 leader_election.cc:290] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.945183 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96fcc61e48e549618197d34346ea5b16" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:00.945299 11781 raft_consensus.cc:2466] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:00.945739 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 2a7f037177d848aea7d2944fc2a5542d (DEFAULT_TABLE table=default.Table_116f4ad3308c453886c2f4677959cd83 [id=6942ace3779642069ec3a616db6123d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.946012 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7f037177d848aea7d2944fc2a5542d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.946025 11993 leader_election.cc:304] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:00.946286 13121 raft_consensus.cc:2802] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:00.946388 13121 raft_consensus.cc:491] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:00.946429 13121 raft_consensus.cc:3058] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.946619 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet a4199634a8be4e359cc9707d4754cac9 (table default.Table_d996cc697ed246c7b1118cdd14e3450c [id=f5c7890a67b34de29d7bb56262c9e0c3]) successfully deleted
I20250625 14:02:00.946763 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 5ea3aa2ef74f467dbb4238f58028a270 (DEFAULT_TABLE table=default.Table_ee455592e1bf4f1596f36d91b207154f [id=bce509beb3474d97805654e806eebdf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.946831 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 140c1810e98741479c3754729409b46c (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
I20250625 14:02:00.946991 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea3aa2ef74f467dbb4238f58028a270. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.947572 13121 raft_consensus.cc:513] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.947999 13121 leader_election.cc:290] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:00.948406 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.948536 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 801fae4d88114ff29eacde80365b84a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.948644 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 594d394be3f54a3bb2b7d4705e1877d5 with delete_type TABLET_DATA_DELETED (replaced by tablet b778a1b075794c0a86992066a14d5e11) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:00.949249 11993 leader_election.cc:343] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 21908df7bb384e9782b97abe6f06b0f5
I20250625 14:02:00.949545 12045 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fce93c919a3446bb9999be958e08b500" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.949739 11993 leader_election.cc:343] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 21908df7bb384e9782b97abe6f06b0f5
I20250625 14:02:00.949915 11764 tablet_service.cc:1468] Processing CreateTablet for tablet c1204bd717034944942e317ca50466a9 (DEFAULT_TABLE table=default.Table_a15909878962425e8ac28f041e57b699 [id=2423be9f2597425aa4df59cb52a712a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.950179 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1204bd717034944942e317ca50466a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.952492 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96fcc61e48e549618197d34346ea5b16" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:00.952613 11781 raft_consensus.cc:3058] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:00.952749 12177 tablet_replica.cc:331] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.952864 12177 raft_consensus.cc:2241] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.952956 12177 raft_consensus.cc:2270] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:00.953012 11717 leader_election.cc:343] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.953325 12177 ts_tablet_manager.cc:1905] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:00.953424 11717 leader_election.cc:343] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 2e5c492cb21c45f391aa20780f680d5f
I20250625 14:02:00.953586 13335 consensus_queue.cc:1035] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:00.953718 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 1543af6914f44570a055b91f50062670 (DEFAULT_TABLE table=default.Table_9b8a6b5a7ff34d5486a1887a30984012 [id=e52939d3952f44d3a68a118d3e58a1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.953476 11781 raft_consensus.cc:2466] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:00.953958 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1543af6914f44570a055b91f50062670. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.954454 12175 tablet_replica.cc:331] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.954692 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "2e5c492cb21c45f391aa20780f680d5f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.954702 12175 raft_consensus.cc:2241] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:00.955052 12175 pending_rounds.cc:70] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:02:00.955091 12175 pending_rounds.cc:77] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523055366680576 op_type: NO_OP noop_request { }
I20250625 14:02:00.955159 12175 raft_consensus.cc:2887] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:00.955225 12175 raft_consensus.cc:2270] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.955643 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fce93c919a3446bb9999be958e08b500" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.955902 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96fcc61e48e549618197d34346ea5b16" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:00.956073 12175 ts_tablet_manager.cc:1905] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:00.956943 11990 leader_election.cc:343] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.957170 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a4199634a8be4e359cc9707d4754cac9 (table default.Table_d996cc697ed246c7b1118cdd14e3450c [id=f5c7890a67b34de29d7bb56262c9e0c3]) successfully deleted
I20250625 14:02:00.957429 12177 ts_tablet_manager.cc:1918] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.957490 11993 leader_election.cc:304] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:00.958365 13335 raft_consensus.cc:491] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.958806 13335 raft_consensus.cc:513] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.958863 12175 ts_tablet_manager.cc:1918] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:00.958936 12175 log.cc:1199] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/2e5c492cb21c45f391aa20780f680d5f
I20250625 14:02:00.959187 12175 ts_tablet_manager.cc:1939] T 2e5c492cb21c45f391aa20780f680d5f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.959229 13335 leader_election.cc:290] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.959488 12177 log.cc:1199] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/2e5c492cb21c45f391aa20780f680d5f
I20250625 14:02:00.959762 12177 ts_tablet_manager.cc:1939] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.960135 12177 tablet_replica.cc:331] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.960316 12177 raft_consensus.cc:2241] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.960484 12177 raft_consensus.cc:2270] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.960839 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d53e9ef9d5f64cb893a552ab0784c120
I20250625 14:02:00.960968 12177 ts_tablet_manager.cc:1905] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.961190 11529 catalog_manager.cc:6652] ReplaceTablet: tablet d53e9ef9d5f64cb893a552ab0784c120 deleted and replaced by tablet 680b915f4d574d419a611d05ca2ddcfe
I20250625 14:02:00.961356 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet dff6358de0e4446e8dfc9465180ba395 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:00.962800 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 with delete_type TABLET_DATA_DELETED (replaced by tablet 680b915f4d574d419a611d05ca2ddcfe) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.962996 13121 raft_consensus.cc:2802] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:00.963089 13121 raft_consensus.cc:695] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:00.963255 13121 consensus_queue.cc:237] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:00.963686 12177 ts_tablet_manager.cc:1918] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.963749 12177 log.cc:1199] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c751d05cac1d4d65965e0aca2a94c14a
I20250625 14:02:00.963969 12177 ts_tablet_manager.cc:1939] T c751d05cac1d4d65965e0aca2a94c14a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.964445 12177 tablet_replica.cc:331] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.964646 12177 raft_consensus.cc:2241] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.964811 12177 raft_consensus.cc:2270] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.965536 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 with delete_type TABLET_DATA_DELETED (replaced by tablet 680b915f4d574d419a611d05ca2ddcfe) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:00.965951 12177 ts_tablet_manager.cc:1905] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.968263 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bb6f4cb8f8c9426bbbfcdd3b350e950e
W20250625 14:02:00.968818 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a95691b366be4e5e8b697bca3dede838 consensus state has no leader
I20250625 14:02:00.969058 12177 ts_tablet_manager.cc:1918] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.969091 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e7300adf77db4dafa942e06f07e635a9
I20250625 14:02:00.969123 12177 log.cc:1199] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e1ad291ba0da4f3fa70aa9548ef71d01
I20250625 14:02:00.969357 12177 ts_tablet_manager.cc:1939] T e1ad291ba0da4f3fa70aa9548ef71d01 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.969656 12177 tablet_replica.cc:331] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.969798 12177 raft_consensus.cc:2241] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.969931 12177 raft_consensus.cc:2270] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.970162 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4ca3d5203a64d99912765b83af97c09" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.970395 11717 leader_election.cc:304] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.970475 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 with delete_type TABLET_DATA_DELETED (replaced by tablet 680b915f4d574d419a611d05ca2ddcfe) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.970700 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4ca3d5203a64d99912765b83af97c09" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:00.970978 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:00.971094 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet e7300adf77db4dafa942e06f07e635a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:00.971486 11717 raft_consensus.cc:2684] T 2e5c492cb21c45f391aa20780f680d5f P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:00.971740 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 2e5c492cb21c45f391aa20780f680d5f (table default.Table_e28b81e130be4741a8b96e733248cf1a [id=e7b04afa1b174d9ebd5d9a72d25605df]) successfully deleted
I20250625 14:02:00.971944 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f7ef8af8357846339868b61391e6199c" } modify_external_catalogs: true
I20250625 14:02:00.972040 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f7ef8af8357846339868b61391e6199c" } modify_external_catalogs: true
W20250625 14:02:00.972288 11717 leader_election.cc:343] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.972361 11717 leader_election.cc:304] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.971982 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c751d05cac1d4d65965e0aca2a94c14a (table default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]) successfully deleted
I20250625 14:02:00.972476 13335 raft_consensus.cc:2747] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.972611 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e1ad291ba0da4f3fa70aa9548ef71d01 (table default.Table_675a9837739b463fbb71d870eda3a3c2 [id=3177ee8dc2ee43adbbf768c40dae97bd]) successfully deleted
I20250625 14:02:00.973135 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 2e5c492cb21c45f391aa20780f680d5f (table default.Table_e28b81e130be4741a8b96e733248cf1a [id=e7b04afa1b174d9ebd5d9a72d25605df]) successfully deleted
I20250625 14:02:00.973240 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:00.973265 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet e7300adf77db4dafa942e06f07e635a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:00.973306 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f7bbc6f086d49d7830d47d9db4ebf7b already in progress: creating tablet
W20250625 14:02:00.973421 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 594d394be3f54a3bb2b7d4705e1877d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 594d394be3f54a3bb2b7d4705e1877d5 already in progress: creating tablet
I20250625 14:02:00.973482 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:00.973522 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d53e9ef9d5f64cb893a552ab0784c120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d53e9ef9d5f64cb893a552ab0784c120 already in progress: creating tablet
I20250625 14:02:00.973794 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet e7300adf77db4dafa942e06f07e635a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:00.973883 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb6f4cb8f8c9426bbbfcdd3b350e950e already in progress: creating tablet
I20250625 14:02:00.973939 12175 tablet_replica.cc:331] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:00.971709 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_554e5fbd71a24bae80548733b7db8290"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.971807 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_116f4ad3308c453886c2f4677959cd83" } new_table_name: "default.Table_b1cc0648236f4feb88a93d12331667b3" modify_external_catalogs: true
I20250625 14:02:00.974082 12175 raft_consensus.cc:2241] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:00.974299 12175 raft_consensus.cc:2270] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:00.974432 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_554e5fbd71a24bae80548733b7db8290 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.974854 12175 ts_tablet_manager.cc:1905] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.977998 12175 ts_tablet_manager.cc:1918] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:00.978104 12175 log.cc:1199] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e7300adf77db4dafa942e06f07e635a9
I20250625 14:02:00.978539 12175 ts_tablet_manager.cc:1939] T e7300adf77db4dafa942e06f07e635a9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:00.979218 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e7300adf77db4dafa942e06f07e635a9 (table default.Table_daa46b6e09604fbe821817cc42384742 [id=ccb915c6ee95448296116b2791b3ed0e]) successfully deleted
I20250625 14:02:00.979640 12177 ts_tablet_manager.cc:1905] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:00.982717 11717 leader_election.cc:343] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:00.983131 11717 leader_election.cc:343] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.983199 11717 leader_election.cc:304] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.983331 13335 raft_consensus.cc:2747] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:00.983381 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a7f037177d848aea7d2944fc2a5542d consensus state has no leader
I20250625 14:02:00.984833 12177 ts_tablet_manager.cc:1918] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.984911 12177 log.cc:1199] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e9476529c1b7401683c02e146f54a228
I20250625 14:02:00.985121 12177 ts_tablet_manager.cc:1939] T e9476529c1b7401683c02e146f54a228 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:00.985411 12177 tablet_replica.cc:331] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:00.985594 12177 raft_consensus.cc:2241] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.985739 12177 raft_consensus.cc:2270] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.986253 12177 ts_tablet_manager.cc:1905] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:00.987164 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_87b14d45472a4fcd9d299d7071ec42fd" } new_table_name: "default.Table_141ea3329eb44d8c8324c18ba7f94190" modify_external_catalogs: true
I20250625 14:02:00.987286 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7e97826c0ac04d3f80d9f5e15b03452f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:00.987425 13335 raft_consensus.cc:491] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:00.987499 13335 raft_consensus.cc:513] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:00.987653 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e97826c0ac04d3f80d9f5e15b03452f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:00.987737 13335 leader_election.cc:290] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:00.987944 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e9476529c1b7401683c02e146f54a228 (table default.Table_fd6351d08daa4564ba49cf00d72ecd56 [id=ebc9dc830f034c5682988e810c4eb9d3]) successfully deleted
I20250625 14:02:00.988399 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b97c5c63a8184f07ad6e8054d056ff58" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:00.988924 13335 consensus_queue.cc:1035] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:00.989310 11717 leader_election.cc:343] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.989424 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b97c5c63a8184f07ad6e8054d056ff58" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:00.989825 11717 leader_election.cc:343] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:00.989892 11717 leader_election.cc:304] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:00.990063 12177 ts_tablet_manager.cc:1918] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:00.990144 12177 log.cc:1199] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/295ddb94cd4f489c9d53875bd1578474
I20250625 14:02:00.990557 12208 raft_consensus.cc:2747] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:00.991665 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 93d666f4b403435287f4157bda971193 (table default.Table_43bcd95133e249cc987155fe5045e4ea [id=27af5f3cf87a4e71937c303a90e3d366]). Expected version 1 got 0
I20250625 14:02:00.994447 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 9dd91e36cdea4175af4987ef5b3c3693 (DEFAULT_TABLE table=default.Table_1f75a3a066b14db6b75d2a209efd27e0 [id=3978b59edade490bb84750c417677c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.994732 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd91e36cdea4175af4987ef5b3c3693. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.997149 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_fd4614a0de7d438f82751d3ed54210cd [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 1 got 0
I20250625 14:02:00.997807 12173 tablet_replica.cc:331] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:00.998116 12173 raft_consensus.cc:2241] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:00.998227 12173 raft_consensus.cc:2270] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:00.998474 11764 tablet_service.cc:1468] Processing CreateTablet for tablet cb66618516b44f27a715ddfbafde480d (DEFAULT_TABLE table=default.Table_ebcb19662b564c958aca93f4b956a713 [id=eac24c3362c74394aa8c68ff64195c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:00.998720 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb66618516b44f27a715ddfbafde480d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:00.998842 12173 ts_tablet_manager.cc:1905] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.001032 12173 ts_tablet_manager.cc:1918] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.001096 12173 log.cc:1199] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e7300adf77db4dafa942e06f07e635a9
I20250625 14:02:01.001019 11527 catalog_manager.cc:5582] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:01.001350 12173 ts_tablet_manager.cc:1939] T e7300adf77db4dafa942e06f07e635a9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.001340 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 93d666f4b403435287f4157bda971193 (table default.Table_43bcd95133e249cc987155fe5045e4ea [id=27af5f3cf87a4e71937c303a90e3d366]). Expected version 1 got 0
I20250625 14:02:01.001459 11527 catalog_manager.cc:5582] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:01.001614 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_fd4614a0de7d438f82751d3ed54210cd [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 1 got 0
I20250625 14:02:01.002064 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 (DEFAULT_TABLE table=default.Table_57c928ae62334708914b5df36f2b8f4c [id=117b42a319264452a226744efe5fe312]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.002379 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fa4d981de8405ebf2a1bdb82a41cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.002624 12172 tablet_bootstrap.cc:492] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.002700 12172 ts_tablet_manager.cc:1397] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.164s user 0.002s sys 0.000s
I20250625 14:02:01.003185 12172 raft_consensus.cc:357] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.003289 12172 raft_consensus.cc:383] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.003319 12172 raft_consensus.cc:738] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.003443 12172 consensus_queue.cc:260] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.003754 12172 ts_tablet_manager.cc:1428] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.003878 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.003948 12172 tablet_bootstrap.cc:492] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:01.007165 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cba459a70a404cdead8d487e6b9f2eb7 consensus state has no leader
I20250625 14:02:01.007261 11760 tablet_service.cc:1468] Processing CreateTablet for tablet d588175174d64966a2f268d8cab437bc (DEFAULT_TABLE table=default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.007529 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d588175174d64966a2f268d8cab437bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:01.008291 13430 negotiation.cc:337] Failed RPC negotiation. Trace:
0625 14:02:00.981347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.39.190:38199 (local address 127.11.39.131:48999)
0625 14:02:01.007637 (+ 26290us) negotiation.cc:107] Waiting for socket to connect
0625 14:02:01.007732 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.39.190:38199: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":26052,"thread_start_us":89,"threads_started":1}
I20250625 14:02:01.008952 12167 tablet_bootstrap.cc:492] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.009047 12167 ts_tablet_manager.cc:1397] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.143s user 0.000s sys 0.002s
I20250625 14:02:01.009022 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 170e4018bf5d4bde8a9b4bc6840889f3 (DEFAULT_TABLE table=default.Table_96dbeba001d841fc816db28e08ce97ee [id=eff008dc12334a1a9c1190edb63e614c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.009275 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170e4018bf5d4bde8a9b4bc6840889f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.009625 12167 raft_consensus.cc:357] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.009727 12167 raft_consensus.cc:383] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.009755 12167 raft_consensus.cc:738] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.009868 12167 consensus_queue.cc:260] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.010128 12167 ts_tablet_manager.cc:1428] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.010350 12167 tablet_bootstrap.cc:492] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.011400 12167 tablet_bootstrap.cc:654] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.011824 12166 tablet_bootstrap.cc:492] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.011925 12166 ts_tablet_manager.cc:1397] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.142s user 0.002s sys 0.000s
W20250625 14:02:01.012212 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d53e9ef9d5f64cb893a552ab0784c120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d53e9ef9d5f64cb893a552ab0784c120 already in progress: creating tablet
W20250625 14:02:01.012372 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb6f4cb8f8c9426bbbfcdd3b350e950e already in progress: creating tablet
I20250625 14:02:01.012475 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e7300adf77db4dafa942e06f07e635a9 (table default.Table_daa46b6e09604fbe821817cc42384742 [id=ccb915c6ee95448296116b2791b3ed0e]) successfully deleted
I20250625 14:02:01.012480 12166 raft_consensus.cc:357] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.012595 12166 raft_consensus.cc:383] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.012567 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 9dd91e36cdea4175af4987ef5b3c3693 (DEFAULT_TABLE table=default.Table_1f75a3a066b14db6b75d2a209efd27e0 [id=3978b59edade490bb84750c417677c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.012630 12166 raft_consensus.cc:738] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.012715 12024 tablet_service.cc:1468] Processing CreateTablet for tablet 170e4018bf5d4bde8a9b4bc6840889f3 (DEFAULT_TABLE table=default.Table_96dbeba001d841fc816db28e08ce97ee [id=eff008dc12334a1a9c1190edb63e614c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.012750 12166 consensus_queue.cc:260] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.012810 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd91e36cdea4175af4987ef5b3c3693. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.012938 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170e4018bf5d4bde8a9b4bc6840889f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.013037 12166 ts_tablet_manager.cc:1428] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.013226 12166 tablet_bootstrap.cc:492] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.014518 12036 tablet_service.cc:1468] Processing CreateTablet for tablet cb66618516b44f27a715ddfbafde480d (DEFAULT_TABLE table=default.Table_ebcb19662b564c958aca93f4b956a713 [id=eac24c3362c74394aa8c68ff64195c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.014748 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb66618516b44f27a715ddfbafde480d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.015029 12172 tablet_bootstrap.cc:654] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.015162 12021 tablet_service.cc:1468] Processing CreateTablet for tablet d588175174d64966a2f268d8cab437bc (DEFAULT_TABLE table=default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.015360 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d588175174d64966a2f268d8cab437bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.015611 12177 ts_tablet_manager.cc:1939] T 295ddb94cd4f489c9d53875bd1578474 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.016155 12177 tablet_replica.cc:331] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.016309 12177 raft_consensus.cc:2241] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.016409 12177 raft_consensus.cc:2270] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.016616 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_197e23eaa8114f5e87c9b4166f3f7995"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.017002 12166 tablet_bootstrap.cc:654] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:01.017036 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_197e23eaa8114f5e87c9b4166f3f7995 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.017463 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 (DEFAULT_TABLE table=default.Table_57c928ae62334708914b5df36f2b8f4c [id=117b42a319264452a226744efe5fe312]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.017706 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fa4d981de8405ebf2a1bdb82a41cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.019328 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 295ddb94cd4f489c9d53875bd1578474 (table default.Table_478843ad04c04773be560cc8ac45cc52 [id=9954b567381b49cf81d3cea6b706f327]) successfully deleted
I20250625 14:02:01.020593 12172 tablet_bootstrap.cc:492] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.020684 12172 ts_tablet_manager.cc:1397] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.001s
I20250625 14:02:01.021185 12172 raft_consensus.cc:357] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.021312 12172 raft_consensus.cc:383] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.021354 12172 raft_consensus.cc:738] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.021481 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3faa8782ba0d45dbbd89437685a64aef
I20250625 14:02:01.021479 12172 consensus_queue.cc:260] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.021766 12172 ts_tablet_manager.cc:1428] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.021968 12172 tablet_bootstrap.cc:492] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.021982 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9e952a2f63ab4ff3bdebd62848e0c1b6
I20250625 14:02:01.022228 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 deleted and replaced by tablet 1d73b0124af54007b4e16a3f653836af
I20250625 14:02:01.022753 12166 tablet_bootstrap.cc:492] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.022840 12166 ts_tablet_manager.cc:1397] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:02:01.023105 12172 tablet_bootstrap.cc:654] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.023368 12166 raft_consensus.cc:357] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.023494 12166 raft_consensus.cc:383] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.023525 12166 raft_consensus.cc:738] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.023651 12166 consensus_queue.cc:260] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.023965 12166 ts_tablet_manager.cc:1428] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.024155 12166 tablet_bootstrap.cc:492] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.024196 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 3faa8782ba0d45dbbd89437685a64aef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.024322 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d73b0124af54007b4e16a3f653836af) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.024597 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 9dd91e36cdea4175af4987ef5b3c3693 (DEFAULT_TABLE table=default.Table_1f75a3a066b14db6b75d2a209efd27e0 [id=3978b59edade490bb84750c417677c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.024654 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet c751d05cac1d4d65965e0aca2a94c14a with delete_type TABLET_DATA_DELETED (replaced by tablet 288e0c1644a34b8dabc06ccdda9f0fa9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.024835 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd91e36cdea4175af4987ef5b3c3693. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.024921 11891 tablet_service.cc:1468] Processing CreateTablet for tablet d588175174d64966a2f268d8cab437bc (DEFAULT_TABLE table=default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.025156 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d588175174d64966a2f268d8cab437bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.025192 12166 tablet_bootstrap.cc:654] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.025276 11901 tablet_service.cc:1468] Processing CreateTablet for tablet cb66618516b44f27a715ddfbafde480d (DEFAULT_TABLE table=default.Table_ebcb19662b564c958aca93f4b956a713 [id=eac24c3362c74394aa8c68ff64195c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.025483 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb66618516b44f27a715ddfbafde480d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.027236 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 44dd83c53b15400d94bb7b1a8784569a) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.027483 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 170e4018bf5d4bde8a9b4bc6840889f3 (DEFAULT_TABLE table=default.Table_96dbeba001d841fc816db28e08ce97ee [id=eff008dc12334a1a9c1190edb63e614c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.027714 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170e4018bf5d4bde8a9b4bc6840889f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.027967 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.028415 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d73b0124af54007b4e16a3f653836af) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.029022 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 3faa8782ba0d45dbbd89437685a64aef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.029457 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 3faa8782ba0d45dbbd89437685a64aef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.029914 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 (DEFAULT_TABLE table=default.Table_57c928ae62334708914b5df36f2b8f4c [id=117b42a319264452a226744efe5fe312]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.030148 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10fa4d981de8405ebf2a1bdb82a41cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.030656 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d73b0124af54007b4e16a3f653836af) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.030753 12167 tablet_bootstrap.cc:492] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.030845 12167 ts_tablet_manager.cc:1397] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.001s
I20250625 14:02:01.031075 12175 tablet_replica.cc:331] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.031217 12175 raft_consensus.cc:2241] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.031366 12175 pending_rounds.cc:70] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:02:01.031397 12175 pending_rounds.cc:77] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523055034368000 op_type: NO_OP noop_request { }
I20250625 14:02:01.031459 12175 raft_consensus.cc:2887] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:01.031430 12167 raft_consensus.cc:357] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.031507 12175 raft_consensus.cc:2270] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.031529 12167 raft_consensus.cc:383] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.031560 12167 raft_consensus.cc:738] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.031692 12167 consensus_queue.cc:260] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.032423 12167 ts_tablet_manager.cc:1428] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:01.032636 12167 tablet_bootstrap.cc:492] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.033170 12175 ts_tablet_manager.cc:1905] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.034956 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_fd4614a0de7d438f82751d3ed54210cd [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 1 got 0
I20250625 14:02:01.035422 12167 tablet_bootstrap.cc:654] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.035475 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d3693e166c2c4af0b7a8f7994507de2c
I20250625 14:02:01.035948 12177 ts_tablet_manager.cc:1905] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.036370 12173 tablet_replica.cc:331] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.036516 12173 raft_consensus.cc:2241] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.036675 12173 raft_consensus.cc:2270] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.036849 12175 ts_tablet_manager.cc:1918] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.036931 12175 log.cc:1199] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c751d05cac1d4d65965e0aca2a94c14a
I20250625 14:02:01.037093 12173 ts_tablet_manager.cc:1905] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.039409 12177 ts_tablet_manager.cc:1918] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.039512 12177 log.cc:1199] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/2030a3a1aa3a4702b7a2b4eaddf3c4b4
I20250625 14:02:01.039614 12173 ts_tablet_manager.cc:1918] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:01.039695 12173 log.cc:1199] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9e952a2f63ab4ff3bdebd62848e0c1b6
I20250625 14:02:01.039933 12173 ts_tablet_manager.cc:1939] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.040009 12175 ts_tablet_manager.cc:1939] T c751d05cac1d4d65965e0aca2a94c14a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.040751 12175 tablet_replica.cc:331] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.040951 12175 raft_consensus.cc:2241] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.041095 12175 raft_consensus.cc:2270] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.041673 12175 ts_tablet_manager.cc:1905] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.042475 12167 tablet_bootstrap.cc:492] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.042657 12167 ts_tablet_manager.cc:1397] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s
I20250625 14:02:01.043251 12167 raft_consensus.cc:357] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.043437 12167 raft_consensus.cc:383] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.043526 12167 raft_consensus.cc:738] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.043702 12167 consensus_queue.cc:260] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.044122 12167 ts_tablet_manager.cc:1428] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:01.045444 11520 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 -> Peer b569e7a9e38b4882a89092d98a2f1b9b (127.11.39.190:38199): Couldn't send request to peer b569e7a9e38b4882a89092d98a2f1b9b. Status: Network error: Client connection negotiation failed: client connection to 127.11.39.190:38199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:01.045449 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet d3693e166c2c4af0b7a8f7994507de2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.045594 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet d3693e166c2c4af0b7a8f7994507de2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.046568 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c751d05cac1d4d65965e0aca2a94c14a (table default.Table_dc9dee22497a48a2b7705efdac6aae7e [id=8082aa269ffd46148b58dd2279034161]) successfully deleted
W20250625 14:02:01.046782 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 3faa8782ba0d45dbbd89437685a64aef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3faa8782ba0d45dbbd89437685a64aef already in progress: creating tablet
I20250625 14:02:01.046967 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (table default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]) successfully deleted
I20250625 14:02:01.047581 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 21908df7bb384e9782b97abe6f06b0f5 with delete_type TABLET_DATA_DELETED (replaced by tablet 44dd83c53b15400d94bb7b1a8784569a) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:01.042093 13431 negotiation.cc:337] Failed RPC negotiation. Trace:
0625 14:02:00.981472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.39.190:38199 (local address 127.11.39.130:48329)
0625 14:02:01.041367 (+ 59895us) negotiation.cc:107] Waiting for socket to connect
0625 14:02:01.041434 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.39.190:38199: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":59799,"thread_start_us":49,"threads_started":1}
I20250625 14:02:01.048941 12167 tablet_bootstrap.cc:492] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.050254 12167 tablet_bootstrap.cc:654] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.050985 12166 tablet_bootstrap.cc:492] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.051087 12166 ts_tablet_manager.cc:1397] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:02:01.051131 12177 ts_tablet_manager.cc:1939] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.051615 12166 raft_consensus.cc:357] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.051713 12177 tablet_replica.cc:331] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.051733 12166 raft_consensus.cc:383] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.051765 12166 raft_consensus.cc:738] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.051851 12177 raft_consensus.cc:2241] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.051941 12177 raft_consensus.cc:2270] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.039947 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet d3693e166c2c4af0b7a8f7994507de2c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.052311 12177 ts_tablet_manager.cc:1905] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.051885 12166 consensus_queue.cc:260] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.053268 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 (table default.Table_e07ec41a73ce4df9ab09b63d87da79be [id=e6ec8721bee347c19b4724c249a20e2f]) successfully deleted
I20250625 14:02:01.049084 12173 tablet_replica.cc:331] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.054296 12166 ts_tablet_manager.cc:1428] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:01.054010 12173 raft_consensus.cc:2241] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.055235 12173 raft_consensus.cc:2270] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.056509 12173 ts_tablet_manager.cc:1905] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.057019 12166 tablet_bootstrap.cc:492] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.058122 12166 tablet_bootstrap.cc:654] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.060142 12175 ts_tablet_manager.cc:1918] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.060240 12175 log.cc:1199] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/21908df7bb384e9782b97abe6f06b0f5
I20250625 14:02:01.060470 12175 ts_tablet_manager.cc:1939] T 21908df7bb384e9782b97abe6f06b0f5 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.060505 12166 tablet_bootstrap.cc:492] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.060595 12166 ts_tablet_manager.cc:1397] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:01.061084 12175 tablet_replica.cc:331] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.061055 12166 raft_consensus.cc:357] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.061164 12166 raft_consensus.cc:383] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.061195 12166 raft_consensus.cc:738] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.061247 12175 raft_consensus.cc:2241] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.061324 12166 consensus_queue.cc:260] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.061367 12175 raft_consensus.cc:2270] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.061600 12166 ts_tablet_manager.cc:1428] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.061769 12166 tablet_bootstrap.cc:492] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.062947 12166 tablet_bootstrap.cc:654] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.066702 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f40caafd5e4557af321454d28fa2ab with delete_type TABLET_DATA_DELETED (replaced by tablet dfbf6959677547a6a2582b73b2be4c03) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.066781 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 21908df7bb384e9782b97abe6f06b0f5 (table default.Table_99ef32b961ed4799869db0bddb6346de [id=55cc2676447f4267a1b31fb53a7705dd]) successfully deleted
I20250625 14:02:01.066895 11526 catalog_manager.cc:5582] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:01.067194 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 93d666f4b403435287f4157bda971193 (table default.Table_43bcd95133e249cc987155fe5045e4ea [id=27af5f3cf87a4e71937c303a90e3d366]). Expected version 1 got 0
I20250625 14:02:01.067353 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a4ca3d5203a64d99912765b83af97c09 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]). Expected version 1 got 0
I20250625 14:02:01.067618 12172 tablet_bootstrap.cc:492] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.067713 12172 ts_tablet_manager.cc:1397] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.000s
I20250625 14:02:01.067716 12166 tablet_bootstrap.cc:492] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.067801 12166 ts_tablet_manager.cc:1397] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:02:01.068257 12172 raft_consensus.cc:357] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.068379 12172 raft_consensus.cc:383] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.068415 12172 raft_consensus.cc:738] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.068478 12166 raft_consensus.cc:357] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.068532 12172 consensus_queue.cc:260] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.068576 12166 raft_consensus.cc:383] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.068607 12166 raft_consensus.cc:738] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.068742 12166 consensus_queue.cc:260] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.068871 12172 ts_tablet_manager.cc:1428] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.069073 12172 tablet_bootstrap.cc:492] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.070119 12172 tablet_bootstrap.cc:654] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.071605 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 956de83084b54b1589dfca476a52885a (DEFAULT_TABLE table=default.Table_554e5fbd71a24bae80548733b7db8290 [id=2b659653a64f4bcaaf647c553a4df34b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.071838 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 57547a2cd850430985c56efe7be24477 (DEFAULT_TABLE table=default.Table_9cb2c3718ef74831b6cf225009595b1f [id=8d4ef44d277e4ccb8d1fe7bf1c3d436f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.072579 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 4c13da355df54f129f74003c0f8fbf2e (DEFAULT_TABLE table=default.Table_6d2f84fbfffb428d8c49c42421d9bb77 [id=c2235cc76fe84ae9a65ee63adef1ce2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.073472 11751 tablet_service.cc:1468] Processing CreateTablet for tablet c6f1447498b74f3985cd2b3ef83f3ba6 (DEFAULT_TABLE table=default.Table_3822190b351d490d9f98f42c7e7d6682 [id=53b9018326d3470a9671a9bd0ad94960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.073797 11757 tablet_service.cc:1468] Processing CreateTablet for tablet fdb5d33f643a4e398c312dcc5ec2a547 (DEFAULT_TABLE table=default.Table_c55446b42ca8451480daa20ae8f25a22 [id=09f8ca0c91b64cb788d3977a56505eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.074091 11761 tablet_service.cc:1468] Processing CreateTablet for tablet bd2ef3584826443188c4c7257042b03c (DEFAULT_TABLE table=default.Table_fb8735736377472582a9ec36a82e90e3 [id=be6beebec85345e1a875574cd9722a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.074409 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 680b915f4d574d419a611d05ca2ddcfe (DEFAULT_TABLE table=default.Table_3fc13d79731e4d07a486ac496fd081fc [id=c3c11e126c464fdb8861f40571c798f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.074793 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 4b0ea982f6af473c957029e723201342 (DEFAULT_TABLE table=default.Table_e254b12c2c1c4aa2a47102fc27509dc8 [id=796e88c4938c4509ab3a9bd7d2a2666c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.075168 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 9169d58caf8b440abe39fe2b09859d07 (DEFAULT_TABLE table=default.Table_c3c339b91e554ca48078afe01a438fd6 [id=772e827c1b834bf6aa66c06b6202ac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.075706 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956de83084b54b1589dfca476a52885a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.075874 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9169d58caf8b440abe39fe2b09859d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.075990 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c13da355df54f129f74003c0f8fbf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.076175 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb5d33f643a4e398c312dcc5ec2a547. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.077930 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57547a2cd850430985c56efe7be24477. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.078552 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0ea982f6af473c957029e723201342. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.078787 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2ef3584826443188c4c7257042b03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.080655 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680b915f4d574d419a611d05ca2ddcfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.082654 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f1447498b74f3985cd2b3ef83f3ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.082967 12173 ts_tablet_manager.cc:1918] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.083140 12173 log.cc:1199] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d3693e166c2c4af0b7a8f7994507de2c
I20250625 14:02:01.083588 12173 ts_tablet_manager.cc:1939] T d3693e166c2c4af0b7a8f7994507de2c P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.082684 12177 ts_tablet_manager.cc:1918] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.084851 12173 tablet_replica.cc:331] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.084977 12177 log.cc:1199] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/2f2c3d6fe97d4cb3b52e2ffea14e615b
I20250625 14:02:01.085358 12177 ts_tablet_manager.cc:1939] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.085600 12173 raft_consensus.cc:2241] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.085901 12173 pending_rounds.cc:70] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:01.085949 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet b345695e57a24b09aff2b8e00bf0fbdf from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.086400 12177 tablet_replica.cc:331] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.086534 12173 pending_rounds.cc:77] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523055370780672 op_type: NO_OP noop_request { }
I20250625 14:02:01.086681 12173 raft_consensus.cc:2887] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:01.086814 12173 raft_consensus.cc:2270] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.087056 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b (table default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]) successfully deleted
I20250625 14:02:01.087081 12177 raft_consensus.cc:2241] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.087430 12177 raft_consensus.cc:2270] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.087908 12177 ts_tablet_manager.cc:1905] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.088348 12173 ts_tablet_manager.cc:1905] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.088645 12166 ts_tablet_manager.cc:1428] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:02:01.089310 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 956de83084b54b1589dfca476a52885a (DEFAULT_TABLE table=default.Table_554e5fbd71a24bae80548733b7db8290 [id=2b659653a64f4bcaaf647c553a4df34b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.089601 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956de83084b54b1589dfca476a52885a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.091991 12166 tablet_bootstrap.cc:492] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.092021 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 57547a2cd850430985c56efe7be24477 (DEFAULT_TABLE table=default.Table_9cb2c3718ef74831b6cf225009595b1f [id=8d4ef44d277e4ccb8d1fe7bf1c3d436f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.092022 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 956de83084b54b1589dfca476a52885a (DEFAULT_TABLE table=default.Table_554e5fbd71a24bae80548733b7db8290 [id=2b659653a64f4bcaaf647c553a4df34b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.092272 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956de83084b54b1589dfca476a52885a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.092272 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57547a2cd850430985c56efe7be24477. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.094326 12166 tablet_bootstrap.cc:654] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.095455 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
I20250625 14:02:01.096093 11525 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a4ca3d5203a64d99912765b83af97c09 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]). Expected version 1 got 0
I20250625 14:02:01.096511 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 57547a2cd850430985c56efe7be24477 (DEFAULT_TABLE table=default.Table_9cb2c3718ef74831b6cf225009595b1f [id=8d4ef44d277e4ccb8d1fe7bf1c3d436f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.096619 12036 tablet_service.cc:1468] Processing CreateTablet for tablet c6f1447498b74f3985cd2b3ef83f3ba6 (DEFAULT_TABLE table=default.Table_3822190b351d490d9f98f42c7e7d6682 [id=53b9018326d3470a9671a9bd0ad94960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.096772 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57547a2cd850430985c56efe7be24477. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.096904 12024 tablet_service.cc:1468] Processing CreateTablet for tablet fdb5d33f643a4e398c312dcc5ec2a547 (DEFAULT_TABLE table=default.Table_c55446b42ca8451480daa20ae8f25a22 [id=09f8ca0c91b64cb788d3977a56505eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.096931 12034 tablet_service.cc:1468] Processing CreateTablet for tablet b778a1b075794c0a86992066a14d5e11 (DEFAULT_TABLE table=default.Table_4b1e6053c18e494c91d6de1708f61215 [id=996afd779ef84dfbab367a3796ddcafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.096962 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 680b915f4d574d419a611d05ca2ddcfe (DEFAULT_TABLE table=default.Table_3fc13d79731e4d07a486ac496fd081fc [id=c3c11e126c464fdb8861f40571c798f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.097167 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 4b0ea982f6af473c957029e723201342 (DEFAULT_TABLE table=default.Table_e254b12c2c1c4aa2a47102fc27509dc8 [id=796e88c4938c4509ab3a9bd7d2a2666c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.097203 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 9169d58caf8b440abe39fe2b09859d07 (DEFAULT_TABLE table=default.Table_c3c339b91e554ca48078afe01a438fd6 [id=772e827c1b834bf6aa66c06b6202ac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.097203 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb5d33f643a4e398c312dcc5ec2a547. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.097642 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]) successfully deleted
I20250625 14:02:01.097759 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0ea982f6af473c957029e723201342. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.098270 12027 tablet_service.cc:1468] Processing CreateTablet for tablet bd2ef3584826443188c4c7257042b03c (DEFAULT_TABLE table=default.Table_fb8735736377472582a9ec36a82e90e3 [id=be6beebec85345e1a875574cd9722a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.098526 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2ef3584826443188c4c7257042b03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.098802 12175 ts_tablet_manager.cc:1905] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.100138 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b778a1b075794c0a86992066a14d5e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.100525 11891 tablet_service.cc:1468] Processing CreateTablet for tablet bd2ef3584826443188c4c7257042b03c (DEFAULT_TABLE table=default.Table_fb8735736377472582a9ec36a82e90e3 [id=be6beebec85345e1a875574cd9722a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.100742 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2ef3584826443188c4c7257042b03c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.100708 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 680b915f4d574d419a611d05ca2ddcfe (DEFAULT_TABLE table=default.Table_3fc13d79731e4d07a486ac496fd081fc [id=c3c11e126c464fdb8861f40571c798f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.100926 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680b915f4d574d419a611d05ca2ddcfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.101076 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 9169d58caf8b440abe39fe2b09859d07 (DEFAULT_TABLE table=default.Table_c3c339b91e554ca48078afe01a438fd6 [id=772e827c1b834bf6aa66c06b6202ac95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.101313 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9169d58caf8b440abe39fe2b09859d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.101712 11901 tablet_service.cc:1468] Processing CreateTablet for tablet fdb5d33f643a4e398c312dcc5ec2a547 (DEFAULT_TABLE table=default.Table_c55446b42ca8451480daa20ae8f25a22 [id=09f8ca0c91b64cb788d3977a56505eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.101945 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb5d33f643a4e398c312dcc5ec2a547. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.102094 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680b915f4d574d419a611d05ca2ddcfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.102391 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9169d58caf8b440abe39fe2b09859d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.102649 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f1447498b74f3985cd2b3ef83f3ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.103097 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 4b0ea982f6af473c957029e723201342 (DEFAULT_TABLE table=default.Table_e254b12c2c1c4aa2a47102fc27509dc8 [id=796e88c4938c4509ab3a9bd7d2a2666c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.103350 11899 tablet_service.cc:1468] Processing CreateTablet for tablet b778a1b075794c0a86992066a14d5e11 (DEFAULT_TABLE table=default.Table_4b1e6053c18e494c91d6de1708f61215 [id=996afd779ef84dfbab367a3796ddcafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.096771 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 4c13da355df54f129f74003c0f8fbf2e (DEFAULT_TABLE table=default.Table_6d2f84fbfffb428d8c49c42421d9bb77 [id=c2235cc76fe84ae9a65ee63adef1ce2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.104126 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c13da355df54f129f74003c0f8fbf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.105242 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_57c928ae62334708914b5df36f2b8f4c" } modify_external_catalogs: true
I20250625 14:02:01.105285 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_322ff18a53304b238122781629c6a514"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.105386 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_57c928ae62334708914b5df36f2b8f4c" } modify_external_catalogs: true
W20250625 14:02:01.105690 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_322ff18a53304b238122781629c6a514 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.107059 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b778a1b075794c0a86992066a14d5e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.108570 12175 ts_tablet_manager.cc:1918] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:01.108639 12175 log.cc:1199] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9e952a2f63ab4ff3bdebd62848e0c1b6
I20250625 14:02:01.108886 12175 ts_tablet_manager.cc:1939] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.110255 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f40caafd5e4557af321454d28fa2ab with delete_type TABLET_DATA_DELETED (replaced by tablet dfbf6959677547a6a2582b73b2be4c03) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.110335 11894 tablet_service.cc:1468] Processing CreateTablet for tablet c6f1447498b74f3985cd2b3ef83f3ba6 (DEFAULT_TABLE table=default.Table_3822190b351d490d9f98f42c7e7d6682 [id=53b9018326d3470a9671a9bd0ad94960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.109345 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0ea982f6af473c957029e723201342. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.110102 12166 tablet_bootstrap.cc:492] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.110694 12166 ts_tablet_manager.cc:1397] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:02:01.111147 12166 raft_consensus.cc:357] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.111251 12166 raft_consensus.cc:383] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.111279 12166 raft_consensus.cc:738] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.111377 12166 consensus_queue.cc:260] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.111640 12166 ts_tablet_manager.cc:1428] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.112445 11525 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]). Expected version 3 got 0
I20250625 14:02:01.112761 12166 tablet_bootstrap.cc:492] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.110066 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 4c13da355df54f129f74003c0f8fbf2e (DEFAULT_TABLE table=default.Table_6d2f84fbfffb428d8c49c42421d9bb77 [id=c2235cc76fe84ae9a65ee63adef1ce2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.113927 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c13da355df54f129f74003c0f8fbf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.114439 12167 tablet_bootstrap.cc:492] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.114530 12167 ts_tablet_manager.cc:1397] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.000s
I20250625 14:02:01.115163 12167 raft_consensus.cc:357] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.115273 12167 raft_consensus.cc:383] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.115309 12167 raft_consensus.cc:738] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.115423 12167 consensus_queue.cc:260] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.115705 12167 ts_tablet_manager.cc:1428] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.116302 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f1447498b74f3985cd2b3ef83f3ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.116603 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_43bcd95133e249cc987155fe5045e4ea" } new_table_name: "default.Table_86c68a2f990a4174aad0cf389e4d23d4" modify_external_catalogs: true
I20250625 14:02:01.118618 12167 tablet_bootstrap.cc:492] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.119829 12167 tablet_bootstrap.cc:654] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.120344 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.120597 12166 tablet_bootstrap.cc:654] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.121029 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
I20250625 14:02:01.121724 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b345695e57a24b09aff2b8e00bf0fbdf
I20250625 14:02:01.121721 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (table default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]) successfully deleted
I20250625 14:02:01.122010 11527 catalog_manager.cc:6652] ReplaceTablet: tablet b345695e57a24b09aff2b8e00bf0fbdf deleted and replaced by tablet 357d05c539144e9c8bafe6819f8ee39b
I20250625 14:02:01.122370 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet b345695e57a24b09aff2b8e00bf0fbdf with delete_type TABLET_DATA_DELETED (replaced by tablet 357d05c539144e9c8bafe6819f8ee39b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.124962 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bf09753866574adb9eca228ba4c15f16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.125396 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf09753866574adb9eca228ba4c15f16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.126717 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet b345695e57a24b09aff2b8e00bf0fbdf with delete_type TABLET_DATA_DELETED (replaced by tablet 357d05c539144e9c8bafe6819f8ee39b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.088402 11757 tablet_service.cc:1468] Processing CreateTablet for tablet b778a1b075794c0a86992066a14d5e11 (DEFAULT_TABLE table=default.Table_4b1e6053c18e494c91d6de1708f61215 [id=996afd779ef84dfbab367a3796ddcafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.091307 12172 tablet_bootstrap.cc:492] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.126996 12172 ts_tablet_manager.cc:1397] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.000s
I20250625 14:02:01.127031 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b778a1b075794c0a86992066a14d5e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.127527 12172 raft_consensus.cc:357] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.127624 12172 raft_consensus.cc:383] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.127652 12172 raft_consensus.cc:738] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.127772 12172 consensus_queue.cc:260] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.128100 12172 ts_tablet_manager.cc:1428] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.128317 12172 tablet_bootstrap.cc:492] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.110484 13137 raft_consensus.cc:491] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.130596 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e407283f16824e65ba9d6ff88904672f" } new_table_name: "default.Table_755b424634ff418fa162743d2c095460" modify_external_catalogs: true
I20250625 14:02:01.131345 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet b345695e57a24b09aff2b8e00bf0fbdf with delete_type TABLET_DATA_DELETED (replaced by tablet 357d05c539144e9c8bafe6819f8ee39b) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:01.132032 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 3faa8782ba0d45dbbd89437685a64aef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3faa8782ba0d45dbbd89437685a64aef already in progress: creating tablet
I20250625 14:02:01.132561 12175 tablet_replica.cc:331] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.132668 12173 ts_tablet_manager.cc:1918] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.132755 12173 log.cc:1199] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/21908df7bb384e9782b97abe6f06b0f5
I20250625 14:02:01.132903 12175 raft_consensus.cc:2241] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.133018 12173 ts_tablet_manager.cc:1939] T 21908df7bb384e9782b97abe6f06b0f5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.133124 12175 raft_consensus.cc:2270] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.133702 12175 ts_tablet_manager.cc:1905] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.136214 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3190c312bb85480f8c10e182119fb4c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.136675 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3190c312bb85480f8c10e182119fb4c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.129303 12177 ts_tablet_manager.cc:1918] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.129369 12172 tablet_bootstrap.cc:654] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.137115 12177 log.cc:1199] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e15bd70671f8458db5b9e52423189eda
I20250625 14:02:01.137360 12177 ts_tablet_manager.cc:1939] T e15bd70671f8458db5b9e52423189eda P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.137507 12175 ts_tablet_manager.cc:1918] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.137573 12175 log.cc:1199] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d3693e166c2c4af0b7a8f7994507de2c
I20250625 14:02:01.137705 12177 tablet_replica.cc:331] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.129614 13137 raft_consensus.cc:513] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.134811 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 with delete_type TABLET_DATA_DELETED (replaced by tablet cdbebbb725564dc98c30ce4bbd3af8db) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.137856 12177 raft_consensus.cc:2241] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.137907 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e15bd70671f8458db5b9e52423189eda (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
I20250625 14:02:01.137962 12177 raft_consensus.cc:2270] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.138127 13137 leader_election.cc:290] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.138528 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "801fae4d88114ff29eacde80365b84a0" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.138736 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]). Expected version 3 got 0
I20250625 14:02:01.138830 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 21908df7bb384e9782b97abe6f06b0f5 (table default.Table_99ef32b961ed4799869db0bddb6346de [id=55cc2676447f4267a1b31fb53a7705dd]) successfully deleted
I20250625 14:02:01.138926 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "801fae4d88114ff29eacde80365b84a0" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:01.139344 11717 leader_election.cc:343] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.139459 11717 leader_election.cc:343] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.139495 11717 leader_election.cc:304] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.139616 13137 raft_consensus.cc:2747] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.139995 12175 ts_tablet_manager.cc:1939] T d3693e166c2c4af0b7a8f7994507de2c P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.140774 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]) successfully deleted
I20250625 14:02:01.140899 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5c451f1ba2f246549b649bf689a73ec1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.141047 12175 tablet_replica.cc:331] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:02:01.141294 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c451f1ba2f246549b649bf689a73ec1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.141191 12175 raft_consensus.cc:2241] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.141434 12175 raft_consensus.cc:2270] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.142123 12175 ts_tablet_manager.cc:1905] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.143028 12173 tablet_replica.cc:331] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.143198 12173 raft_consensus.cc:2241] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.143327 12173 raft_consensus.cc:2270] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.143735 12166 tablet_bootstrap.cc:492] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.143721 12177 ts_tablet_manager.cc:1905] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.143815 12166 ts_tablet_manager.cc:1397] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:02:01.144273 12166 raft_consensus.cc:357] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.144372 12166 raft_consensus.cc:383] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.144405 12166 raft_consensus.cc:738] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.144526 12166 consensus_queue.cc:260] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.144802 12166 ts_tablet_manager.cc:1428] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.145009 12166 tablet_bootstrap.cc:492] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.146232 12166 tablet_bootstrap.cc:654] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.146415 12173 ts_tablet_manager.cc:1905] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.148849 12173 ts_tablet_manager.cc:1918] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.148936 12173 log.cc:1199] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f2f40caafd5e4557af321454d28fa2ab
I20250625 14:02:01.149147 12173 ts_tablet_manager.cc:1939] T f2f40caafd5e4557af321454d28fa2ab P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.150471 12177 ts_tablet_manager.cc:1918] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.150643 12177 log.cc:1199] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/44dd83c53b15400d94bb7b1a8784569a
I20250625 14:02:01.150938 12177 ts_tablet_manager.cc:1939] T 44dd83c53b15400d94bb7b1a8784569a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:02:01.152034 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ef6745366054d0dbdda7c0ffa2313c4 consensus state has no leader
I20250625 14:02:01.152534 12177 tablet_replica.cc:331] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.152878 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 44dd83c53b15400d94bb7b1a8784569a (table default.Table_99ef32b961ed4799869db0bddb6346de [id=55cc2676447f4267a1b31fb53a7705dd]) successfully deleted
I20250625 14:02:01.153137 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 295ddb94cd4f489c9d53875bd1578474 with delete_type TABLET_DATA_DELETED (replaced by tablet 881295234a5b4a089985382765774cd9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.153236 12167 tablet_bootstrap.cc:492] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.153334 12167 ts_tablet_manager.cc:1397] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20250625 14:02:01.153437 12177 raft_consensus.cc:2241] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.153927 12177 raft_consensus.cc:2270] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.154141 12167 raft_consensus.cc:357] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.154268 12167 raft_consensus.cc:383] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.154331 12167 raft_consensus.cc:738] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.154455 12167 consensus_queue.cc:260] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.154755 12167 ts_tablet_manager.cc:1428] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.154954 12167 tablet_bootstrap.cc:492] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.156068 12167 tablet_bootstrap.cc:654] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.156966 12175 ts_tablet_manager.cc:1918] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.157084 12172 tablet_bootstrap.cc:492] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.157178 12172 ts_tablet_manager.cc:1397] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250625 14:02:01.157191 12175 log.cc:1199] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f2f40caafd5e4557af321454d28fa2ab
I20250625 14:02:01.157521 12175 ts_tablet_manager.cc:1939] T f2f40caafd5e4557af321454d28fa2ab P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.157765 12172 raft_consensus.cc:357] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.157877 12172 raft_consensus.cc:383] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.157922 12172 raft_consensus.cc:738] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.158053 12172 consensus_queue.cc:260] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.158210 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f2f40caafd5e4557af321454d28fa2ab (table default.Table_bb1104be50d8484ab10c1efe62b44b88 [id=70d3fc86e64847b9b7edd7945c195dc6]) successfully deleted
I20250625 14:02:01.158404 12172 ts_tablet_manager.cc:1428] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:01.158442 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b345695e57a24b09aff2b8e00bf0fbdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b345695e57a24b09aff2b8e00bf0fbdf already in progress: creating tablet
I20250625 14:02:01.158615 12172 tablet_bootstrap.cc:492] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.159231 12175 tablet_replica.cc:331] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.159653 12172 tablet_bootstrap.cc:654] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.159771 12175 raft_consensus.cc:2241] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.160395 12175 raft_consensus.cc:2270] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.160871 12166 tablet_bootstrap.cc:492] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.160957 12166 ts_tablet_manager.cc:1397] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20250625 14:02:01.161494 12166 raft_consensus.cc:357] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.161617 12166 raft_consensus.cc:383] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.161656 12166 raft_consensus.cc:738] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.161777 12166 consensus_queue.cc:260] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.162072 12166 ts_tablet_manager.cc:1428] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.159842 12177 ts_tablet_manager.cc:1905] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.162284 12166 tablet_bootstrap.cc:492] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.163296 12166 tablet_bootstrap.cc:654] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.163991 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f2f40caafd5e4557af321454d28fa2ab (table default.Table_bb1104be50d8484ab10c1efe62b44b88 [id=70d3fc86e64847b9b7edd7945c195dc6]) successfully deleted
I20250625 14:02:01.164059 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.164258 12173 tablet_replica.cc:331] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.164855 12173 raft_consensus.cc:2241] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.164989 12173 raft_consensus.cc:2270] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.165508 12173 ts_tablet_manager.cc:1905] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.168578 12173 ts_tablet_manager.cc:1918] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.168660 12173 log.cc:1199] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/2f2c3d6fe97d4cb3b52e2ffea14e615b
I20250625 14:02:01.169173 12177 ts_tablet_manager.cc:1918] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.169247 12177 log.cc:1199] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c1c05e534c804eb69e0c249a03418941
I20250625 14:02:01.169505 12177 ts_tablet_manager.cc:1939] T c1c05e534c804eb69e0c249a03418941 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.169822 12177 tablet_replica.cc:331] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.172359 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]) successfully deleted
I20250625 14:02:01.173331 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ecf43538fe7449d3b6b1cb9e34781b9e" } modify_external_catalogs: true
I20250625 14:02:01.173466 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ecf43538fe7449d3b6b1cb9e34781b9e" } modify_external_catalogs: true
I20250625 14:02:01.173772 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5f35471d262d448ea3ab37e9d47ecc88" } new_table_name: "default.Table_2c2b195f74a64e3990919d0efcb9e1ac" modify_external_catalogs: true
I20250625 14:02:01.170830 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.175805 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9b10f90014114258a8dbc17cfd7929b9" } modify_external_catalogs: true
I20250625 14:02:01.175900 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9b10f90014114258a8dbc17cfd7929b9" } modify_external_catalogs: true
I20250625 14:02:01.176251 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9b0ab65cb6b34b5e842f0024f6a8302b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.176657 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b0ab65cb6b34b5e842f0024f6a8302b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.178072 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cedbc8ae8dab416789f47248c6ebfcbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.178221 12177 raft_consensus.cc:2241] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.178365 12177 raft_consensus.cc:2270] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.178813 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cedbc8ae8dab416789f47248c6ebfcbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.178865 12177 ts_tablet_manager.cc:1905] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.179100 13241 tablet.cc:1722] T 93d666f4b403435287f4157bda971193 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:01.181288 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 801fae4d88114ff29eacde80365b84a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.181699 13244 tablet.cc:1722] T 93d666f4b403435287f4157bda971193 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:01.184262 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a541ff958c5d40e5a671a6be42dcbf41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.184679 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a541ff958c5d40e5a671a6be42dcbf41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.185292 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d2ab8a595872457fa3c4f0042a350248" } new_table_name: "default.Table_91ae9ce0be4c4785a73a0f4e89a1cbac" modify_external_catalogs: true
I20250625 14:02:01.186370 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_34dc11525e5c4255b2b2d4d9642807fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.186707 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34dc11525e5c4255b2b2d4d9642807fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.187422 13121 raft_consensus.cc:491] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.187512 13121 raft_consensus.cc:513] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.187878 12953 tablet.cc:1722] T 93d666f4b403435287f4157bda971193 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:01.187932 13121 leader_election.cc:290] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.188017 13121 consensus_queue.cc:1035] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.190147 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4ca3d5203a64d99912765b83af97c09" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.190289 11918 raft_consensus.cc:2466] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:01.190536 12175 ts_tablet_manager.cc:1905] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.190781 11990 leader_election.cc:304] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.190979 13232 raft_consensus.cc:2802] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.191035 13232 raft_consensus.cc:491] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.191071 13232 raft_consensus.cc:3058] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.192031 13232 raft_consensus.cc:513] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.192385 13232 leader_election.cc:290] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.192695 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4ca3d5203a64d99912765b83af97c09" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:01.192806 11918 raft_consensus.cc:3058] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.193181 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 8b1bf8f04694456e91687d89ceb39d56 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.193780 11918 raft_consensus.cc:2466] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:01.194221 11990 leader_election.cc:304] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.194540 12167 tablet_bootstrap.cc:492] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.194633 12167 ts_tablet_manager.cc:1397] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250625 14:02:01.195125 12167 raft_consensus.cc:357] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.195238 12167 raft_consensus.cc:383] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.195271 12167 raft_consensus.cc:738] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.195786 12177 ts_tablet_manager.cc:1918] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.195858 12177 log.cc:1199] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/fae1eddf1156499aa346502f7a200125
I20250625 14:02:01.196087 12177 ts_tablet_manager.cc:1939] T fae1eddf1156499aa346502f7a200125 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.196614 12167 consensus_queue.cc:260] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.197134 13121 raft_consensus.cc:2802] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.197222 13121 raft_consensus.cc:695] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:01.197331 13121 consensus_queue.cc:237] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.198463 12173 ts_tablet_manager.cc:1939] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.199352 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b (table default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]) successfully deleted
I20250625 14:02:01.199501 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4ca3d5203a64d99912765b83af97c09" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:01.199606 11784 raft_consensus.cc:3058] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.199656 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a4ca3d5203a64d99912765b83af97c09" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:01.200574 11784 raft_consensus.cc:2466] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:01.204262 12167 ts_tablet_manager.cc:1428] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250625 14:02:01.204736 12167 tablet_bootstrap.cc:492] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.206457 12167 tablet_bootstrap.cc:654] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.206557 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet fae1eddf1156499aa346502f7a200125 (table default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]) successfully deleted
W20250625 14:02:01.207500 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 806e5502a95e4a0396c008267e16f2d5 consensus state has no leader
I20250625 14:02:01.208528 12175 ts_tablet_manager.cc:1918] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.208607 12175 log.cc:1199] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/2f2c3d6fe97d4cb3b52e2ffea14e615b
I20250625 14:02:01.208603 12172 tablet_bootstrap.cc:492] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.208694 12172 ts_tablet_manager.cc:1397] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.000s
I20250625 14:02:01.208829 12175 ts_tablet_manager.cc:1939] T 2f2c3d6fe97d4cb3b52e2ffea14e615b P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.209270 12172 raft_consensus.cc:357] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.209393 12172 raft_consensus.cc:383] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.209425 12172 raft_consensus.cc:738] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.209556 12172 consensus_queue.cc:260] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.209877 12172 ts_tablet_manager.cc:1428] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.210073 12172 tablet_bootstrap.cc:492] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.210197 12166 tablet_bootstrap.cc:492] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.210282 12166 ts_tablet_manager.cc:1397] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.002s
I20250625 14:02:01.210852 12166 raft_consensus.cc:357] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.210955 12166 raft_consensus.cc:383] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.210989 12166 raft_consensus.cc:738] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.211139 12172 tablet_bootstrap.cc:654] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.211129 12166 consensus_queue.cc:260] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.211479 12166 ts_tablet_manager.cc:1428] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.214906 12177 tablet_replica.cc:331] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.215086 12177 raft_consensus.cc:2241] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.215862 12175 tablet_replica.cc:331] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.216025 12175 raft_consensus.cc:2241] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.216147 12175 raft_consensus.cc:2270] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.216506 12177 raft_consensus.cc:2270] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.220182 12177 ts_tablet_manager.cc:1905] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.222827 12167 tablet_bootstrap.cc:492] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.223024 12167 ts_tablet_manager.cc:1397] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:02:01.223448 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet cb66618516b44f27a715ddfbafde480d from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.224020 12167 raft_consensus.cc:357] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.224224 12167 raft_consensus.cc:383] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.224308 12167 raft_consensus.cc:738] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.224474 12167 consensus_queue.cc:260] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.224798 12167 ts_tablet_manager.cc:1428] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:01.225036 12167 tablet_bootstrap.cc:492] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:02:01.225275 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 096c166fc3b84bcf94b1565683bdbb38 consensus state has no leader
I20250625 14:02:01.225551 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_162814545c1c4cfcaefb1d6723cbcf59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.225950 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_162814545c1c4cfcaefb1d6723cbcf59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.226192 12167 tablet_bootstrap.cc:654] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.227110 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 2f2c3d6fe97d4cb3b52e2ffea14e615b (table default.Table_b0ebdaac5dcb4ca0abae0f22dd521551 [id=5780144da7034bee976245e26e405814]) successfully deleted
W20250625 14:02:01.227306 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b345695e57a24b09aff2b8e00bf0fbdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b345695e57a24b09aff2b8e00bf0fbdf already in progress: creating tablet
I20250625 14:02:01.227629 12177 ts_tablet_manager.cc:1918] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.227754 12177 log.cc:1199] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/3e56586f5cd745a397bf6ed1a63d070e
I20250625 14:02:01.228052 12177 ts_tablet_manager.cc:1939] T 3e56586f5cd745a397bf6ed1a63d070e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.228730 13352 consensus_queue.cc:1035] T 34bdfb2527c14c7985bc790dcb4d0657 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.228840 12177 tablet_replica.cc:331] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.228989 12177 raft_consensus.cc:2241] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.229117 12177 raft_consensus.cc:2270] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.229621 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 3e56586f5cd745a397bf6ed1a63d070e (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
W20250625 14:02:01.229835 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f7bbc6f086d49d7830d47d9db4ebf7b already in progress: creating tablet
I20250625 14:02:01.230096 12177 ts_tablet_manager.cc:1905] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.230819 12175 ts_tablet_manager.cc:1905] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.230973 12166 tablet_bootstrap.cc:492] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.232102 12166 tablet_bootstrap.cc:654] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.235136 12175 ts_tablet_manager.cc:1918] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.235306 12175 log.cc:1199] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/295ddb94cd4f489c9d53875bd1578474
I20250625 14:02:01.235612 12175 ts_tablet_manager.cc:1939] T 295ddb94cd4f489c9d53875bd1578474 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.235769 12600 raft_consensus.cc:491] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.235857 12600 raft_consensus.cc:513] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.236232 12600 leader_election.cc:290] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.236815 12175 tablet_replica.cc:331] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.236898 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 295ddb94cd4f489c9d53875bd1578474 (table default.Table_478843ad04c04773be560cc8ac45cc52 [id=9954b567381b49cf81d3cea6b706f327]) successfully deleted
I20250625 14:02:01.237181 12175 raft_consensus.cc:2241] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.237349 12175 raft_consensus.cc:2270] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.238880 12175 ts_tablet_manager.cc:1905] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.239022 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fce93c919a3446bb9999be958e08b500" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.239187 12042 raft_consensus.cc:2466] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:01.239535 11855 leader_election.cc:304] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.239713 12600 raft_consensus.cc:2802] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.239766 12600 raft_consensus.cc:491] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.239820 12600 raft_consensus.cc:3058] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.240758 12600 raft_consensus.cc:513] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.241151 13137 raft_consensus.cc:491] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.241189 12600 leader_election.cc:290] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.241269 13137 raft_consensus.cc:513] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.241658 13137 leader_election.cc:290] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.241873 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fce93c919a3446bb9999be958e08b500" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:01.242002 12042 raft_consensus.cc:3058] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.242033 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0627b4ff4173405eba5bd0686bab8e55" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.242163 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0627b4ff4173405eba5bd0686bab8e55" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:01.242553 11717 leader_election.cc:343] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.242715 11717 leader_election.cc:343] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.242777 11717 leader_election.cc:304] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.242899 13335 raft_consensus.cc:491] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.242992 13335 raft_consensus.cc:513] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.243047 12042 raft_consensus.cc:2466] T fce93c919a3446bb9999be958e08b500 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:01.243240 13137 raft_consensus.cc:2747] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.243350 13335 leader_election.cc:290] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.243360 11855 leader_election.cc:304] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.243516 12600 raft_consensus.cc:2802] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.243593 12600 raft_consensus.cc:695] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:01.243727 12600 consensus_queue.cc:237] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.244398 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fce93c919a3446bb9999be958e08b500" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:01.244499 11784 raft_consensus.cc:3058] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.244689 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fce93c919a3446bb9999be958e08b500" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:01.244702 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00437d4f1cae420698471935887c2418" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.244851 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00437d4f1cae420698471935887c2418" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:01.245239 11717 leader_election.cc:343] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.245364 11717 leader_election.cc:343] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.245417 11717 leader_election.cc:304] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.245476 11784 raft_consensus.cc:2466] T fce93c919a3446bb9999be958e08b500 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:01.245671 13335 raft_consensus.cc:2747] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.245936 12175 ts_tablet_manager.cc:1918] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.246075 12175 log.cc:1199] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/801fae4d88114ff29eacde80365b84a0
I20250625 14:02:01.246364 12175 ts_tablet_manager.cc:1939] T 801fae4d88114ff29eacde80365b84a0 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.246759 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_de445b22ad884186ad267d577630e845" } new_table_name: "default.Table_875e11b27bb446218a901c940558ca2f" modify_external_catalogs: true
I20250625 14:02:01.248929 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_740cd4b264aa4d3baf5d5c296a06cd43" } modify_external_catalogs: true
I20250625 14:02:01.249049 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_740cd4b264aa4d3baf5d5c296a06cd43" } modify_external_catalogs: true
I20250625 14:02:01.249365 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 801fae4d88114ff29eacde80365b84a0 (table default.Table_99e3b9f63eb947ed8424df6c7a25de5e [id=c1cfd4563a0043058570d3ce22551316]) successfully deleted
I20250625 14:02:01.249688 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 5fb1f0297ff443818507584b4ab00ddf from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.254710 12167 tablet_bootstrap.cc:492] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.254829 12167 ts_tablet_manager.cc:1397] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250625 14:02:01.255412 12167 raft_consensus.cc:357] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.255543 12167 raft_consensus.cc:383] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.255576 12167 raft_consensus.cc:738] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.255699 12167 consensus_queue.cc:260] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.255990 12167 ts_tablet_manager.cc:1428] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.256191 12167 tablet_bootstrap.cc:492] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.257198 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5fb1f0297ff443818507584b4ab00ddf
I20250625 14:02:01.257480 12167 tablet_bootstrap.cc:654] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.258643 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 5fb1f0297ff443818507584b4ab00ddf deleted and replaced by tablet 883e83d188fe4a13b36f780842e3bc4a
I20250625 14:02:01.258893 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 5fb1f0297ff443818507584b4ab00ddf with delete_type TABLET_DATA_DELETED (replaced by tablet 883e83d188fe4a13b36f780842e3bc4a) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.259274 12177 ts_tablet_manager.cc:1918] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.259351 12177 log.cc:1199] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b97c5c63a8184f07ad6e8054d056ff58
I20250625 14:02:01.259573 12177 ts_tablet_manager.cc:1939] T b97c5c63a8184f07ad6e8054d056ff58 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.259900 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9b8a6b5a7ff34d5486a1887a30984012" } modify_external_catalogs: true
I20250625 14:02:01.260059 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9b8a6b5a7ff34d5486a1887a30984012" } modify_external_catalogs: true
I20250625 14:02:01.261550 12177 tablet_replica.cc:331] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.261703 12177 raft_consensus.cc:2241] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.261819 12177 raft_consensus.cc:2270] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.262023 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b97c5c63a8184f07ad6e8054d056ff58 (table default.Table_bd047e00bc2045538f5a1a59bb15519f [id=afb45b5ae6fd44d79aeffec0dfa629c9]) successfully deleted
I20250625 14:02:01.263613 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 5fb1f0297ff443818507584b4ab00ddf with delete_type TABLET_DATA_DELETED (replaced by tablet 883e83d188fe4a13b36f780842e3bc4a) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.263803 12175 tablet_replica.cc:331] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.263944 12175 raft_consensus.cc:2241] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.264060 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 5fb1f0297ff443818507584b4ab00ddf with delete_type TABLET_DATA_DELETED (replaced by tablet 883e83d188fe4a13b36f780842e3bc4a) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.264097 12175 pending_rounds.cc:70] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:02:01.264127 12175 pending_rounds.cc:77] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523055378575360 op_type: NO_OP noop_request { }
W20250625 14:02:01.264178 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8cf54c149e444987817228977ac06c2d consensus state has no leader
I20250625 14:02:01.264195 12175 raft_consensus.cc:2887] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:01.264248 12175 raft_consensus.cc:2270] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.264415 12173 tablet_replica.cc:331] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.264560 12173 raft_consensus.cc:2241] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.264671 12173 raft_consensus.cc:2270] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.265092 12173 ts_tablet_manager.cc:1905] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.265245 12177 ts_tablet_manager.cc:1905] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.265223 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_75443e5e812b45d9bc5d267fc83bde83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.265877 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75443e5e812b45d9bc5d267fc83bde83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.266701 13335 raft_consensus.cc:491] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.266793 13335 raft_consensus.cc:513] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.267132 13335 leader_election.cc:290] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.267596 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b1bf8f04694456e91687d89ceb39d56" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.267675 12177 ts_tablet_manager.cc:1918] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.267737 12177 log.cc:1199] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/801fae4d88114ff29eacde80365b84a0
I20250625 14:02:01.267727 12173 ts_tablet_manager.cc:1918] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.267789 12173 log.cc:1199] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/5fb1f0297ff443818507584b4ab00ddf
I20250625 14:02:01.267979 12177 ts_tablet_manager.cc:1939] T 801fae4d88114ff29eacde80365b84a0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.268034 12173 ts_tablet_manager.cc:1939] T 5fb1f0297ff443818507584b4ab00ddf P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:01.268321 11717 leader_election.cc:343] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.268461 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b1bf8f04694456e91687d89ceb39d56" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.268739 12175 ts_tablet_manager.cc:1905] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:01.268914 11717 leader_election.cc:343] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.268999 11717 leader_election.cc:304] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.269173 13335 raft_consensus.cc:2747] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.271226 12175 ts_tablet_manager.cc:1918] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.271319 12175 log.cc:1199] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/5fb1f0297ff443818507584b4ab00ddf
I20250625 14:02:01.271579 12175 ts_tablet_manager.cc:1939] T 5fb1f0297ff443818507584b4ab00ddf P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.271683 12177 tablet_replica.cc:331] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.271836 12177 raft_consensus.cc:2241] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.271838 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 801fae4d88114ff29eacde80365b84a0 (table default.Table_99e3b9f63eb947ed8424df6c7a25de5e [id=c1cfd4563a0043058570d3ce22551316]) successfully deleted
I20250625 14:02:01.271947 12177 raft_consensus.cc:2270] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.272022 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 594d394be3f54a3bb2b7d4705e1877d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 594d394be3f54a3bb2b7d4705e1877d5 already in progress: creating tablet
W20250625 14:02:01.272166 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d53e9ef9d5f64cb893a552ab0784c120 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d53e9ef9d5f64cb893a552ab0784c120 already in progress: creating tablet
W20250625 14:02:01.272306 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb6f4cb8f8c9426bbbfcdd3b350e950e already in progress: creating tablet
I20250625 14:02:01.272346 12177 ts_tablet_manager.cc:1905] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.272367 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 5fb1f0297ff443818507584b4ab00ddf (table default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]) successfully deleted
I20250625 14:02:01.272471 13335 raft_consensus.cc:491] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.272555 13335 raft_consensus.cc:513] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.272904 13335 leader_election.cc:290] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.273379 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ebec65b7f6a475ab01359aab392d1cf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.273403 11526 catalog_manager.cc:5582] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:01.273648 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a4ca3d5203a64d99912765b83af97c09 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]). Expected version 1 got 0
I20250625 14:02:01.273940 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8ebec65b7f6a475ab01359aab392d1cf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:01.274178 11717 leader_election.cc:343] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.274361 11717 leader_election.cc:343] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.274405 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1721c814394940f094f12911b6e9c1de
I20250625 14:02:01.274427 11717 leader_election.cc:304] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.274631 13335 raft_consensus.cc:2747] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.274789 12177 ts_tablet_manager.cc:1918] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.274794 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 7fe89f83d1bd4beab31544e8dd45a448 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.274860 12177 log.cc:1199] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e7300adf77db4dafa942e06f07e635a9
I20250625 14:02:01.275115 12177 ts_tablet_manager.cc:1939] T e7300adf77db4dafa942e06f07e635a9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.275368 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 1721c814394940f094f12911b6e9c1de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.275399 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 1721c814394940f094f12911b6e9c1de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.275496 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_86c68a2f990a4174aad0cf389e4d23d4 [id=27af5f3cf87a4e71937c303a90e3d366] alter complete (version 2)
I20250625 14:02:01.275524 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 1721c814394940f094f12911b6e9c1de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.275723 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 10fa4d981de8405ebf2a1bdb82a41cd3
I20250625 14:02:01.275813 12177 tablet_replica.cc:331] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.275969 12177 raft_consensus.cc:2241] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.276145 12177 raft_consensus.cc:2270] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.276156 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.276531 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.276553 12177 ts_tablet_manager.cc:1905] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.277097 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 5fb1f0297ff443818507584b4ab00ddf (table default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]) successfully deleted
W20250625 14:02:01.277272 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1721c814394940f094f12911b6e9c1de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1721c814394940f094f12911b6e9c1de already in progress: creating tablet
W20250625 14:02:01.277494 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1721c814394940f094f12911b6e9c1de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1721c814394940f094f12911b6e9c1de already in progress: creating tablet
W20250625 14:02:01.277803 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10fa4d981de8405ebf2a1bdb82a41cd3 already in progress: creating tablet
W20250625 14:02:01.277977 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10fa4d981de8405ebf2a1bdb82a41cd3 already in progress: creating tablet
I20250625 14:02:01.278076 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1543af6914f44570a055b91f50062670
I20250625 14:02:01.278611 12177 ts_tablet_manager.cc:1918] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:01.278676 12177 log.cc:1199] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9e952a2f63ab4ff3bdebd62848e0c1b6
I20250625 14:02:01.278918 12177 ts_tablet_manager.cc:1939] T 9e952a2f63ab4ff3bdebd62848e0c1b6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.279037 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 1543af6914f44570a055b91f50062670 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.279255 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 1543af6914f44570a055b91f50062670 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.279450 12177 tablet_replica.cc:331] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.279572 12177 raft_consensus.cc:2241] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.279654 12177 raft_consensus.cc:2270] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.279775 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1543af6914f44570a055b91f50062670 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1543af6914f44570a055b91f50062670 already in progress: creating tablet
W20250625 14:02:01.279889 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1543af6914f44570a055b91f50062670 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1543af6914f44570a055b91f50062670 already in progress: creating tablet
I20250625 14:02:01.281487 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 1543af6914f44570a055b91f50062670 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.281607 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.281788 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e7300adf77db4dafa942e06f07e635a9 (table default.Table_daa46b6e09604fbe821817cc42384742 [id=ccb915c6ee95448296116b2791b3ed0e]) successfully deleted
W20250625 14:02:01.281917 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 3faa8782ba0d45dbbd89437685a64aef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3faa8782ba0d45dbbd89437685a64aef already in progress: creating tablet
I20250625 14:02:01.282038 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9e952a2f63ab4ff3bdebd62848e0c1b6 (table default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]) successfully deleted
I20250625 14:02:01.283608 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7353ef647c3649d59fadbd240ccae7bb
I20250625 14:02:01.284404 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 7353ef647c3649d59fadbd240ccae7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.284467 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 7353ef647c3649d59fadbd240ccae7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.284934 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 7353ef647c3649d59fadbd240ccae7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:01.285871 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7353ef647c3649d59fadbd240ccae7bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7353ef647c3649d59fadbd240ccae7bb already in progress: creating tablet
W20250625 14:02:01.286029 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7353ef647c3649d59fadbd240ccae7bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7353ef647c3649d59fadbd240ccae7bb already in progress: creating tablet
I20250625 14:02:01.286783 11533 catalog_manager.cc:5582] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:01.288775 11752 tablet_service.cc:1468] Processing CreateTablet for tablet e89d3a05feda4049aa47f0ed5aaf93b4 (DEFAULT_TABLE table=default.Table_7e97826c0ac04d3f80d9f5e15b03452f [id=042efa2cf7b24d858062bf451d679438]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.289067 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d3a05feda4049aa47f0ed5aaf93b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.290795 12177 ts_tablet_manager.cc:1905] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.292044 11894 tablet_service.cc:1468] Processing CreateTablet for tablet e89d3a05feda4049aa47f0ed5aaf93b4 (DEFAULT_TABLE table=default.Table_7e97826c0ac04d3f80d9f5e15b03452f [id=042efa2cf7b24d858062bf451d679438]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.292375 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d3a05feda4049aa47f0ed5aaf93b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.293040 12177 ts_tablet_manager.cc:1918] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.293102 12177 log.cc:1199] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8ebec65b7f6a475ab01359aab392d1cf
I20250625 14:02:01.293118 12021 tablet_service.cc:1468] Processing CreateTablet for tablet e89d3a05feda4049aa47f0ed5aaf93b4 (DEFAULT_TABLE table=default.Table_7e97826c0ac04d3f80d9f5e15b03452f [id=042efa2cf7b24d858062bf451d679438]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.293308 12177 ts_tablet_manager.cc:1939] T 8ebec65b7f6a475ab01359aab392d1cf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.293411 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89d3a05feda4049aa47f0ed5aaf93b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.293862 12177 tablet_replica.cc:331] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.293995 12177 raft_consensus.cc:2241] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.294095 12177 raft_consensus.cc:2270] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.296655 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8ebec65b7f6a475ab01359aab392d1cf (table default.Table_de10db8210b34241a0e63aaa8702fb67 [id=e183bb9e565845b7aab4a61a32ccb7ed]) successfully deleted
I20250625 14:02:01.296705 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7fe89f83d1bd4beab31544e8dd45a448
I20250625 14:02:01.296970 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 7fe89f83d1bd4beab31544e8dd45a448 deleted and replaced by tablet 93a420268757402b8cd0609b79187e8b
I20250625 14:02:01.297123 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 1d73b0124af54007b4e16a3f653836af (DEFAULT_TABLE table=default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.297385 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d73b0124af54007b4e16a3f653836af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.298381 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 1d73b0124af54007b4e16a3f653836af (DEFAULT_TABLE table=default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.298632 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d73b0124af54007b4e16a3f653836af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.298599 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 1d73b0124af54007b4e16a3f653836af (DEFAULT_TABLE table=default.Table_17d82633b136412b84fe29a827c8bd5f [id=db9eb49b2b2d49bb8dc446545f82064b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.298817 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d73b0124af54007b4e16a3f653836af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.299484 11757 tablet_service.cc:1468] Processing CreateTablet for tablet b491668795ae4c0fb626d8c83c550243 (DEFAULT_TABLE table=default.Table_197e23eaa8114f5e87c9b4166f3f7995 [id=96b82f9b53d1409188ff29e2ff2cf8ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.299685 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b491668795ae4c0fb626d8c83c550243. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.302076 12021 tablet_service.cc:1468] Processing CreateTablet for tablet b491668795ae4c0fb626d8c83c550243 (DEFAULT_TABLE table=default.Table_197e23eaa8114f5e87c9b4166f3f7995 [id=96b82f9b53d1409188ff29e2ff2cf8ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.302291 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b491668795ae4c0fb626d8c83c550243. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.302711 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 7fe89f83d1bd4beab31544e8dd45a448 with delete_type TABLET_DATA_DELETED (replaced by tablet 93a420268757402b8cd0609b79187e8b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.303036 12177 ts_tablet_manager.cc:1905] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.303949 12166 tablet_bootstrap.cc:492] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.304054 12166 ts_tablet_manager.cc:1397] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.000s
I20250625 14:02:01.304574 11894 tablet_service.cc:1468] Processing CreateTablet for tablet b491668795ae4c0fb626d8c83c550243 (DEFAULT_TABLE table=default.Table_197e23eaa8114f5e87c9b4166f3f7995 [id=96b82f9b53d1409188ff29e2ff2cf8ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.304629 12166 raft_consensus.cc:357] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.304737 12166 raft_consensus.cc:383] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.304767 12166 raft_consensus.cc:738] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.304821 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b491668795ae4c0fb626d8c83c550243. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.304891 12166 consensus_queue.cc:260] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.305122 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 295ddb94cd4f489c9d53875bd1578474 with delete_type TABLET_DATA_DELETED (replaced by tablet 881295234a5b4a089985382765774cd9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.305193 12166 ts_tablet_manager.cc:1428] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.305395 12166 tablet_bootstrap.cc:492] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.305771 12177 ts_tablet_manager.cc:1918] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.305846 12177 log.cc:1199] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d3693e166c2c4af0b7a8f7994507de2c
I20250625 14:02:01.306125 12177 ts_tablet_manager.cc:1939] T d3693e166c2c4af0b7a8f7994507de2c P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.306864 12177 tablet_replica.cc:331] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.306952 12173 tablet_replica.cc:331] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.307024 12177 raft_consensus.cc:2241] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.307070 12558 raft_consensus.cc:491] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.307111 12173 raft_consensus.cc:2241] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.307137 12177 raft_consensus.cc:2270] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.307123 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d3693e166c2c4af0b7a8f7994507de2c (table default.Table_dca578face4f4457a35e41ae7c8e62d9 [id=41869cf657a84d8481d779530f631972]) successfully deleted
I20250625 14:02:01.307138 12558 raft_consensus.cc:513] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.307232 12173 raft_consensus.cc:2270] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.307328 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b345695e57a24b09aff2b8e00bf0fbdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b345695e57a24b09aff2b8e00bf0fbdf already in progress: creating tablet
I20250625 14:02:01.307541 12558 leader_election.cc:290] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.307637 12177 ts_tablet_manager.cc:1905] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.307796 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e15bd70671f8458db5b9e52423189eda" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:01.308173 11855 leader_election.cc:343] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.308257 11858 leader_election.cc:343] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: e15bd70671f8458db5b9e52423189eda
I20250625 14:02:01.308322 11858 leader_election.cc:304] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:01.309239 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 7fe89f83d1bd4beab31544e8dd45a448 with delete_type TABLET_DATA_DELETED (replaced by tablet 93a420268757402b8cd0609b79187e8b) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.309312 12558 raft_consensus.cc:2747] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.309820 12177 ts_tablet_manager.cc:1918] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.309891 12177 log.cc:1199] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/34ef10dc2de8460c90dc0cf3bb5fe234
I20250625 14:02:01.309957 12173 ts_tablet_manager.cc:1905] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.310098 12177 ts_tablet_manager.cc:1939] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.310209 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 7fe89f83d1bd4beab31544e8dd45a448 with delete_type TABLET_DATA_DELETED (replaced by tablet 93a420268757402b8cd0609b79187e8b) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:01.310557 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7fe89f83d1bd4beab31544e8dd45a448 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fe89f83d1bd4beab31544e8dd45a448 already in progress: creating tablet
I20250625 14:02:01.310844 12177 tablet_replica.cc:331] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.310956 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 34ef10dc2de8460c90dc0cf3bb5fe234 (table default.Table_67c0588df36842488fcf1789bb9e0c88 [id=ca4d9657d22c41cb8df831d8a7470745]) successfully deleted
I20250625 14:02:01.310982 12177 raft_consensus.cc:2241] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.311080 12177 raft_consensus.cc:2270] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.312232 12173 ts_tablet_manager.cc:1918] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.312291 12173 log.cc:1199] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/295ddb94cd4f489c9d53875bd1578474
I20250625 14:02:01.312476 12173 ts_tablet_manager.cc:1939] T 295ddb94cd4f489c9d53875bd1578474 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.313714 12166 tablet_bootstrap.cc:654] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.314374 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 295ddb94cd4f489c9d53875bd1578474 (table default.Table_478843ad04c04773be560cc8ac45cc52 [id=9954b567381b49cf81d3cea6b706f327]) successfully deleted
W20250625 14:02:01.314626 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7fe89f83d1bd4beab31544e8dd45a448 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fe89f83d1bd4beab31544e8dd45a448 already in progress: creating tablet
I20250625 14:02:01.315752 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a95691b366be4e5e8b697bca3dede838
I20250625 14:02:01.317145 12172 tablet_bootstrap.cc:492] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.317241 12172 ts_tablet_manager.cc:1397] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.107s user 0.002s sys 0.000s
I20250625 14:02:01.317752 12172 raft_consensus.cc:357] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.317853 12172 raft_consensus.cc:383] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.317888 12172 raft_consensus.cc:738] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.318006 12172 consensus_queue.cc:260] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.318073 12558 consensus_queue.cc:1035] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.318346 12172 ts_tablet_manager.cc:1428] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:01.318470 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet cb66618516b44f27a715ddfbafde480d
I20250625 14:02:01.318547 12172 tablet_bootstrap.cc:492] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.318748 11528 catalog_manager.cc:6652] ReplaceTablet: tablet cb66618516b44f27a715ddfbafde480d deleted and replaced by tablet a6fc582219ca44c7b59a06e8f10eacbd
I20250625 14:02:01.319592 12172 tablet_bootstrap.cc:654] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.319707 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet a95691b366be4e5e8b697bca3dede838 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.320487 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.320883 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet cb66618516b44f27a715ddfbafde480d with delete_type TABLET_DATA_DELETED (replaced by tablet a6fc582219ca44c7b59a06e8f10eacbd) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.321954 12167 tablet_bootstrap.cc:492] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.322085 12167 ts_tablet_manager.cc:1397] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.000s
I20250625 14:02:01.322829 12167 raft_consensus.cc:357] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.322973 12167 raft_consensus.cc:383] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.323019 12167 raft_consensus.cc:738] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.323181 12167 consensus_queue.cc:260] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.323396 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet a95691b366be4e5e8b697bca3dede838 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.323503 12167 ts_tablet_manager.cc:1428] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:01.323684 12167 tablet_bootstrap.cc:492] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.324807 12167 tablet_bootstrap.cc:654] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.325300 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet e15bd70671f8458db5b9e52423189eda with delete_type TABLET_DATA_DELETED (replaced by tablet 1d596792632e4e32be161450f46b4168) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.325507 12175 tablet_replica.cc:331] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.325651 12175 raft_consensus.cc:2241] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.325760 12175 raft_consensus.cc:2270] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.326462 12175 ts_tablet_manager.cc:1905] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.326660 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 295ddb94cd4f489c9d53875bd1578474 with delete_type TABLET_DATA_DELETED (replaced by tablet 881295234a5b4a089985382765774cd9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.326797 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet e9476529c1b7401683c02e146f54a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.326900 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.327229 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet a95691b366be4e5e8b697bca3dede838 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.327244 12173 tablet_replica.cc:331] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.327455 12173 raft_consensus.cc:2241] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.327548 12173 raft_consensus.cc:2270] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.328970 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet cb66618516b44f27a715ddfbafde480d with delete_type TABLET_DATA_DELETED (replaced by tablet a6fc582219ca44c7b59a06e8f10eacbd) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.329093 12175 ts_tablet_manager.cc:1918] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.329159 12175 log.cc:1199] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e15bd70671f8458db5b9e52423189eda
I20250625 14:02:01.329363 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet cb66618516b44f27a715ddfbafde480d with delete_type TABLET_DATA_DELETED (replaced by tablet a6fc582219ca44c7b59a06e8f10eacbd) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:01.329655 11517 catalog_manager.cc:4895] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 295ddb94cd4f489c9d53875bd1578474 because the tablet was not found. No further retry: Not found: Tablet not found: 295ddb94cd4f489c9d53875bd1578474
I20250625 14:02:01.330024 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.330534 12173 ts_tablet_manager.cc:1905] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:01.332357 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a95691b366be4e5e8b697bca3dede838 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a95691b366be4e5e8b697bca3dede838 already in progress: creating tablet
I20250625 14:02:01.332770 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet e1ad291ba0da4f3fa70aa9548ef71d01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.333433 12175 ts_tablet_manager.cc:1939] T e15bd70671f8458db5b9e52423189eda P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.334267 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e15bd70671f8458db5b9e52423189eda (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
I20250625 14:02:01.334908 12173 ts_tablet_manager.cc:1918] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250625 14:02:01.335037 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet cb66618516b44f27a715ddfbafde480d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb66618516b44f27a715ddfbafde480d already in progress: creating tablet
I20250625 14:02:01.335204 12173 log.cc:1199] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e9476529c1b7401683c02e146f54a228
I20250625 14:02:01.335422 12173 ts_tablet_manager.cc:1939] T e9476529c1b7401683c02e146f54a228 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.335618 12175 tablet_replica.cc:331] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.335772 12175 raft_consensus.cc:2241] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.335897 12175 raft_consensus.cc:2270] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.336243 12167 tablet_bootstrap.cc:492] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.336371 12167 ts_tablet_manager.cc:1397] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:01.336490 12175 ts_tablet_manager.cc:1905] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.336980 12167 raft_consensus.cc:357] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.338191 13421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:02:01.338366 13421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
I20250625 14:02:01.338456 13335 raft_consensus.cc:491] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.338552 13335 raft_consensus.cc:513] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.338919 13335 leader_election.cc:290] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.339409 12175 ts_tablet_manager.cc:1918] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.339533 12167 raft_consensus.cc:383] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.339630 12167 raft_consensus.cc:738] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.339906 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "837e98e4e48a465fa9c3e697ae34c9ea" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.340000 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "837e98e4e48a465fa9c3e697ae34c9ea" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.340425 12175 log.cc:1199] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e1ad291ba0da4f3fa70aa9548ef71d01
W20250625 14:02:01.340842 11717 leader_election.cc:343] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.340436 12167 consensus_queue.cc:260] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.341014 12175 ts_tablet_manager.cc:1939] T e1ad291ba0da4f3fa70aa9548ef71d01 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:02:01.341001 11717 leader_election.cc:343] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.341068 11717 leader_election.cc:304] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.341234 13335 raft_consensus.cc:2747] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.343997 12173 tablet_replica.cc:331] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.344481 12173 raft_consensus.cc:2241] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.344621 12173 raft_consensus.cc:2270] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.344363 12167 ts_tablet_manager.cc:1428] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20250625 14:02:01.344960 12167 tablet_bootstrap.cc:492] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.345124 12173 ts_tablet_manager.cc:1905] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.347173 12167 tablet_bootstrap.cc:654] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.348170 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e1ad291ba0da4f3fa70aa9548ef71d01 (table default.Table_675a9837739b463fbb71d870eda3a3c2 [id=3177ee8dc2ee43adbbf768c40dae97bd]) successfully deleted
I20250625 14:02:01.348590 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 10fa4d981de8405ebf2a1bdb82a41cd3 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.348879 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e9476529c1b7401683c02e146f54a228 (table default.Table_fd6351d08daa4564ba49cf00d72ecd56 [id=ebc9dc830f034c5682988e810c4eb9d3]) successfully deleted
I20250625 14:02:01.350252 12173 ts_tablet_manager.cc:1918] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.350376 12173 log.cc:1199] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/2030a3a1aa3a4702b7a2b4eaddf3c4b4
I20250625 14:02:01.351009 12173 ts_tablet_manager.cc:1939] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.349828 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_89944f8208c0482ba8fdb0d2ae89723f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.352126 12173 tablet_replica.cc:331] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.352190 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 (table default.Table_e07ec41a73ce4df9ab09b63d87da79be [id=e6ec8721bee347c19b4724c249a20e2f]) successfully deleted
I20250625 14:02:01.352319 12173 raft_consensus.cc:2241] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:02:01.352339 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a95691b366be4e5e8b697bca3dede838 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a95691b366be4e5e8b697bca3dede838 already in progress: creating tablet
I20250625 14:02:01.352454 12173 raft_consensus.cc:2270] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.352463 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet cb66618516b44f27a715ddfbafde480d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb66618516b44f27a715ddfbafde480d already in progress: creating tablet
I20250625 14:02:01.344723 12177 ts_tablet_manager.cc:1905] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.353343 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2eff9b2709c74720a25fd27e8c92073d" } new_table_name: "default.Table_37e44727f643447ea580d6fa6ebc699a" modify_external_catalogs: true
W20250625 14:02:01.355053 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89944f8208c0482ba8fdb0d2ae89723f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.356503 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1ad8bc8df53b47e8b766b570a08fbd82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.356961 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ad8bc8df53b47e8b766b570a08fbd82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.357700 12172 tablet_bootstrap.cc:492] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.357858 12172 ts_tablet_manager.cc:1397] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
W20250625 14:02:01.358528 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 042ea15848cf41949499f9878683bb83 consensus state has no leader
I20250625 14:02:01.358556 12172 raft_consensus.cc:357] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.358664 12172 raft_consensus.cc:383] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.358693 12172 raft_consensus.cc:738] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.358819 12172 consensus_queue.cc:260] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.359133 12172 ts_tablet_manager.cc:1428] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.359683 12173 ts_tablet_manager.cc:1905] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.360491 12172 tablet_bootstrap.cc:492] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.362124 12172 tablet_bootstrap.cc:654] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.363632 12167 tablet_bootstrap.cc:492] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.368165 12167 ts_tablet_manager.cc:1397] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20250625 14:02:01.368222 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_17050ff370b3439593f2c49820554432"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.368669 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17050ff370b3439593f2c49820554432 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.368959 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bf89472b824e4e6bb4262550d846a433"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.369271 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf89472b824e4e6bb4262550d846a433 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.370271 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6599fe84caa14c35abca12303dad90fc" } new_table_name: "default.Table_ed347c6c07c34e2f8d012b4137ef0af3" modify_external_catalogs: true
I20250625 14:02:01.370705 12166 tablet_bootstrap.cc:492] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.370785 12166 ts_tablet_manager.cc:1397] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
I20250625 14:02:01.370857 12167 raft_consensus.cc:357] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.370986 12167 raft_consensus.cc:383] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.371029 12167 raft_consensus.cc:738] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.371201 12167 consensus_queue.cc:260] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.371335 12166 raft_consensus.cc:357] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.371451 12166 raft_consensus.cc:383] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.371492 12166 raft_consensus.cc:738] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.371614 12166 consensus_queue.cc:260] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.371753 12167 ts_tablet_manager.cc:1428] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:01.371891 12166 ts_tablet_manager.cc:1428] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.372120 12166 tablet_bootstrap.cc:492] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.373265 12166 tablet_bootstrap.cc:654] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.373251 12167 tablet_bootstrap.cc:492] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.374284 12167 tablet_bootstrap.cc:654] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.377071 12177 ts_tablet_manager.cc:1918] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.377179 12177 log.cc:1199] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9c4ee7f813d04ce2a0359f5fe7d5d8ef
I20250625 14:02:01.377434 12177 ts_tablet_manager.cc:1939] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.378064 12177 tablet_replica.cc:331] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.378232 12177 raft_consensus.cc:2241] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.378360 12177 raft_consensus.cc:2270] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.380012 12265 consensus_queue.cc:1035] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.381556 12172 tablet_bootstrap.cc:492] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.381712 12172 ts_tablet_manager.cc:1397] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:02:01.382294 12172 raft_consensus.cc:357] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.382428 12172 raft_consensus.cc:383] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.382467 12172 raft_consensus.cc:738] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.382627 12172 consensus_queue.cc:260] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.382989 12172 ts_tablet_manager.cc:1428] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.383431 12172 tablet_bootstrap.cc:492] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.384547 12172 tablet_bootstrap.cc:654] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.385128 12167 tablet_bootstrap.cc:492] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.385243 12167 ts_tablet_manager.cc:1397] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:01.385658 12177 ts_tablet_manager.cc:1905] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.387044 12167 raft_consensus.cc:357] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.387177 12167 raft_consensus.cc:383] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.387216 12167 raft_consensus.cc:738] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.387346 12167 consensus_queue.cc:260] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.387629 12167 ts_tablet_manager.cc:1428] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250625 14:02:01.387825 12167 tablet_bootstrap.cc:492] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.388056 12173 ts_tablet_manager.cc:1918] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.388113 12173 log.cc:1199] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e1ad291ba0da4f3fa70aa9548ef71d01
I20250625 14:02:01.388360 12173 ts_tablet_manager.cc:1939] T e1ad291ba0da4f3fa70aa9548ef71d01 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.389128 12167 tablet_bootstrap.cc:654] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.389276 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e1ad291ba0da4f3fa70aa9548ef71d01 (table default.Table_675a9837739b463fbb71d870eda3a3c2 [id=3177ee8dc2ee43adbbf768c40dae97bd]) successfully deleted
I20250625 14:02:01.390398 12166 tablet_bootstrap.cc:492] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.390486 12166 ts_tablet_manager.cc:1397] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:02:01.390925 12166 raft_consensus.cc:357] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.391016 12166 raft_consensus.cc:383] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.391042 12166 raft_consensus.cc:738] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.391631 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef (table default.Table_06d43b44b02e415d81733ddc00e3d18b [id=d2c5d6b97745451cabb9a44a25c19b80]) successfully deleted
I20250625 14:02:01.393685 12166 consensus_queue.cc:260] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.394908 12172 tablet_bootstrap.cc:492] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.395017 12172 ts_tablet_manager.cc:1397] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:01.395427 12172 raft_consensus.cc:357] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.395520 12172 raft_consensus.cc:383] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.395560 12172 raft_consensus.cc:738] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.395671 12172 consensus_queue.cc:260] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.396168 12172 ts_tablet_manager.cc:1428] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.396370 12172 tablet_bootstrap.cc:492] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.397310 12172 tablet_bootstrap.cc:654] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:01.398437 11519 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 042ea15848cf41949499f9878683bb83 (table default.Table_37e44727f643447ea580d6fa6ebc699a [id=5d71af43dc0348a09233006746009e49], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 042ea15848cf41949499f9878683bb83 consensus state has no leader
I20250625 14:02:01.397408 12177 ts_tablet_manager.cc:1918] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.398537 12177 log.cc:1199] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/5fb1f0297ff443818507584b4ab00ddf
I20250625 14:02:01.398751 12177 ts_tablet_manager.cc:1939] T 5fb1f0297ff443818507584b4ab00ddf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.399384 12172 tablet_bootstrap.cc:492] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.399381 12167 tablet_bootstrap.cc:492] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.399473 12167 ts_tablet_manager.cc:1397] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:01.399784 12166 ts_tablet_manager.cc:1428] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20250625 14:02:01.399951 12167 raft_consensus.cc:357] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.400058 12167 raft_consensus.cc:383] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.400089 12167 raft_consensus.cc:738] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.400244 12167 consensus_queue.cc:260] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.400542 12167 ts_tablet_manager.cc:1428] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.400723 12167 tablet_bootstrap.cc:492] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.400800 12172 ts_tablet_manager.cc:1397] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:01.401305 12172 raft_consensus.cc:357] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.401484 12172 raft_consensus.cc:383] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.401561 12172 raft_consensus.cc:738] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.401752 12167 tablet_bootstrap.cc:654] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.401767 12172 consensus_queue.cc:260] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.402294 12172 ts_tablet_manager.cc:1428] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.402551 12172 tablet_bootstrap.cc:492] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.403360 12177 tablet_replica.cc:331] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.403491 12177 raft_consensus.cc:2241] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.403605 12177 raft_consensus.cc:2270] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.403820 12172 tablet_bootstrap.cc:654] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.404371 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 5fb1f0297ff443818507584b4ab00ddf (table default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]) successfully deleted
W20250625 14:02:01.405092 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1721c814394940f094f12911b6e9c1de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1721c814394940f094f12911b6e9c1de already in progress: creating tablet
W20250625 14:02:01.405357 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1543af6914f44570a055b91f50062670 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1543af6914f44570a055b91f50062670 already in progress: creating tablet
W20250625 14:02:01.405560 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 10fa4d981de8405ebf2a1bdb82a41cd3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10fa4d981de8405ebf2a1bdb82a41cd3 already in progress: creating tablet
W20250625 14:02:01.405758 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7353ef647c3649d59fadbd240ccae7bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7353ef647c3649d59fadbd240ccae7bb already in progress: creating tablet
W20250625 14:02:01.406225 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7fe89f83d1bd4beab31544e8dd45a448 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fe89f83d1bd4beab31544e8dd45a448 already in progress: creating tablet
W20250625 14:02:01.406417 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a95691b366be4e5e8b697bca3dede838 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a95691b366be4e5e8b697bca3dede838 already in progress: creating tablet
I20250625 14:02:01.410765 12177 ts_tablet_manager.cc:1905] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.412016 13352 raft_consensus.cc:491] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.412137 13352 raft_consensus.cc:513] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.412220 12166 tablet_bootstrap.cc:492] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.412572 13352 leader_election.cc:290] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.413057 12265 raft_consensus.cc:491] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.413147 12265 raft_consensus.cc:513] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.413486 12265 leader_election.cc:290] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.413482 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_609fdabd07f24e4a8ab9be9b40b1b39e" } new_table_name: "default.Table_400fd728d70f41feace7aff4f4d49c4b" modify_external_catalogs: true
I20250625 14:02:01.413899 12167 tablet_bootstrap.cc:492] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.414230 12167 ts_tablet_manager.cc:1397] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:01.414460 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9ed052ae88e4b679ac55177a3bbab88" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.414579 12042 raft_consensus.cc:2466] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:01.414942 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0627b4ff4173405eba5bd0686bab8e55" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.415079 11918 raft_consensus.cc:2466] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:01.415371 11855 leader_election.cc:304] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.415524 12265 raft_consensus.cc:2802] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.415562 12265 raft_consensus.cc:491] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.415596 12265 raft_consensus.cc:3058] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.415640 12167 raft_consensus.cc:357] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.415735 12167 raft_consensus.cc:383] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.415766 12167 raft_consensus.cc:738] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.415911 12167 consensus_queue.cc:260] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.416215 12167 ts_tablet_manager.cc:1428] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:01.416412 12167 tablet_bootstrap.cc:492] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.416615 12265 raft_consensus.cc:513] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.416945 12265 leader_election.cc:290] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.417125 11990 leader_election.cc:304] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.417390 13121 raft_consensus.cc:2802] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.417490 13121 raft_consensus.cc:491] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.417544 13121 raft_consensus.cc:3058] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.417598 12167 tablet_bootstrap.cc:654] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.418613 13121 raft_consensus.cc:513] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.418951 13121 leader_election.cc:290] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.418499 12177 ts_tablet_manager.cc:1918] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.419338 12177 log.cc:1199] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8b1bf8f04694456e91687d89ceb39d56
I20250625 14:02:01.419572 12177 ts_tablet_manager.cc:1939] T 8b1bf8f04694456e91687d89ceb39d56 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.419564 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_27e4643611f149f5b8ce6162364e8467"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.419996 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27e4643611f149f5b8ce6162364e8467 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.420040 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9ed052ae88e4b679ac55177a3bbab88" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:01.420131 12042 raft_consensus.cc:3058] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.420342 12166 tablet_bootstrap.cc:654] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.421103 12042 raft_consensus.cc:2466] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:01.421536 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9ed052ae88e4b679ac55177a3bbab88" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:01.421622 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f9ed052ae88e4b679ac55177a3bbab88" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:01.421669 11784 raft_consensus.cc:2466] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:01.422412 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0627b4ff4173405eba5bd0686bab8e55" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:01.422528 11918 raft_consensus.cc:3058] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.422746 12167 tablet_bootstrap.cc:492] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
W20250625 14:02:01.422814 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cfcb08ddbdd43dd92472dcbdc772a2d consensus state has no leader
I20250625 14:02:01.422870 12167 ts_tablet_manager.cc:1397] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:02:01.423614 11918 raft_consensus.cc:2466] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:01.423731 12167 raft_consensus.cc:357] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.423832 12167 raft_consensus.cc:383] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.423869 12167 raft_consensus.cc:738] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.424014 12167 consensus_queue.cc:260] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.424326 12167 ts_tablet_manager.cc:1428] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.424726 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f644045e842a4eb6a1aec944110d0606"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.425087 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f644045e842a4eb6a1aec944110d0606 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.425817 11855 leader_election.cc:304] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.426342 12167 tablet_bootstrap.cc:492] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.426769 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e63fe2c5df514e2da6f77363d9dec47c" } new_table_name: "default.Table_d99af6ff01a9485c85fa33253072f7ef" modify_external_catalogs: true
I20250625 14:02:01.427104 12265 raft_consensus.cc:2802] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.427274 12265 raft_consensus.cc:695] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:01.427402 12265 consensus_queue.cc:237] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.427553 12167 tablet_bootstrap.cc:654] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.427951 11501 master_runner.cc:186] Error getting master registration for 127.11.39.190:38199: Network error: Client connection negotiation failed: client connection to 127.11.39.190:38199: connect: Connection refused (error 111),
I20250625 14:02:01.428049 11501 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250625 14:02:01.428519 11990 leader_election.cc:304] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.428699 13352 raft_consensus.cc:2802] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.428768 13352 raft_consensus.cc:695] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:01.428880 13352 consensus_queue.cc:237] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.433293 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8b1bf8f04694456e91687d89ceb39d56 (table default.Table_e11dc32e96254d3489a8f9c7028feaca [id=9644f5266f174f748510e2c26e6b102f]) successfully deleted
I20250625 14:02:01.433318 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0627b4ff4173405eba5bd0686bab8e55" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:01.433396 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0627b4ff4173405eba5bd0686bab8e55" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:01.433458 11784 raft_consensus.cc:2466] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:01.433490 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet cb66618516b44f27a715ddfbafde480d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb66618516b44f27a715ddfbafde480d already in progress: creating tablet
I20250625 14:02:01.434216 12172 tablet_bootstrap.cc:492] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.434355 12172 ts_tablet_manager.cc:1397] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.002s
I20250625 14:02:01.434842 12172 raft_consensus.cc:357] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.434958 12172 raft_consensus.cc:383] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.434993 12172 raft_consensus.cc:738] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.435106 12172 consensus_queue.cc:260] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.435391 12172 ts_tablet_manager.cc:1428] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.435596 12172 tablet_bootstrap.cc:492] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.436120 13121 raft_consensus.cc:491] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.436223 13121 raft_consensus.cc:513] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.436623 12172 tablet_bootstrap.cc:654] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.436609 13121 leader_election.cc:290] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.437322 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44dd83c53b15400d94bb7b1a8784569a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.437450 11915 raft_consensus.cc:2466] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:01.437774 11990 leader_election.cc:304] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.437934 13121 raft_consensus.cc:2802] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.437994 13121 raft_consensus.cc:491] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.438035 13121 raft_consensus.cc:3058] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.439694 13121 raft_consensus.cc:513] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.440002 13121 leader_election.cc:290] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.440851 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "44dd83c53b15400d94bb7b1a8784569a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:01.440972 11915 raft_consensus.cc:3058] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.442432 11915 raft_consensus.cc:2466] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
W20250625 14:02:01.442813 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ffa9f78bdf1a478bb201d672fc9e92d4 consensus state has no leader
I20250625 14:02:01.444003 11990 leader_election.cc:304] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.444324 13121 raft_consensus.cc:2802] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.444454 13121 raft_consensus.cc:695] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:01.444774 13121 consensus_queue.cc:237] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.447121 12167 tablet_bootstrap.cc:492] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.447150 12172 tablet_bootstrap.cc:492] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.447212 12167 ts_tablet_manager.cc:1397] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:02:01.447242 12172 ts_tablet_manager.cc:1397] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250625 14:02:01.447715 12167 raft_consensus.cc:357] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.447724 12172 raft_consensus.cc:357] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:01.447825 12167 raft_consensus.cc:383] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.447829 12172 raft_consensus.cc:383] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.447883 12167 raft_consensus.cc:738] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.447886 12172 raft_consensus.cc:738] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.448014 12167 consensus_queue.cc:260] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.448024 12172 consensus_queue.cc:260] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:01.448058 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c570db4043ad4896a62d6598f38d8660"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.448254 11993 leader_election.cc:343] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 44dd83c53b15400d94bb7b1a8784569a
I20250625 14:02:01.448326 12172 ts_tablet_manager.cc:1428] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.448355 12167 ts_tablet_manager.cc:1428] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:01.448516 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c570db4043ad4896a62d6598f38d8660 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.448542 12167 tablet_bootstrap.cc:492] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.448556 12172 tablet_bootstrap.cc:492] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:01.449383 11993 leader_election.cc:343] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 44dd83c53b15400d94bb7b1a8784569a
I20250625 14:02:01.449640 12167 tablet_bootstrap.cc:654] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.449641 12172 tablet_bootstrap.cc:654] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.451678 12167 tablet_bootstrap.cc:492] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.451761 12167 ts_tablet_manager.cc:1397] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:01.452000 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2d91a191018b49f0a5925c35ec583f86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.452239 12167 raft_consensus.cc:357] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.452342 12167 raft_consensus.cc:383] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.452378 12167 raft_consensus.cc:738] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
W20250625 14:02:01.452399 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d91a191018b49f0a5925c35ec583f86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.452497 12167 consensus_queue.cc:260] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.452772 12167 ts_tablet_manager.cc:1428] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.452968 12167 tablet_bootstrap.cc:492] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.453290 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_914775c66f004e21bd14f7c87028ca0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.453617 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_914775c66f004e21bd14f7c87028ca0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.453904 12167 tablet_bootstrap.cc:654] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.457381 12167 tablet_bootstrap.cc:492] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.457466 12167 ts_tablet_manager.cc:1397] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:01.457893 12167 raft_consensus.cc:357] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.458014 12167 raft_consensus.cc:383] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.458051 12167 raft_consensus.cc:738] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.458175 12167 consensus_queue.cc:260] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.458508 12167 ts_tablet_manager.cc:1428] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.458691 12167 tablet_bootstrap.cc:492] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.459720 12167 tablet_bootstrap.cc:654] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.465739 12166 tablet_bootstrap.cc:492] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.466398 12166 ts_tablet_manager.cc:1397] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20250625 14:02:01.466751 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3ef1319b5c184316b50ed0cc8da2abec" } new_table_name: "default.Table_f91a67f8ba664f31bf351cf52e532b15" modify_external_catalogs: true
I20250625 14:02:01.468998 12166 raft_consensus.cc:357] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.469218 12166 raft_consensus.cc:383] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.469290 12166 raft_consensus.cc:738] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.469501 12166 consensus_queue.cc:260] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:01.472246 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4bd610ccce4c4aa68491b0ebbdf0002a consensus state has no leader
I20250625 14:02:01.474393 12600 raft_consensus.cc:491] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.474498 12600 raft_consensus.cc:513] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.474846 12600 leader_election.cc:290] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.475425 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96fcc61e48e549618197d34346ea5b16" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.475931 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "96fcc61e48e549618197d34346ea5b16" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:01.476076 11782 raft_consensus.cc:2391] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:01.476037 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_03ef2dedc3ec4970b6e31ab7ece17acb" } modify_external_catalogs: true
I20250625 14:02:01.476157 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_03ef2dedc3ec4970b6e31ab7ece17acb" } modify_external_catalogs: true
I20250625 14:02:01.476701 11858 leader_election.cc:304] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:01.477018 12600 raft_consensus.cc:3058] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.478041 12600 raft_consensus.cc:2747] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.478639 12166 ts_tablet_manager.cc:1428] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20250625 14:02:01.479856 12167 tablet_bootstrap.cc:492] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.479974 12167 ts_tablet_manager.cc:1397] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.002s
I20250625 14:02:01.480468 12167 raft_consensus.cc:357] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.480566 12167 raft_consensus.cc:383] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.480594 12167 raft_consensus.cc:738] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.480707 12167 consensus_queue.cc:260] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.480960 12167 ts_tablet_manager.cc:1428] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.481161 12167 tablet_bootstrap.cc:492] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.482179 12167 tablet_bootstrap.cc:654] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.482594 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_469eddba721c44d599a1894bf7a95c2a" } modify_external_catalogs: true
I20250625 14:02:01.482719 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_469eddba721c44d599a1894bf7a95c2a" } modify_external_catalogs: true
I20250625 14:02:01.483675 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f5427083312e42a9b3320e8d5639dc1a" } modify_external_catalogs: true
I20250625 14:02:01.484099 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 39b41ff066cb499fae9b71ca1f2f9d2b from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.484958 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7b87d17923ce49cda6bb7de761f700d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.485146 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6d4a606cc39f4c5991ebd75363e1b078" } modify_external_catalogs: true
I20250625 14:02:01.485674 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6d4a606cc39f4c5991ebd75363e1b078" } modify_external_catalogs: true
W20250625 14:02:01.485941 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b87d17923ce49cda6bb7de761f700d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.486932 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f5427083312e42a9b3320e8d5639dc1a" } modify_external_catalogs: true
I20250625 14:02:01.488698 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 96fcc61e48e549618197d34346ea5b16
I20250625 14:02:01.489553 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 96fcc61e48e549618197d34346ea5b16 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.489724 12173 tablet_replica.cc:331] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.489850 12173 raft_consensus.cc:2241] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.489993 12173 pending_rounds.cc:70] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:01.490018 12173 pending_rounds.cc:77] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523055467151360 op_type: NO_OP noop_request { }
I20250625 14:02:01.490072 12173 raft_consensus.cc:2887] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:01.490120 12173 raft_consensus.cc:2270] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.490801 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 96fcc61e48e549618197d34346ea5b16 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.491012 12177 tablet_replica.cc:331] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.491158 12177 raft_consensus.cc:2241] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.491261 12177 raft_consensus.cc:2270] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.491636 12177 ts_tablet_manager.cc:1905] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.491838 12173 ts_tablet_manager.cc:1905] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.491880 12166 tablet_bootstrap.cc:492] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.493088 12166 tablet_bootstrap.cc:654] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.493924 12177 ts_tablet_manager.cc:1918] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.494007 12177 log.cc:1199] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/96fcc61e48e549618197d34346ea5b16
I20250625 14:02:01.494031 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_6599fe84caa14c35abca12303dad90fc [id=740dddd095854d55afb3091ebf06d72f]). Expected version 1 got 0
I20250625 14:02:01.494160 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_fd4614a0de7d438f82751d3ed54210cd [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 1 got 0
I20250625 14:02:01.494243 12177 ts_tablet_manager.cc:1939] T 96fcc61e48e549618197d34346ea5b16 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.494468 12173 ts_tablet_manager.cc:1918] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20250625 14:02:01.494495 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 837e98e4e48a465fa9c3e697ae34c9ea consensus state has no leader
I20250625 14:02:01.494541 12173 log.cc:1199] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/96fcc61e48e549618197d34346ea5b16
I20250625 14:02:01.494814 12173 ts_tablet_manager.cc:1939] T 96fcc61e48e549618197d34346ea5b16 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.495715 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 96fcc61e48e549618197d34346ea5b16 (table default.Table_469eddba721c44d599a1894bf7a95c2a [id=5c6cac0e4f4b453db57e34f39b8f0093]) successfully deleted
I20250625 14:02:01.498040 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 237ca3218ae84a0b8354f328b91dfab4
I20250625 14:02:01.499178 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 5479ccdc39ce43c2a2727334235541b5 (DEFAULT_TABLE table=default.Table_cedbc8ae8dab416789f47248c6ebfcbb [id=b79f84879db54e1ca2919c58cfcf8bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.499488 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5479ccdc39ce43c2a2727334235541b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.499446 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 1d2cf613b4404dbb89de199e089f0116 (DEFAULT_TABLE table=default.Table_75443e5e812b45d9bc5d267fc83bde83 [id=42b227ba030346b09b1e987c80ae0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.499711 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2cf613b4404dbb89de199e089f0116. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.499784 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 237ca3218ae84a0b8354f328b91dfab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.503525 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_fd4614a0de7d438f82751d3ed54210cd [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 1 got 0
I20250625 14:02:01.503734 11524 catalog_manager.cc:5582] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:01.503928 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]). Expected version 3 got 0
I20250625 14:02:01.504117 12024 tablet_service.cc:1468] Processing CreateTablet for tablet 357d05c539144e9c8bafe6819f8ee39b (DEFAULT_TABLE table=default.Table_40002fc3ebb64224b030b871c7a3dd5f [id=0b16c8212aad40b6bd5289f62521c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.504177 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 27a05814621446f0b40733de5ff51328 (DEFAULT_TABLE table=default.Table_5c451f1ba2f246549b649bf689a73ec1 [id=b0b734e1e1d04d9c8f633d5ecfbdc13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.504397 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 357d05c539144e9c8bafe6819f8ee39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.504514 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 4cab07f1176143ba8da576817132876d (DEFAULT_TABLE table=default.Table_322ff18a53304b238122781629c6a514 [id=0ad25317ea7a4a01b4088ec5a0d22cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.504562 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 611afe6d28214382a538791e33a5ed78 (DEFAULT_TABLE table=default.Table_9b0ab65cb6b34b5e842f0024f6a8302b [id=e4358ce6e208481fba4cea7f6d210dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.504712 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cab07f1176143ba8da576817132876d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.504899 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 883e83d188fe4a13b36f780842e3bc4a (DEFAULT_TABLE table=default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.505096 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883e83d188fe4a13b36f780842e3bc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.506548 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 031ec1b9c6b74d3fa090906e1eef4fe2 (DEFAULT_TABLE table=default.Table_3190c312bb85480f8c10e182119fb4c0 [id=9c166345a8be4902b58f16c940fce76a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.506752 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031ec1b9c6b74d3fa090906e1eef4fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.506726 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 69561949c8b04a75a0bbdde9e9656e37 (DEFAULT_TABLE table=default.Table_162814545c1c4cfcaefb1d6723cbcf59 [id=4f8c4958492f4c77a670fbee18ad314d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.506904 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69561949c8b04a75a0bbdde9e9656e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.507326 12019 tablet_service.cc:1468] Processing CreateTablet for tablet d788fd11e91d45e085974be939929e8c (DEFAULT_TABLE table=default.Table_bf09753866574adb9eca228ba4c15f16 [id=b242244c98cc465bbe5399da4c4d99e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.507529 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d788fd11e91d45e085974be939929e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.509668 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 0f3c5e4b77724849ab5703f84775e370 (DEFAULT_TABLE table=default.Table_a541ff958c5d40e5a671a6be42dcbf41 [id=dcc23ee45c6b402cac6aa806892c466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.509907 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3c5e4b77724849ab5703f84775e370. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.510397 12172 tablet_bootstrap.cc:492] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.510489 12172 ts_tablet_manager.cc:1397] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.000s
I20250625 14:02:01.511018 12172 raft_consensus.cc:357] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.511139 12172 raft_consensus.cc:383] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.511173 12172 raft_consensus.cc:738] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.511296 12172 consensus_queue.cc:260] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.511445 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 4cab07f1176143ba8da576817132876d (DEFAULT_TABLE table=default.Table_322ff18a53304b238122781629c6a514 [id=0ad25317ea7a4a01b4088ec5a0d22cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.511487 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 883e83d188fe4a13b36f780842e3bc4a (DEFAULT_TABLE table=default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.511304 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 611afe6d28214382a538791e33a5ed78 (DEFAULT_TABLE table=default.Table_9b0ab65cb6b34b5e842f0024f6a8302b [id=e4358ce6e208481fba4cea7f6d210dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.511727 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883e83d188fe4a13b36f780842e3bc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.511778 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 1d2cf613b4404dbb89de199e089f0116 (DEFAULT_TABLE table=default.Table_75443e5e812b45d9bc5d267fc83bde83 [id=42b227ba030346b09b1e987c80ae0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.511847 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611afe6d28214382a538791e33a5ed78. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.511930 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611afe6d28214382a538791e33a5ed78. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.512010 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2cf613b4404dbb89de199e089f0116. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.512072 11758 tablet_service.cc:1468] Processing CreateTablet for tablet d788fd11e91d45e085974be939929e8c (DEFAULT_TABLE table=default.Table_bf09753866574adb9eca228ba4c15f16 [id=b242244c98cc465bbe5399da4c4d99e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.512288 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d788fd11e91d45e085974be939929e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.513871 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a05814621446f0b40733de5ff51328. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.514063 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 237ca3218ae84a0b8354f328b91dfab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.514230 12177 tablet_replica.cc:331] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.514381 12177 raft_consensus.cc:2241] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.514415 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cab07f1176143ba8da576817132876d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.514452 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 01df2302397e41f882ea3578fe6351b1 (DEFAULT_TABLE table=default.Table_34dc11525e5c4255b2b2d4d9642807fd [id=4ae1e98e6c0b4f13a25ffa6d19d0d395]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.514580 12177 raft_consensus.cc:2270] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.514649 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df2302397e41f882ea3578fe6351b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.514993 12177 ts_tablet_manager.cc:1905] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.516793 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 0f3c5e4b77724849ab5703f84775e370 (DEFAULT_TABLE table=default.Table_a541ff958c5d40e5a671a6be42dcbf41 [id=dcc23ee45c6b402cac6aa806892c466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.517081 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3c5e4b77724849ab5703f84775e370. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.517180 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 96fcc61e48e549618197d34346ea5b16 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.517571 13121 raft_consensus.cc:491] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.517517 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 1d2cf613b4404dbb89de199e089f0116 (DEFAULT_TABLE table=default.Table_75443e5e812b45d9bc5d267fc83bde83 [id=42b227ba030346b09b1e987c80ae0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.517648 13121 raft_consensus.cc:513] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.517803 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2cf613b4404dbb89de199e089f0116. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.517952 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 357d05c539144e9c8bafe6819f8ee39b (DEFAULT_TABLE table=default.Table_40002fc3ebb64224b030b871c7a3dd5f [id=0b16c8212aad40b6bd5289f62521c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.518041 13121 leader_election.cc:290] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.518215 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 357d05c539144e9c8bafe6819f8ee39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.519209 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 27a05814621446f0b40733de5ff51328 (DEFAULT_TABLE table=default.Table_5c451f1ba2f246549b649bf689a73ec1 [id=b0b734e1e1d04d9c8f633d5ecfbdc13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.519433 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a05814621446f0b40733de5ff51328. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.520093 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 237ca3218ae84a0b8354f328b91dfab4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.520344 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 5479ccdc39ce43c2a2727334235541b5 (DEFAULT_TABLE table=default.Table_cedbc8ae8dab416789f47248c6ebfcbb [id=b79f84879db54e1ca2919c58cfcf8bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.520578 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5479ccdc39ce43c2a2727334235541b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.520529 11889 tablet_service.cc:1468] Processing CreateTablet for tablet 031ec1b9c6b74d3fa090906e1eef4fe2 (DEFAULT_TABLE table=default.Table_3190c312bb85480f8c10e182119fb4c0 [id=9c166345a8be4902b58f16c940fce76a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.520754 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031ec1b9c6b74d3fa090906e1eef4fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.520924 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 01df2302397e41f882ea3578fe6351b1 (DEFAULT_TABLE table=default.Table_34dc11525e5c4255b2b2d4d9642807fd [id=4ae1e98e6c0b4f13a25ffa6d19d0d395]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.521126 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df2302397e41f882ea3578fe6351b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.521204 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 96fcc61e48e549618197d34346ea5b16 (table default.Table_469eddba721c44d599a1894bf7a95c2a [id=5c6cac0e4f4b453db57e34f39b8f0093]) successfully deleted
I20250625 14:02:01.521536 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 69561949c8b04a75a0bbdde9e9656e37 (DEFAULT_TABLE table=default.Table_162814545c1c4cfcaefb1d6723cbcf59 [id=4f8c4958492f4c77a670fbee18ad314d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.521761 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69561949c8b04a75a0bbdde9e9656e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.522271 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 01df2302397e41f882ea3578fe6351b1 (DEFAULT_TABLE table=default.Table_34dc11525e5c4255b2b2d4d9642807fd [id=4ae1e98e6c0b4f13a25ffa6d19d0d395]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.522541 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df2302397e41f882ea3578fe6351b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.522536 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 357d05c539144e9c8bafe6819f8ee39b (DEFAULT_TABLE table=default.Table_40002fc3ebb64224b030b871c7a3dd5f [id=0b16c8212aad40b6bd5289f62521c039]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.522734 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 357d05c539144e9c8bafe6819f8ee39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.523280 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 27a05814621446f0b40733de5ff51328 (DEFAULT_TABLE table=default.Table_5c451f1ba2f246549b649bf689a73ec1 [id=b0b734e1e1d04d9c8f633d5ecfbdc13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.523487 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a05814621446f0b40733de5ff51328. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:01.523490 11990 leader_election.cc:343] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: e15bd70671f8458db5b9e52423189eda
I20250625 14:02:01.525158 12175 tablet_replica.cc:331] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.525310 12175 raft_consensus.cc:2241] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.525426 12175 raft_consensus.cc:2270] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.525718 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 611afe6d28214382a538791e33a5ed78 (DEFAULT_TABLE table=default.Table_9b0ab65cb6b34b5e842f0024f6a8302b [id=e4358ce6e208481fba4cea7f6d210dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.525830 12175 ts_tablet_manager.cc:1905] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:01.525902 11993 leader_election.cc:343] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: e15bd70671f8458db5b9e52423189eda
I20250625 14:02:01.525978 11993 leader_election.cc:304] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:01.526104 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 4cab07f1176143ba8da576817132876d (DEFAULT_TABLE table=default.Table_322ff18a53304b238122781629c6a514 [id=0ad25317ea7a4a01b4088ec5a0d22cac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.526360 13121 raft_consensus.cc:2747] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.526451 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cab07f1176143ba8da576817132876d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.526487 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 883e83d188fe4a13b36f780842e3bc4a (DEFAULT_TABLE table=default.Table_3d9670070fc6432ea2da685667349385 [id=ebe58dc4ba034934a52f2c3b9750db28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.526679 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883e83d188fe4a13b36f780842e3bc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.528657 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 69561949c8b04a75a0bbdde9e9656e37 (DEFAULT_TABLE table=default.Table_162814545c1c4cfcaefb1d6723cbcf59 [id=4f8c4958492f4c77a670fbee18ad314d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.528908 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69561949c8b04a75a0bbdde9e9656e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.528988 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 5479ccdc39ce43c2a2727334235541b5 (DEFAULT_TABLE table=default.Table_cedbc8ae8dab416789f47248c6ebfcbb [id=b79f84879db54e1ca2919c58cfcf8bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.529238 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5479ccdc39ce43c2a2727334235541b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.531181 11902 tablet_service.cc:1468] Processing CreateTablet for tablet d788fd11e91d45e085974be939929e8c (DEFAULT_TABLE table=default.Table_bf09753866574adb9eca228ba4c15f16 [id=b242244c98cc465bbe5399da4c4d99e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.531419 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d788fd11e91d45e085974be939929e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.511596 12172 ts_tablet_manager.cc:1428] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.534799 12172 tablet_bootstrap.cc:492] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.534749 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 0f3c5e4b77724849ab5703f84775e370 (DEFAULT_TABLE table=default.Table_a541ff958c5d40e5a671a6be42dcbf41 [id=dcc23ee45c6b402cac6aa806892c466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.534934 13121 raft_consensus.cc:491] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.535030 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3c5e4b77724849ab5703f84775e370. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.535037 13121 raft_consensus.cc:513] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.535477 13121 leader_election.cc:290] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.535705 12172 tablet_bootstrap.cc:654] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.537310 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611afe6d28214382a538791e33a5ed78. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.537521 12175 ts_tablet_manager.cc:1918] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.537592 12175 log.cc:1199] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/96fcc61e48e549618197d34346ea5b16
I20250625 14:02:01.538219 12175 ts_tablet_manager.cc:1939] T 96fcc61e48e549618197d34346ea5b16 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.538909 12175 tablet_replica.cc:331] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.539088 12175 raft_consensus.cc:2241] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 14:02:01.539146 11990 leader_election.cc:343] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 801fae4d88114ff29eacde80365b84a0
I20250625 14:02:01.539199 12175 raft_consensus.cc:2270] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.539595 12175 ts_tablet_manager.cc:1905] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.517088 12177 ts_tablet_manager.cc:1918] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.541787 12177 log.cc:1199] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/237ca3218ae84a0b8354f328b91dfab4
I20250625 14:02:01.541931 12175 ts_tablet_manager.cc:1918] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.541998 12175 log.cc:1199] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/237ca3218ae84a0b8354f328b91dfab4
I20250625 14:02:01.542068 12177 ts_tablet_manager.cc:1939] T 237ca3218ae84a0b8354f328b91dfab4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.542593 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 031ec1b9c6b74d3fa090906e1eef4fe2 (DEFAULT_TABLE table=default.Table_3190c312bb85480f8c10e182119fb4c0 [id=9c166345a8be4902b58f16c940fce76a]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:01.542747 11993 leader_election.cc:343] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 801fae4d88114ff29eacde80365b84a0
I20250625 14:02:01.542832 11993 leader_election.cc:304] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:01.542898 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031ec1b9c6b74d3fa090906e1eef4fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.543094 13121 raft_consensus.cc:2747] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.545559 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 237ca3218ae84a0b8354f328b91dfab4 (table default.Table_6d4a606cc39f4c5991ebd75363e1b078 [id=1e61ba0bd36547af93e0c50f5b069faf]) successfully deleted
I20250625 14:02:01.546618 13335 raft_consensus.cc:491] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.546733 13335 raft_consensus.cc:513] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.547186 13335 leader_election.cc:290] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.547463 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3d9670070fc6432ea2da685667349385" } modify_external_catalogs: true
I20250625 14:02:01.548174 12173 tablet_replica.cc:331] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.548341 12173 raft_consensus.cc:2241] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.548471 12173 raft_consensus.cc:2270] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.549233 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet cb66618516b44f27a715ddfbafde480d from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.549611 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1af86cdb13f427ea61ee8ad56ca3f26" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.549701 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1af86cdb13f427ea61ee8ad56ca3f26" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.549770 12175 ts_tablet_manager.cc:1939] T 237ca3218ae84a0b8354f328b91dfab4 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:02:01.550383 11717 leader_election.cc:343] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.551112 12166 tablet_bootstrap.cc:492] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.551229 12166 ts_tablet_manager.cc:1397] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
W20250625 14:02:01.551056 11717 leader_election.cc:343] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.551581 11717 leader_election.cc:304] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.551934 13335 raft_consensus.cc:2747] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.551872 12166 raft_consensus.cc:357] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.551995 12166 raft_consensus.cc:383] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.552028 12166 raft_consensus.cc:738] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.552178 12166 consensus_queue.cc:260] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.552474 12166 ts_tablet_manager.cc:1428] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.554006 12166 tablet_bootstrap.cc:492] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.555298 12166 tablet_bootstrap.cc:654] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.558385 12172 tablet_bootstrap.cc:492] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.558501 12172 ts_tablet_manager.cc:1397] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20250625 14:02:01.559019 12172 raft_consensus.cc:357] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.559145 12172 raft_consensus.cc:383] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.559190 12172 raft_consensus.cc:738] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.559330 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7a4c8610a88347b4ad024e8f3ccc2bdf
I20250625 14:02:01.559319 12172 consensus_queue.cc:260] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.559638 12172 ts_tablet_manager.cc:1428] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.559846 12172 tablet_bootstrap.cc:492] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.561013 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3d9670070fc6432ea2da685667349385" } modify_external_catalogs: true
I20250625 14:02:01.561678 12172 tablet_bootstrap.cc:654] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.562688 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 4fd2ee633d464f7c8be1f06da7be0c70 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.549247 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 96fcc61e48e549618197d34346ea5b16 (table default.Table_469eddba721c44d599a1894bf7a95c2a [id=5c6cac0e4f4b453db57e34f39b8f0093]) successfully deleted
I20250625 14:02:01.563264 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 237ca3218ae84a0b8354f328b91dfab4 (table default.Table_6d4a606cc39f4c5991ebd75363e1b078 [id=1e61ba0bd36547af93e0c50f5b069faf]) successfully deleted
I20250625 14:02:01.563458 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:01.563951 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a4c8610a88347b4ad024e8f3ccc2bdf already in progress: creating tablet
I20250625 14:02:01.564241 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.564460 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_551f8133109341f7a7045c081156ed57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.564590 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_39dbe13f14dd4baa92a5256ab572973a" } new_table_name: "default.Table_6ddf39e5d36e4f2dbae8115326df5d33" modify_external_catalogs: true
W20250625 14:02:01.564898 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_551f8133109341f7a7045c081156ed57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.566370 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.566507 12173 ts_tablet_manager.cc:1905] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.567077 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1028fee60eff416cb36b22bb6a320403"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.567426 12166 tablet_bootstrap.cc:492] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
W20250625 14:02:01.567461 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1028fee60eff416cb36b22bb6a320403 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.567516 12166 ts_tablet_manager.cc:1397] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:01.568277 12166 raft_consensus.cc:357] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.568390 12166 raft_consensus.cc:383] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.568420 12166 raft_consensus.cc:738] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.568625 12166 consensus_queue.cc:260] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.569303 12173 ts_tablet_manager.cc:1918] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.569371 12173 log.cc:1199] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/237ca3218ae84a0b8354f328b91dfab4
I20250625 14:02:01.568635 12265 raft_consensus.cc:491] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.569567 12265 raft_consensus.cc:513] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.569617 12173 ts_tablet_manager.cc:1939] T 237ca3218ae84a0b8354f328b91dfab4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.569906 12265 leader_election.cc:290] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.570380 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fae1eddf1156499aa346502f7a200125" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.570510 12042 raft_consensus.cc:2466] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:01.570644 12166 ts_tablet_manager.cc:1428] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20250625 14:02:01.570695 11858 leader_election.cc:343] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: fae1eddf1156499aa346502f7a200125
I20250625 14:02:01.570863 12166 tablet_bootstrap.cc:492] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.571095 11855 leader_election.cc:304] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5
I20250625 14:02:01.571338 12265 raft_consensus.cc:2802] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.571393 12265 raft_consensus.cc:491] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.571429 12265 raft_consensus.cc:3058] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.571983 12166 tablet_bootstrap.cc:654] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.572407 12265 raft_consensus.cc:513] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.572743 12265 leader_election.cc:290] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.573182 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fae1eddf1156499aa346502f7a200125" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:01.573323 12042 raft_consensus.cc:3058] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:01.573709 11858 leader_election.cc:343] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: fae1eddf1156499aa346502f7a200125
I20250625 14:02:01.574144 12042 raft_consensus.cc:2466] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:01.574528 11855 leader_election.cc:304] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5
I20250625 14:02:01.574788 12265 raft_consensus.cc:2802] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.574879 12265 raft_consensus.cc:695] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:01.575008 12265 consensus_queue.cc:237] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.576205 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 237ca3218ae84a0b8354f328b91dfab4 (table default.Table_6d4a606cc39f4c5991ebd75363e1b078 [id=1e61ba0bd36547af93e0c50f5b069faf]) successfully deleted
W20250625 14:02:01.576396 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a4c8610a88347b4ad024e8f3ccc2bdf already in progress: creating tablet
I20250625 14:02:01.577270 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet afdd722b50584e65a098028c71ee2f9d
I20250625 14:02:01.577864 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet afdd722b50584e65a098028c71ee2f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:01.578727 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet afdd722b50584e65a098028c71ee2f9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afdd722b50584e65a098028c71ee2f9d already in progress: creating tablet
I20250625 14:02:01.578841 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet afdd722b50584e65a098028c71ee2f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.578924 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet afdd722b50584e65a098028c71ee2f9d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.578969 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_704a518792fb46d29f288f87261cfeb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.579335 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet afdd722b50584e65a098028c71ee2f9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afdd722b50584e65a098028c71ee2f9d already in progress: creating tablet
W20250625 14:02:01.579406 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_704a518792fb46d29f288f87261cfeb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.580269 12172 tablet_bootstrap.cc:492] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.580370 12172 ts_tablet_manager.cc:1397] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:02:01.580840 12172 raft_consensus.cc:357] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.580950 12172 raft_consensus.cc:383] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.580981 12172 raft_consensus.cc:738] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.581095 12172 consensus_queue.cc:260] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.582108 12167 tablet_bootstrap.cc:492] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.582217 12167 ts_tablet_manager.cc:1397] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.000s
I20250625 14:02:01.582724 12167 raft_consensus.cc:357] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.582852 12167 raft_consensus.cc:383] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.582888 12167 raft_consensus.cc:738] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.583009 12167 consensus_queue.cc:260] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.583285 12167 ts_tablet_manager.cc:1428] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.583458 12167 tablet_bootstrap.cc:492] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.584456 12167 tablet_bootstrap.cc:654] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.584560 12166 tablet_bootstrap.cc:492] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.584659 12166 ts_tablet_manager.cc:1397] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:01.585189 12166 raft_consensus.cc:357] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.585304 12166 raft_consensus.cc:383] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.585336 12166 raft_consensus.cc:738] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.585486 12166 consensus_queue.cc:260] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.585765 12166 ts_tablet_manager.cc:1428] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.585963 12166 tablet_bootstrap.cc:492] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.586203 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6db36f516279421ea24a5c80f1f505af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.586660 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6db36f516279421ea24a5c80f1f505af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.587045 12166 tablet_bootstrap.cc:654] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.587761 12172 ts_tablet_manager.cc:1428] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:02:01.592262 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 8cf54c149e444987817228977ac06c2d from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.593866 12167 tablet_bootstrap.cc:492] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.593963 12167 ts_tablet_manager.cc:1397] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:02:01.594507 12167 raft_consensus.cc:357] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.594604 12167 raft_consensus.cc:383] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.594630 12167 raft_consensus.cc:738] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.594738 12167 consensus_queue.cc:260] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.594990 12167 ts_tablet_manager.cc:1428] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.595151 12167 tablet_bootstrap.cc:492] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.596098 12167 tablet_bootstrap.cc:654] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.597074 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 883e83d188fe4a13b36f780842e3bc4a
I20250625 14:02:01.597769 13121 raft_consensus.cc:491] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.597847 13121 raft_consensus.cc:513] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.598160 13121 leader_election.cc:290] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:01.598464 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fddd9a629d984649ad92c8f4fe52e114 consensus state has no leader
I20250625 14:02:01.598592 12172 tablet_bootstrap.cc:492] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.599471 11530 catalog_manager.cc:5582] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:01.599608 12172 tablet_bootstrap.cc:654] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.599689 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_fd4614a0de7d438f82751d3ed54210cd [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 1 got 0
I20250625 14:02:01.599784 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]). Expected version 2 got 0
I20250625 14:02:01.602208 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "9c4ee7f813d04ce2a0359f5fe7d5d8ef" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:01.603042 11993 leader_election.cc:343] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 9c4ee7f813d04ce2a0359f5fe7d5d8ef
I20250625 14:02:01.603196 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 883e83d188fe4a13b36f780842e3bc4a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.603580 12172 tablet_bootstrap.cc:492] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.603672 12172 ts_tablet_manager.cc:1397] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:01.604130 12172 raft_consensus.cc:357] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.604244 12172 raft_consensus.cc:383] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.604282 12172 raft_consensus.cc:738] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
W20250625 14:02:01.604537 11990 leader_election.cc:343] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.604562 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7a4c8610a88347b4ad024e8f3ccc2bdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a4c8610a88347b4ad024e8f3ccc2bdf already in progress: creating tablet
I20250625 14:02:01.604616 11990 leader_election.cc:304] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:02:01.604728 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 883e83d188fe4a13b36f780842e3bc4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 883e83d188fe4a13b36f780842e3bc4a already in progress: creating tablet
I20250625 14:02:01.604884 13121 raft_consensus.cc:2747] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.605074 12172 consensus_queue.cc:260] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:01.605679 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet afdd722b50584e65a098028c71ee2f9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afdd722b50584e65a098028c71ee2f9d already in progress: creating tablet
I20250625 14:02:01.606037 12172 ts_tablet_manager.cc:1428] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:01.606298 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 883e83d188fe4a13b36f780842e3bc4a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.606566 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 883e83d188fe4a13b36f780842e3bc4a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.606757 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 44dd83c53b15400d94bb7b1a8784569a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.606907 12172 tablet_bootstrap.cc:492] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.606966 12175 tablet_replica.cc:331] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.607097 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet fae1eddf1156499aa346502f7a200125 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.607120 12175 raft_consensus.cc:2241] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250625 14:02:01.607146 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 883e83d188fe4a13b36f780842e3bc4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 883e83d188fe4a13b36f780842e3bc4a already in progress: creating tablet
I20250625 14:02:01.607235 12175 raft_consensus.cc:2270] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.607282 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 883e83d188fe4a13b36f780842e3bc4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 883e83d188fe4a13b36f780842e3bc4a already in progress: creating tablet
I20250625 14:02:01.607874 12175 ts_tablet_manager.cc:1905] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.608259 12172 tablet_bootstrap.cc:654] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.611027 12172 tablet_bootstrap.cc:492] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.611109 12172 ts_tablet_manager.cc:1397] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:02:01.611090 12175 ts_tablet_manager.cc:1918] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.611156 12175 log.cc:1199] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/44dd83c53b15400d94bb7b1a8784569a
I20250625 14:02:01.611361 12175 ts_tablet_manager.cc:1939] T 44dd83c53b15400d94bb7b1a8784569a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.611591 12172 raft_consensus.cc:357] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.611716 12172 raft_consensus.cc:383] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.611742 12172 raft_consensus.cc:738] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.611850 12172 consensus_queue.cc:260] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.611945 12175 tablet_replica.cc:331] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.612080 12172 ts_tablet_manager.cc:1428] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.612075 12175 raft_consensus.cc:2241] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.612249 12172 tablet_bootstrap.cc:492] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.612569 12175 pending_rounds.cc:70] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:02:01.612591 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 44dd83c53b15400d94bb7b1a8784569a (table default.Table_99ef32b961ed4799869db0bddb6346de [id=55cc2676447f4267a1b31fb53a7705dd]) successfully deleted
I20250625 14:02:01.612617 12175 pending_rounds.cc:77] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523057972609024 op_type: NO_OP noop_request { }
I20250625 14:02:01.612672 12175 raft_consensus.cc:2887] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:01.612722 12175 raft_consensus.cc:2270] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.613543 12175 ts_tablet_manager.cc:1905] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.614009 12172 tablet_bootstrap.cc:654] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.616492 12172 tablet_bootstrap.cc:492] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.616580 12172 ts_tablet_manager.cc:1397] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:02:01.616748 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 34138099f8b248dbb6465f6137e3942b from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.617043 12172 raft_consensus.cc:357] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.617144 12172 raft_consensus.cc:383] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.617170 12172 raft_consensus.cc:738] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.617300 12172 consensus_queue.cc:260] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.617555 12172 ts_tablet_manager.cc:1428] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.617719 12172 tablet_bootstrap.cc:492] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.618693 12172 tablet_bootstrap.cc:654] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.619218 12175 ts_tablet_manager.cc:1918] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.619359 12175 log.cc:1199] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/fae1eddf1156499aa346502f7a200125
I20250625 14:02:01.619699 12175 ts_tablet_manager.cc:1939] T fae1eddf1156499aa346502f7a200125 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.621920 12172 tablet_bootstrap.cc:492] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.622010 12172 ts_tablet_manager.cc:1397] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:02:01.622604 12172 raft_consensus.cc:357] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.622721 12172 raft_consensus.cc:383] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.622753 12172 raft_consensus.cc:738] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.622859 12172 consensus_queue.cc:260] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.623106 12172 ts_tablet_manager.cc:1428] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.623299 12172 tablet_bootstrap.cc:492] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.624328 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8cf54c149e444987817228977ac06c2d
I20250625 14:02:01.624660 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 8cf54c149e444987817228977ac06c2d deleted and replaced by tablet 9613ce45d22240bb971fcced3e58a60b
I20250625 14:02:01.625056 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 8cf54c149e444987817228977ac06c2d with delete_type TABLET_DATA_DELETED (replaced by tablet 9613ce45d22240bb971fcced3e58a60b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.625487 12172 tablet_bootstrap.cc:654] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:01.625501 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8cf54c149e444987817228977ac06c2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cf54c149e444987817228977ac06c2d already in progress: creating tablet
I20250625 14:02:01.626709 12172 tablet_bootstrap.cc:492] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.626811 12172 ts_tablet_manager.cc:1397] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20250625 14:02:01.627354 12172 raft_consensus.cc:357] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.627466 12172 raft_consensus.cc:383] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.627549 12172 raft_consensus.cc:738] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.627586 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 8cf54c149e444987817228977ac06c2d with delete_type TABLET_DATA_DELETED (replaced by tablet 9613ce45d22240bb971fcced3e58a60b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.627677 12172 consensus_queue.cc:260] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.628005 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 8cf54c149e444987817228977ac06c2d with delete_type TABLET_DATA_DELETED (replaced by tablet 9613ce45d22240bb971fcced3e58a60b) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.628273 13335 raft_consensus.cc:491] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.628342 13335 raft_consensus.cc:513] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.628630 13335 leader_election.cc:290] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.629122 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dff05950ded34f4bb554badc4ccd3e0f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:01.629479 11717 leader_election.cc:343] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.628630 12172 ts_tablet_manager.cc:1428] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:02:01.629989 12172 tablet_bootstrap.cc:492] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.630033 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dff05950ded34f4bb554badc4ccd3e0f" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.630350 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet fae1eddf1156499aa346502f7a200125 (table default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]) successfully deleted
W20250625 14:02:01.630470 11717 leader_election.cc:343] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.630535 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8cf54c149e444987817228977ac06c2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cf54c149e444987817228977ac06c2d already in progress: creating tablet
I20250625 14:02:01.630542 11717 leader_election.cc:304] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.630733 13335 raft_consensus.cc:2747] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:01.630667 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8cf54c149e444987817228977ac06c2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cf54c149e444987817228977ac06c2d already in progress: creating tablet
I20250625 14:02:01.631083 12172 tablet_bootstrap.cc:654] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.631968 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4b1e6053c18e494c91d6de1708f61215" } new_table_name: "default.Table_0fa9ab1010504819ad26e3193c3b4614" modify_external_catalogs: true
I20250625 14:02:01.632192 12172 tablet_bootstrap.cc:492] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.632269 12172 ts_tablet_manager.cc:1397] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20250625 14:02:01.632829 12172 raft_consensus.cc:357] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.632973 12172 raft_consensus.cc:383] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.633018 12172 raft_consensus.cc:738] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.633206 12166 tablet_bootstrap.cc:492] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.633168 12172 consensus_queue.cc:260] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.633220 12167 tablet_bootstrap.cc:492] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.633299 12167 ts_tablet_manager.cc:1397] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20250625 14:02:01.633301 12166 ts_tablet_manager.cc:1397] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.002s
I20250625 14:02:01.633741 12166 raft_consensus.cc:357] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.633741 12167 raft_consensus.cc:357] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.633845 12167 raft_consensus.cc:383] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.633843 12166 raft_consensus.cc:383] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.633881 12167 raft_consensus.cc:738] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.633908 12166 raft_consensus.cc:738] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.634001 12167 consensus_queue.cc:260] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.634027 12166 consensus_queue.cc:260] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.633947 12172 ts_tablet_manager.cc:1428] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:01.634286 12166 ts_tablet_manager.cc:1428] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.634518 12166 tablet_bootstrap.cc:492] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.635484 12166 tablet_bootstrap.cc:654] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.635828 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_fd4614a0de7d438f82751d3ed54210cd [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 1 got 0
I20250625 14:02:01.636015 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 2 got 0
I20250625 14:02:01.636893 12167 ts_tablet_manager.cc:1428] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
W20250625 14:02:01.636982 11529 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 7b817bda69f44497a6787d1d649ef5e9 consensus state has no leader
I20250625 14:02:01.637118 12167 tablet_bootstrap.cc:492] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.637360 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet fee20f2812d34d188b7181e6da00f823 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.637465 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.637511 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet fa2ccf77288144e5b81513dede9d4302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.637625 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 67002721ac274619b435e8bf16fc149a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.637734 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet ccf9474414824e6c84c2e81c52bb802a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.638026 12167 tablet_bootstrap.cc:654] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.639197 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:56 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.639361 12175 tablet_replica.cc:331] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.639487 12175 raft_consensus.cc:2241] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.639587 12175 raft_consensus.cc:2270] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.640043 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet e9476529c1b7401683c02e146f54a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.640139 12175 ts_tablet_manager.cc:1905] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.640163 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.641297 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet fae1eddf1156499aa346502f7a200125 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.641633 12166 tablet_bootstrap.cc:492] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.641718 12166 ts_tablet_manager.cc:1397] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20250625 14:02:01.641705 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e56586f5cd745a397bf6ed1a63d070e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.641847 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.641937 12024 tablet_service.cc:1515] Processing DeleteTablet for tablet 801fae4d88114ff29eacde80365b84a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.642045 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet e15bd70671f8458db5b9e52423189eda with delete_type TABLET_DATA_DELETED (replaced by tablet 1d596792632e4e32be161450f46b4168) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.642234 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet fae1eddf1156499aa346502f7a200125 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.642259 12166 raft_consensus.cc:357] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.642405 12166 raft_consensus.cc:383] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.642397 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 44dd83c53b15400d94bb7b1a8784569a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.642441 12166 raft_consensus.cc:738] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.642572 12166 consensus_queue.cc:260] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.642616 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_798e019fc3a741d69e54f07c3fded18d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.642827 12166 ts_tablet_manager.cc:1428] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.642900 12175 ts_tablet_manager.cc:1918] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.642976 12175 log.cc:1199] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/2030a3a1aa3a4702b7a2b4eaddf3c4b4
I20250625 14:02:01.642971 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.643018 12166 tablet_bootstrap.cc:492] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:02:01.643096 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_798e019fc3a741d69e54f07c3fded18d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.643185 12175 ts_tablet_manager.cc:1939] T 2030a3a1aa3a4702b7a2b4eaddf3c4b4 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.643401 12173 tablet_replica.cc:331] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.643558 12173 raft_consensus.cc:2241] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.643673 12173 raft_consensus.cc:2270] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.644232 12166 tablet_bootstrap.cc:654] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.644228 12173 ts_tablet_manager.cc:1905] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.645421 12175 tablet_replica.cc:331] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.645581 12175 raft_consensus.cc:2241] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.645696 12175 raft_consensus.cc:2270] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.646369 12167 tablet_bootstrap.cc:492] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.646461 12167 ts_tablet_manager.cc:1397] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:02:01.646489 11422 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
/tmp/dist-test-taskc2VY_P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.190:38199
--webserver_interface=127.11.39.190
--webserver_port=38689
--builtin_ntp_servers=127.11.39.148:42445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250625 14:02:01.646636 12173 ts_tablet_manager.cc:1918] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.646703 12173 log.cc:1199] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/3e56586f5cd745a397bf6ed1a63d070e
I20250625 14:02:01.646904 12173 ts_tablet_manager.cc:1939] T 3e56586f5cd745a397bf6ed1a63d070e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.646967 12167 raft_consensus.cc:357] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.647070 12167 raft_consensus.cc:383] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.647101 12167 raft_consensus.cc:738] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.647218 12167 consensus_queue.cc:260] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.647531 12167 ts_tablet_manager.cc:1428] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.647711 12167 tablet_bootstrap.cc:492] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.648564 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8450608283364602aa9455be1d9e58fd" } new_table_name: "default.Table_d2a4eb7764fa443daa0ea76f615566f2" modify_external_catalogs: true
I20250625 14:02:01.648808 12167 tablet_bootstrap.cc:654] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.649971 12175 ts_tablet_manager.cc:1905] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.650542 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.650707 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.650825 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.651031 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c3df90d585fc468fb479f6c7fb76d6c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.651309 12173 tablet_replica.cc:331] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.651444 12173 raft_consensus.cc:2241] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.651537 12173 raft_consensus.cc:2270] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.651995 12173 ts_tablet_manager.cc:1905] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.652674 12175 ts_tablet_manager.cc:1918] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.652761 12175 log.cc:1199] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e9476529c1b7401683c02e146f54a228
I20250625 14:02:01.653038 12175 ts_tablet_manager.cc:1939] T e9476529c1b7401683c02e146f54a228 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.654361 12173 ts_tablet_manager.cc:1918] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.654439 12173 log.cc:1199] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b97c5c63a8184f07ad6e8054d056ff58
I20250625 14:02:01.654651 12173 ts_tablet_manager.cc:1939] T b97c5c63a8184f07ad6e8054d056ff58 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.654640 12175 tablet_replica.cc:331] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.654860 12175 raft_consensus.cc:2241] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.654987 12175 raft_consensus.cc:2270] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.649377 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 2030a3a1aa3a4702b7a2b4eaddf3c4b4 (table default.Table_e07ec41a73ce4df9ab09b63d87da79be [id=e6ec8721bee347c19b4724c249a20e2f]) successfully deleted
W20250625 14:02:01.655072 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3df90d585fc468fb479f6c7fb76d6c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.655455 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 3e56586f5cd745a397bf6ed1a63d070e (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
I20250625 14:02:01.655680 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e9476529c1b7401683c02e146f54a228 (table default.Table_fd6351d08daa4564ba49cf00d72ecd56 [id=ebc9dc830f034c5682988e810c4eb9d3]) successfully deleted
I20250625 14:02:01.656210 12173 tablet_replica.cc:331] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.656270 12175 ts_tablet_manager.cc:1905] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.656363 12173 raft_consensus.cc:2241] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.656473 12173 raft_consensus.cc:2270] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.656900 12173 ts_tablet_manager.cc:1905] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.657572 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
I20250625 14:02:01.659076 12173 ts_tablet_manager.cc:1918] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.659152 12173 log.cc:1199] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/801fae4d88114ff29eacde80365b84a0
I20250625 14:02:01.659353 12173 ts_tablet_manager.cc:1939] T 801fae4d88114ff29eacde80365b84a0 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.659970 12173 tablet_replica.cc:331] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.660099 12173 raft_consensus.cc:2241] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.660197 12173 raft_consensus.cc:2270] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.660638 12175 ts_tablet_manager.cc:1918] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.660722 12173 ts_tablet_manager.cc:1905] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.660749 12175 log.cc:1199] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/3e56586f5cd745a397bf6ed1a63d070e
I20250625 14:02:01.660884 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b97c5c63a8184f07ad6e8054d056ff58 (table default.Table_bd047e00bc2045538f5a1a59bb15519f [id=afb45b5ae6fd44d79aeffec0dfa629c9]) successfully deleted
I20250625 14:02:01.661043 12175 ts_tablet_manager.cc:1939] T 3e56586f5cd745a397bf6ed1a63d070e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.661041 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 801fae4d88114ff29eacde80365b84a0 (table default.Table_99e3b9f63eb947ed8424df6c7a25de5e [id=c1cfd4563a0043058570d3ce22551316]) successfully deleted
I20250625 14:02:01.661343 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 with delete_type TABLET_DATA_DELETED (replaced by tablet cdbebbb725564dc98c30ce4bbd3af8db) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.661841 12175 tablet_replica.cc:331] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.662024 12175 raft_consensus.cc:2241] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.662165 12175 raft_consensus.cc:2270] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.662175 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 3e56586f5cd745a397bf6ed1a63d070e (table default.Table_6d4b84f13d9e48689d2869134361da04 [id=e7c4295c0e4b4f3bad40b4d458861960]) successfully deleted
I20250625 14:02:01.662528 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ebec65b7f6a475ab01359aab392d1cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.662794 12175 ts_tablet_manager.cc:1905] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.663050 12173 ts_tablet_manager.cc:1918] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.663132 12173 log.cc:1199] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e15bd70671f8458db5b9e52423189eda
I20250625 14:02:01.663357 12173 ts_tablet_manager.cc:1939] T e15bd70671f8458db5b9e52423189eda P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.663837 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bfc13b8c105c4d06a2bd6c6d773e2b42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.663954 12172 tablet_bootstrap.cc:492] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.663965 12173 tablet_replica.cc:331] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.664084 12173 raft_consensus.cc:2241] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.664170 12173 raft_consensus.cc:2270] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.664274 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfc13b8c105c4d06a2bd6c6d773e2b42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.664661 12173 ts_tablet_manager.cc:1905] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.665072 12172 tablet_bootstrap.cc:654] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:01.665999 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet fae1eddf1156499aa346502f7a200125 because the tablet was not found. No further retry: Not found: Tablet not found: fae1eddf1156499aa346502f7a200125
I20250625 14:02:01.666169 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e15bd70671f8458db5b9e52423189eda (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
I20250625 14:02:01.666215 12177 tablet_replica.cc:331] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.666381 12177 raft_consensus.cc:2241] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.666498 12177 raft_consensus.cc:2270] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.666781 12173 ts_tablet_manager.cc:1918] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.666859 12173 log.cc:1199] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/fae1eddf1156499aa346502f7a200125
I20250625 14:02:01.666987 12177 ts_tablet_manager.cc:1905] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.667748 12173 ts_tablet_manager.cc:1939] T fae1eddf1156499aa346502f7a200125 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.668427 12173 tablet_replica.cc:331] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.668434 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a2ff3964d6a24c2fa0471b420dba3238"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.668553 12173 raft_consensus.cc:2241] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:01.668547 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet fae1eddf1156499aa346502f7a200125 (table default.Table_aef7adfdbbe64ad0840a405b8bb4b3f5 [id=37ebe52c193f416b9bd9dc2377e3990d]) successfully deleted
I20250625 14:02:01.668704 12173 pending_rounds.cc:70] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:01.668733 12173 pending_rounds.cc:77] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523057441910784 op_type: NO_OP noop_request { }
I20250625 14:02:01.668785 12173 raft_consensus.cc:2887] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:01.668838 12173 raft_consensus.cc:2270] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.668862 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2ff3964d6a24c2fa0471b420dba3238 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.669546 12177 ts_tablet_manager.cc:1918] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.669617 12177 log.cc:1199] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/fee20f2812d34d188b7181e6da00f823
I20250625 14:02:01.669672 12173 ts_tablet_manager.cc:1905] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.669827 12177 ts_tablet_manager.cc:1939] T fee20f2812d34d188b7181e6da00f823 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.670640 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b14fc3a4b7354d878201d3685b0eb531"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.671032 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b14fc3a4b7354d878201d3685b0eb531 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.672369 12173 ts_tablet_manager.cc:1918] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:01.672464 12173 log.cc:1199] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/44dd83c53b15400d94bb7b1a8784569a
I20250625 14:02:01.672719 12173 ts_tablet_manager.cc:1939] T 44dd83c53b15400d94bb7b1a8784569a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.673105 12177 tablet_replica.cc:331] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.673334 12177 raft_consensus.cc:2241] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.673372 12173 tablet_replica.cc:331] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.673516 12173 raft_consensus.cc:2241] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.673513 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet fee20f2812d34d188b7181e6da00f823 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
I20250625 14:02:01.673532 12177 raft_consensus.cc:2270] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.673633 12173 raft_consensus.cc:2270] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.674221 12173 ts_tablet_manager.cc:1905] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.674239 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3190c312bb85480f8c10e182119fb4c0" } new_table_name: "default.Table_08cfffe10d4f4a7bbad590562e90eddd" modify_external_catalogs: true
I20250625 14:02:01.674439 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 44dd83c53b15400d94bb7b1a8784569a (table default.Table_99ef32b961ed4799869db0bddb6346de [id=55cc2676447f4267a1b31fb53a7705dd]) successfully deleted
I20250625 14:02:01.675364 12177 ts_tablet_manager.cc:1905] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.676690 12173 ts_tablet_manager.cc:1918] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.676779 12173 log.cc:1199] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8ebec65b7f6a475ab01359aab392d1cf
I20250625 14:02:01.677021 12173 ts_tablet_manager.cc:1939] T 8ebec65b7f6a475ab01359aab392d1cf P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.677305 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 34138099f8b248dbb6465f6137e3942b
I20250625 14:02:01.677620 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 34138099f8b248dbb6465f6137e3942b deleted and replaced by tablet a3589745418e44adab10778ed1b0838a
I20250625 14:02:01.677649 12173 tablet_replica.cc:331] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.677784 12173 raft_consensus.cc:2241] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.677892 12173 raft_consensus.cc:2270] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.678092 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b08135db764c4eb286d5f67ccba94ed5 consensus state has no leader
I20250625 14:02:01.678400 12173 ts_tablet_manager.cc:1905] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.678496 12177 ts_tablet_manager.cc:1918] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.678591 12177 log.cc:1199] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/043622be53ec4198b6c9b25a0404c0d2
I20250625 14:02:01.678853 12177 ts_tablet_manager.cc:1939] T 043622be53ec4198b6c9b25a0404c0d2 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.680676 12173 ts_tablet_manager.cc:1918] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.680747 12173 log.cc:1199] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9c4ee7f813d04ce2a0359f5fe7d5d8ef
I20250625 14:02:01.681002 12173 ts_tablet_manager.cc:1939] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.681625 12173 tablet_replica.cc:331] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.681717 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 34138099f8b248dbb6465f6137e3942b with delete_type TABLET_DATA_DELETED (replaced by tablet a3589745418e44adab10778ed1b0838a) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.681762 12173 raft_consensus.cc:2241] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.681788 12175 ts_tablet_manager.cc:1918] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.681866 12175 log.cc:1199] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/34ef10dc2de8460c90dc0cf3bb5fe234
I20250625 14:02:01.681890 12173 raft_consensus.cc:2270] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.682147 12175 ts_tablet_manager.cc:1939] T 34ef10dc2de8460c90dc0cf3bb5fe234 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.682192 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 34138099f8b248dbb6465f6137e3942b with delete_type TABLET_DATA_DELETED (replaced by tablet a3589745418e44adab10778ed1b0838a) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.682480 12173 ts_tablet_manager.cc:1905] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.683089 12175 tablet_replica.cc:331] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.683267 12175 raft_consensus.cc:2241] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.683387 12175 raft_consensus.cc:2270] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.683847 12175 ts_tablet_manager.cc:1905] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.685060 12173 ts_tablet_manager.cc:1918] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.685075 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8ebec65b7f6a475ab01359aab392d1cf (table default.Table_de10db8210b34241a0e63aaa8702fb67 [id=e183bb9e565845b7aab4a61a32ccb7ed]) successfully deleted
I20250625 14:02:01.685148 12173 log.cc:1199] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/043622be53ec4198b6c9b25a0404c0d2
I20250625 14:02:01.685233 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef (table default.Table_06d43b44b02e415d81733ddc00e3d18b [id=d2c5d6b97745451cabb9a44a25c19b80]) successfully deleted
I20250625 14:02:01.685379 12173 ts_tablet_manager.cc:1939] T 043622be53ec4198b6c9b25a0404c0d2 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.686024 12173 tablet_replica.cc:331] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.686168 12173 raft_consensus.cc:2241] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.686266 12173 raft_consensus.cc:2270] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.687242 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b778a1b075794c0a86992066a14d5e11 consensus state has no leader
I20250625 14:02:01.687242 12175 ts_tablet_manager.cc:1918] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.687314 12175 log.cc:1199] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8ebec65b7f6a475ab01359aab392d1cf
I20250625 14:02:01.687531 12175 ts_tablet_manager.cc:1939] T 8ebec65b7f6a475ab01359aab392d1cf P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.687582 12173 ts_tablet_manager.cc:1905] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.688108 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 34ef10dc2de8460c90dc0cf3bb5fe234 (table default.Table_67c0588df36842488fcf1789bb9e0c88 [id=ca4d9657d22c41cb8df831d8a7470745]) successfully deleted
I20250625 14:02:01.688594 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 043622be53ec4198b6c9b25a0404c0d2 (table default.Table_5f98d59df4eb46318868cd55ce407c04 [id=dd7a0ca76f43401a945a0ed0fc973001]) successfully deleted
I20250625 14:02:01.688760 12600 consensus_queue.cc:1035] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.689664 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8ebec65b7f6a475ab01359aab392d1cf (table default.Table_de10db8210b34241a0e63aaa8702fb67 [id=e183bb9e565845b7aab4a61a32ccb7ed]) successfully deleted
W20250625 14:02:01.690115 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 34138099f8b248dbb6465f6137e3942b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34138099f8b248dbb6465f6137e3942b already in progress: creating tablet
I20250625 14:02:01.691407 12173 ts_tablet_manager.cc:1918] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.691488 12173 log.cc:1199] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8b1bf8f04694456e91687d89ceb39d56
I20250625 14:02:01.691701 12173 ts_tablet_manager.cc:1939] T 8b1bf8f04694456e91687d89ceb39d56 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:01.691738 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_43fdda0af50e4d8b987902ac23c1a825" } modify_external_catalogs: true
I20250625 14:02:01.691862 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_43fdda0af50e4d8b987902ac23c1a825" } modify_external_catalogs: true
I20250625 14:02:01.692612 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8b1bf8f04694456e91687d89ceb39d56 (table default.Table_e11dc32e96254d3489a8f9c7028feaca [id=9644f5266f174f748510e2c26e6b102f]) successfully deleted
W20250625 14:02:01.692795 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 34138099f8b248dbb6465f6137e3942b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34138099f8b248dbb6465f6137e3942b already in progress: creating tablet
I20250625 14:02:01.694633 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet 34138099f8b248dbb6465f6137e3942b with delete_type TABLET_DATA_DELETED (replaced by tablet a3589745418e44adab10778ed1b0838a) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.695206 12177 tablet_replica.cc:331] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.695366 12177 raft_consensus.cc:2241] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.695493 12177 raft_consensus.cc:2270] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.696115 12177 ts_tablet_manager.cc:1905] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.698985 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 043622be53ec4198b6c9b25a0404c0d2 (table default.Table_5f98d59df4eb46318868cd55ce407c04 [id=dd7a0ca76f43401a945a0ed0fc973001]) successfully deleted
I20250625 14:02:01.699661 12177 ts_tablet_manager.cc:1918] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.699734 12177 log.cc:1199] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/fa2ccf77288144e5b81513dede9d4302
I20250625 14:02:01.699924 12177 ts_tablet_manager.cc:1939] T fa2ccf77288144e5b81513dede9d4302 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.700685 12600 consensus_queue.cc:1035] T fce93c919a3446bb9999be958e08b500 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.700686 13121 consensus_queue.cc:1035] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.701252 12177 tablet_replica.cc:331] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.701349 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet fa2ccf77288144e5b81513dede9d4302 (table default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]) successfully deleted
I20250625 14:02:01.701432 12177 raft_consensus.cc:2241] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.701542 12177 raft_consensus.cc:2270] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.702581 12166 tablet_bootstrap.cc:492] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.702709 12166 ts_tablet_manager.cc:1397] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.001s
I20250625 14:02:01.703012 12167 tablet_bootstrap.cc:492] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.703102 12167 ts_tablet_manager.cc:1397] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.000s
I20250625 14:02:01.703248 12166 raft_consensus.cc:357] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.703361 12166 raft_consensus.cc:383] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.703395 12166 raft_consensus.cc:738] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.703521 12166 consensus_queue.cc:260] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.703559 12167 raft_consensus.cc:357] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.703660 12167 raft_consensus.cc:383] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.703691 12167 raft_consensus.cc:738] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.703814 12166 ts_tablet_manager.cc:1428] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.703804 12167 consensus_queue.cc:260] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.704000 12166 tablet_bootstrap.cc:492] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.704116 12167 ts_tablet_manager.cc:1428] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.704295 12167 tablet_bootstrap.cc:492] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.705068 12166 tablet_bootstrap.cc:654] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.705296 12167 tablet_bootstrap.cc:654] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.707934 12166 tablet_bootstrap.cc:492] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.708037 12166 ts_tablet_manager.cc:1397] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:01.708518 12166 raft_consensus.cc:357] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.708628 12166 raft_consensus.cc:383] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.708658 12166 raft_consensus.cc:738] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.708772 12166 consensus_queue.cc:260] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.709038 12166 ts_tablet_manager.cc:1428] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.709251 12166 tablet_bootstrap.cc:492] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.709263 11533 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a4ca3d5203a64d99912765b83af97c09 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]). Expected version 1 got 0
I20250625 14:02:01.710450 12166 tablet_bootstrap.cc:654] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.711524 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_56a5f91af59040738b1802382d68ed19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.711964 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56a5f91af59040738b1802382d68ed19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.712545 12177 ts_tablet_manager.cc:1905] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.712883 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fd4614a0de7d438f82751d3ed54210cd" } new_table_name: "default.Table_ee2a6a17b42241cca1e5333b97a12735" modify_external_catalogs: true
I20250625 14:02:01.713187 12167 tablet_bootstrap.cc:492] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.713276 12167 ts_tablet_manager.cc:1397] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:02:01.713478 12166 tablet_bootstrap.cc:492] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.713565 12166 ts_tablet_manager.cc:1397] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:02:01.713757 12167 raft_consensus.cc:357] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.713812 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ae3b18f018434e4a8b85ea267ae0b343" } modify_external_catalogs: true
I20250625 14:02:01.713871 12167 raft_consensus.cc:383] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.713903 12167 raft_consensus.cc:738] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.713922 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ae3b18f018434e4a8b85ea267ae0b343" } modify_external_catalogs: true
I20250625 14:02:01.714077 12167 consensus_queue.cc:260] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.714079 12166 raft_consensus.cc:357] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.714191 12166 raft_consensus.cc:383] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.714249 12166 raft_consensus.cc:738] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.714416 12167 ts_tablet_manager.cc:1428] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:01.714455 12166 consensus_queue.cc:260] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.714632 12167 tablet_bootstrap.cc:492] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.714743 12166 ts_tablet_manager.cc:1428] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.714919 12166 tablet_bootstrap.cc:492] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.715703 12167 tablet_bootstrap.cc:654] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.716068 12166 tablet_bootstrap.cc:654] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.717303 12166 tablet_bootstrap.cc:492] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.717406 12166 ts_tablet_manager.cc:1397] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:01.717823 12166 raft_consensus.cc:357] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.717924 12166 raft_consensus.cc:383] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.717953 12166 raft_consensus.cc:738] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.718055 12166 consensus_queue.cc:260] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.718237 12172 tablet_bootstrap.cc:492] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.718367 12172 ts_tablet_manager.cc:1397] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20250625 14:02:01.718398 12166 ts_tablet_manager.cc:1428] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.718567 12166 tablet_bootstrap.cc:492] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.718858 12172 raft_consensus.cc:357] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.718971 12172 raft_consensus.cc:383] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.719010 12172 raft_consensus.cc:738] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.719142 12172 consensus_queue.cc:260] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.719430 12172 ts_tablet_manager.cc:1428] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.719575 12166 tablet_bootstrap.cc:654] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.719604 12172 tablet_bootstrap.cc:492] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.720774 12172 tablet_bootstrap.cc:654] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.721040 12166 tablet_bootstrap.cc:492] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.721118 12166 ts_tablet_manager.cc:1397] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:01.721588 12166 raft_consensus.cc:357] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.721694 12166 raft_consensus.cc:383] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.721726 12166 raft_consensus.cc:738] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.721843 12166 consensus_queue.cc:260] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.722106 12166 ts_tablet_manager.cc:1428] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.722695 12166 tablet_bootstrap.cc:492] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.722751 12172 tablet_bootstrap.cc:492] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.722827 12172 ts_tablet_manager.cc:1397] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:01.723240 12172 raft_consensus.cc:357] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.723336 12172 raft_consensus.cc:383] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.723366 12172 raft_consensus.cc:738] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.723481 12172 consensus_queue.cc:260] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.723716 12166 tablet_bootstrap.cc:654] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.723730 12172 ts_tablet_manager.cc:1428] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.723896 12172 tablet_bootstrap.cc:492] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.724869 12172 tablet_bootstrap.cc:654] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.724997 12166 tablet_bootstrap.cc:492] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.725069 12166 ts_tablet_manager.cc:1397] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:02:01.725539 12166 raft_consensus.cc:357] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.725638 12166 raft_consensus.cc:383] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.725672 12166 raft_consensus.cc:738] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.725790 12166 consensus_queue.cc:260] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.726126 12166 ts_tablet_manager.cc:1428] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.726325 12166 tablet_bootstrap.cc:492] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.728138 12167 tablet_bootstrap.cc:492] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.728261 12167 ts_tablet_manager.cc:1397] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:01.728291 13335 raft_consensus.cc:491] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.728420 12166 tablet_bootstrap.cc:654] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.728374 13335 raft_consensus.cc:513] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.728762 13335 leader_election.cc:290] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.728931 12167 raft_consensus.cc:357] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.729067 12167 raft_consensus.cc:383] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.729224 12167 raft_consensus.cc:738] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.729369 12167 consensus_queue.cc:260] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.729672 12167 ts_tablet_manager.cc:1428] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.729854 12167 tablet_bootstrap.cc:492] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.730213 12177 ts_tablet_manager.cc:1918] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.730286 12177 log.cc:1199] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/67002721ac274619b435e8bf16fc149a
I20250625 14:02:01.730738 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4a906afbc504981942d57221742e822" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.730898 12167 tablet_bootstrap.cc:654] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:01.731568 11717 leader_election.cc:343] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.731791 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4a906afbc504981942d57221742e822" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:01.732997 11717 leader_election.cc:343] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.733075 11717 leader_election.cc:304] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.733196 13335 raft_consensus.cc:2747] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:01.734164 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 031ec1b9c6b74d3fa090906e1eef4fe2 consensus state has no leader
I20250625 14:02:01.734347 11784 raft_consensus.cc:3058] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.735352 11784 raft_consensus.cc:1273] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:01.735787 12558 consensus_queue.cc:1035] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.736388 12042 raft_consensus.cc:1273] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:01.737699 12600 consensus_queue.cc:1035] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.738240 13121 consensus_queue.cc:1035] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.741869 12177 ts_tablet_manager.cc:1939] T 67002721ac274619b435e8bf16fc149a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.742965 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 67002721ac274619b435e8bf16fc149a (table default.Table_f41c7ed5d5c64d7196b15168dc43ccab [id=41cea1d0aade416ca6b75cbb14127245]) successfully deleted
I20250625 14:02:01.743503 13335 raft_consensus.cc:491] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.743593 13335 raft_consensus.cc:513] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.743925 13335 leader_election.cc:290] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.745980 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7b817bda69f44497a6787d1d649ef5e9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.746119 11918 raft_consensus.cc:2466] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:01.746511 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7b817bda69f44497a6787d1d649ef5e9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.746636 12042 raft_consensus.cc:2466] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:01.746897 11717 leader_election.cc:304] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.747601 13335 raft_consensus.cc:2802] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.747682 13335 raft_consensus.cc:491] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.747723 13335 raft_consensus.cc:3058] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.748437 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 2 got 0
I20250625 14:02:01.748896 13335 raft_consensus.cc:513] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.749009 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 2 got 0
I20250625 14:02:01.749312 13335 leader_election.cc:290] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.750829 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.751022 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 8b1bf8f04694456e91687d89ceb39d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.751185 12175 tablet_replica.cc:331] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.751314 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7b817bda69f44497a6787d1d649ef5e9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:01.751448 11918 raft_consensus.cc:3058] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.752571 11918 raft_consensus.cc:2466] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:01.751319 12175 raft_consensus.cc:2241] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.752846 12175 raft_consensus.cc:2270] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.752971 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7b817bda69f44497a6787d1d649ef5e9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:01.753089 12042 raft_consensus.cc:3058] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.753427 12175 ts_tablet_manager.cc:1905] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.754251 12042 raft_consensus.cc:2466] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:01.754809 11717 leader_election.cc:304] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:01.755220 13335 raft_consensus.cc:2802] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.755185 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet c4a906afbc504981942d57221742e822 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.755306 13335 raft_consensus.cc:695] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:01.755456 13335 consensus_queue.cc:237] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.756139 12175 ts_tablet_manager.cc:1918] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.756219 12175 log.cc:1199] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9c4ee7f813d04ce2a0359f5fe7d5d8ef
I20250625 14:02:01.756172 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]). Expected version 3 got 0
I20250625 14:02:01.756330 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]). Expected version 2 got 0
I20250625 14:02:01.756438 12175 ts_tablet_manager.cc:1939] T 9c4ee7f813d04ce2a0359f5fe7d5d8ef P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.756443 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 0542b05b9bd5489995ff972289d4b9c5 (table default.Table_ee2a6a17b42241cca1e5333b97a12735 [id=ca9692e6bb984585b43995ad4eceda1c]). Expected version 2 got 0
I20250625 14:02:01.756527 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a4ca3d5203a64d99912765b83af97c09 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]). Expected version 1 got 0
I20250625 14:02:01.756537 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet a05b09a3225f45db841978b7b9b1fe51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.756806 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d596792632e4e32be161450f46b4168 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fd261d824c34864a7b15e4736254062) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.757045 12175 tablet_replica.cc:331] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.757073 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.757252 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet dff05950ded34f4bb554badc4ccd3e0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.757625 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 (DEFAULT_TABLE table=default.Table_7b87d17923ce49cda6bb7de761f700d3 [id=796b3c0ac87f4086a3d5f43e34d9b3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.758090 11763 tablet_service.cc:1468] Processing CreateTablet for tablet b533dc63b9a2428a8c5c925077c7f8e8 (DEFAULT_TABLE table=default.Table_f644045e842a4eb6a1aec944110d0606 [id=3af948ffff2d4e899bc3453673af580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.758482 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 779db196f4f7406abfa01ada7cad3c17 (DEFAULT_TABLE table=default.Table_c570db4043ad4896a62d6598f38d8660 [id=66e161f1e07244a7947be5549270b630]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.758523 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 17eee455777b4258a6d236c33ce10c0a (DEFAULT_TABLE table=default.Table_bf89472b824e4e6bb4262550d846a433 [id=99ff856062fa4e9cb593a33acdd18171]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.759397 13121 raft_consensus.cc:491] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.759501 13121 raft_consensus.cc:513] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.759577 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 043622be53ec4198b6c9b25a0404c0d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.759778 12175 raft_consensus.cc:2241] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.759871 13121 leader_election.cc:290] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.759910 12175 raft_consensus.cc:2270] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.760744 11897 tablet_service.cc:1468] Processing CreateTablet for tablet b533dc63b9a2428a8c5c925077c7f8e8 (DEFAULT_TABLE table=default.Table_f644045e842a4eb6a1aec944110d0606 [id=3af948ffff2d4e899bc3453673af580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.760838 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 17eee455777b4258a6d236c33ce10c0a (DEFAULT_TABLE table=default.Table_bf89472b824e4e6bb4262550d846a433 [id=99ff856062fa4e9cb593a33acdd18171]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.761049 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b533dc63b9a2428a8c5c925077c7f8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.761240 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 779db196f4f7406abfa01ada7cad3c17 (DEFAULT_TABLE table=default.Table_c570db4043ad4896a62d6598f38d8660 [id=66e161f1e07244a7947be5549270b630]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.761458 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779db196f4f7406abfa01ada7cad3c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.763516 11896 tablet_service.cc:1468] Processing CreateTablet for tablet c45a4ff4b20d4c5491fc45ab8c9e1016 (DEFAULT_TABLE table=default.Table_89944f8208c0482ba8fdb0d2ae89723f [id=6799622f293846f288d73c61bd3c50d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.763643 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet b97c5c63a8184f07ad6e8054d056ff58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.763756 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45a4ff4b20d4c5491fc45ab8c9e1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.763908 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 (DEFAULT_TABLE table=default.Table_7b87d17923ce49cda6bb7de761f700d3 [id=796b3c0ac87f4086a3d5f43e34d9b3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.764113 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147dbf21a3d242b9a8d7d1389c7cecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.765924 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 7bcc674dc5e448c0871e4efe0c9100b8 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.766119 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17eee455777b4258a6d236c33ce10c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.766111 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d" } modify_external_catalogs: true
I20250625 14:02:01.766237 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d" } modify_external_catalogs: true
I20250625 14:02:01.766849 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9c4ee7f813d04ce2a0359f5fe7d5d8ef (table default.Table_06d43b44b02e415d81733ddc00e3d18b [id=d2c5d6b97745451cabb9a44a25c19b80]) successfully deleted
I20250625 14:02:01.768326 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 75f6dce2462e47cca6a262eb3f871f06 (DEFAULT_TABLE table=default.Table_17050ff370b3439593f2c49820554432 [id=ec1d919fcf964316b35e1b92e345ca05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.768358 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 1a26eb678ade4b44993806e57644ec85 (DEFAULT_TABLE table=default.Table_27e4643611f149f5b8ce6162364e8467 [id=13221c382e5341deb081c6ae53d387bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.768478 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]). Expected version 3 got 0
I20250625 14:02:01.768376 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 600c108480fb45e18f8004aea752f233 (DEFAULT_TABLE table=default.Table_1ad8bc8df53b47e8b766b570a08fbd82 [id=3fec5f1e588e4a72bf7f0d045b441397]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.768610 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f6dce2462e47cca6a262eb3f871f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.768637 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a4ca3d5203a64d99912765b83af97c09 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]). Expected version 1 got 0
I20250625 14:02:01.769109 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 55e1b894360e492ebf5346418d796f23 (DEFAULT_TABLE table=default.Table_2d91a191018b49f0a5925c35ec583f86 [id=dd5621156d01451f88e2769d6a1d5aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.769893 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 (DEFAULT_TABLE table=default.Table_7b87d17923ce49cda6bb7de761f700d3 [id=796b3c0ac87f4086a3d5f43e34d9b3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.770071 12024 tablet_service.cc:1468] Processing CreateTablet for tablet c45a4ff4b20d4c5491fc45ab8c9e1016 (DEFAULT_TABLE table=default.Table_89944f8208c0482ba8fdb0d2ae89723f [id=6799622f293846f288d73c61bd3c50d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.770176 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147dbf21a3d242b9a8d7d1389c7cecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.770362 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45a4ff4b20d4c5491fc45ab8c9e1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.770615 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 779db196f4f7406abfa01ada7cad3c17 (DEFAULT_TABLE table=default.Table_c570db4043ad4896a62d6598f38d8660 [id=66e161f1e07244a7947be5549270b630]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.770825 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779db196f4f7406abfa01ada7cad3c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.771054 11891 tablet_service.cc:1468] Processing CreateTablet for tablet a6fc582219ca44c7b59a06e8f10eacbd (DEFAULT_TABLE table=default.Table_ebcb19662b564c958aca93f4b956a713 [id=eac24c3362c74394aa8c68ff64195c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.771378 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600c108480fb45e18f8004aea752f233. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.772059 12175 ts_tablet_manager.cc:1905] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.772686 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 1a26eb678ade4b44993806e57644ec85 (DEFAULT_TABLE table=default.Table_27e4643611f149f5b8ce6162364e8467 [id=13221c382e5341deb081c6ae53d387bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.772920 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26eb678ade4b44993806e57644ec85. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.773016 12028 tablet_service.cc:1468] Processing CreateTablet for tablet a6fc582219ca44c7b59a06e8f10eacbd (DEFAULT_TABLE table=default.Table_ebcb19662b564c958aca93f4b956a713 [id=eac24c3362c74394aa8c68ff64195c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.773285 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fc582219ca44c7b59a06e8f10eacbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.774230 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e1b894360e492ebf5346418d796f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.774591 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 55e1b894360e492ebf5346418d796f23 (DEFAULT_TABLE table=default.Table_2d91a191018b49f0a5925c35ec583f86 [id=dd5621156d01451f88e2769d6a1d5aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.774866 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e1b894360e492ebf5346418d796f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.775045 12175 ts_tablet_manager.cc:1918] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.775115 12175 log.cc:1199] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8b1bf8f04694456e91687d89ceb39d56
I20250625 14:02:01.775348 12175 ts_tablet_manager.cc:1939] T 8b1bf8f04694456e91687d89ceb39d56 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.775470 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 600c108480fb45e18f8004aea752f233 (DEFAULT_TABLE table=default.Table_1ad8bc8df53b47e8b766b570a08fbd82 [id=3fec5f1e588e4a72bf7f0d045b441397]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.775600 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fc582219ca44c7b59a06e8f10eacbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.775684 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600c108480fb45e18f8004aea752f233. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.777079 13334 raft_consensus.cc:491] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.777185 13334 raft_consensus.cc:513] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.777612 13334 leader_election.cc:290] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.777803 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 75f6dce2462e47cca6a262eb3f871f06 (DEFAULT_TABLE table=default.Table_17050ff370b3439593f2c49820554432 [id=ec1d919fcf964316b35e1b92e345ca05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.777905 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26eb678ade4b44993806e57644ec85. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.778036 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f6dce2462e47cca6a262eb3f871f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.778350 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00437d4f1cae420698471935887c2418" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:01.778396 11757 tablet_service.cc:1468] Processing CreateTablet for tablet c45a4ff4b20d4c5491fc45ab8c9e1016 (DEFAULT_TABLE table=default.Table_89944f8208c0482ba8fdb0d2ae89723f [id=6799622f293846f288d73c61bd3c50d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.778478 11783 raft_consensus.cc:2466] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:01.778765 11761 tablet_service.cc:1468] Processing CreateTablet for tablet a6fc582219ca44c7b59a06e8f10eacbd (DEFAULT_TABLE table=default.Table_ebcb19662b564c958aca93f4b956a713 [id=eac24c3362c74394aa8c68ff64195c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.779150 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 17eee455777b4258a6d236c33ce10c0a (DEFAULT_TABLE table=default.Table_bf89472b824e4e6bb4262550d846a433 [id=99ff856062fa4e9cb593a33acdd18171]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.779214 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 600c108480fb45e18f8004aea752f233 (DEFAULT_TABLE table=default.Table_1ad8bc8df53b47e8b766b570a08fbd82 [id=3fec5f1e588e4a72bf7f0d045b441397]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.779377 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17eee455777b4258a6d236c33ce10c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.780191 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce1b63ad2924626972ce7a42a4fdb60" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.780284 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00437d4f1cae420698471935887c2418" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.781484 12175 tablet_replica.cc:331] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.781635 12175 raft_consensus.cc:2241] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:02:01.781728 11990 leader_election.cc:343] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.781771 12175 raft_consensus.cc:2270] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.782238 12175 ts_tablet_manager.cc:1905] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.779565 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 55e1b894360e492ebf5346418d796f23 (DEFAULT_TABLE table=default.Table_2d91a191018b49f0a5925c35ec583f86 [id=dd5621156d01451f88e2769d6a1d5aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.779755 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 1a26eb678ade4b44993806e57644ec85 (DEFAULT_TABLE table=default.Table_27e4643611f149f5b8ce6162364e8467 [id=13221c382e5341deb081c6ae53d387bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.780002 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 75f6dce2462e47cca6a262eb3f871f06 (DEFAULT_TABLE table=default.Table_17050ff370b3439593f2c49820554432 [id=ec1d919fcf964316b35e1b92e345ca05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.782546 13334 raft_consensus.cc:491] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.782632 13334 raft_consensus.cc:513] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.782680 12021 tablet_service.cc:1468] Processing CreateTablet for tablet b533dc63b9a2428a8c5c925077c7f8e8 (DEFAULT_TABLE table=default.Table_f644045e842a4eb6a1aec944110d0606 [id=3af948ffff2d4e899bc3453673af580a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.782913 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b533dc63b9a2428a8c5c925077c7f8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.782995 13334 leader_election.cc:290] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:01.783397 11717 leader_election.cc:343] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.783879 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccf9474414824e6c84c2e81c52bb802a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.784150 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 34ef10dc2de8460c90dc0cf3bb5fe234 with delete_type TABLET_DATA_DELETED (replaced by tablet cdbebbb725564dc98c30ce4bbd3af8db) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.784300 13121 raft_consensus.cc:491] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.784380 13121 raft_consensus.cc:513] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.784303 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet ccf9474414824e6c84c2e81c52bb802a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.784745 13121 leader_election.cc:290] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.785322 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ccf9474414824e6c84c2e81c52bb802a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.785434 12042 raft_consensus.cc:2466] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:01.786105 11993 leader_election.cc:304] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:01.786167 12175 ts_tablet_manager.cc:1918] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.786244 12175 log.cc:1199] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/043622be53ec4198b6c9b25a0404c0d2
I20250625 14:02:01.786502 12175 ts_tablet_manager.cc:1939] T 043622be53ec4198b6c9b25a0404c0d2 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.787344 12175 tablet_replica.cc:331] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.787495 12175 raft_consensus.cc:2241] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.787607 12175 raft_consensus.cc:2270] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.787744 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce1b63ad2924626972ce7a42a4fdb60" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.788292 12175 ts_tablet_manager.cc:1905] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:01.788605 11520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.39.190:38199: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20250625 14:02:01.784751 12173 tablet_replica.cc:331] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.789703 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b533dc63b9a2428a8c5c925077c7f8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.789822 12173 raft_consensus.cc:2241] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.789942 12173 raft_consensus.cc:2270] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.790139 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779db196f4f7406abfa01ada7cad3c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.790503 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45a4ff4b20d4c5491fc45ab8c9e1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.791147 12175 ts_tablet_manager.cc:1918] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.791285 12175 log.cc:1199] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b97c5c63a8184f07ad6e8054d056ff58
I20250625 14:02:01.791548 12175 ts_tablet_manager.cc:1939] T b97c5c63a8184f07ad6e8054d056ff58 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:01.792191 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fc582219ca44c7b59a06e8f10eacbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.792351 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600c108480fb45e18f8004aea752f233. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.792459 13121 raft_consensus.cc:2802] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.792521 13121 raft_consensus.cc:491] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.792567 13121 raft_consensus.cc:3058] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.792780 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17eee455777b4258a6d236c33ce10c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.793031 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e1b894360e492ebf5346418d796f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.793569 13121 raft_consensus.cc:513] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.793996 13121 leader_election.cc:290] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.794937 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f6dce2462e47cca6a262eb3f871f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.795858 12177 tablet_replica.cc:331] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.796022 12177 raft_consensus.cc:2241] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.796130 12177 raft_consensus.cc:2270] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.797534 12177 ts_tablet_manager.cc:1905] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.797715 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a26eb678ade4b44993806e57644ec85. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.798138 12173 ts_tablet_manager.cc:1905] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.799510 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f3a4b3350e8e41d7836f31c9067e19c1" } modify_external_catalogs: true
I20250625 14:02:01.799664 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f3a4b3350e8e41d7836f31c9067e19c1" } modify_external_catalogs: true
I20250625 14:02:01.799964 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147dbf21a3d242b9a8d7d1389c7cecb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.800055 13535 tablet.cc:1722] T 0542b05b9bd5489995ff972289d4b9c5 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:01.800462 12173 ts_tablet_manager.cc:1918] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.800527 12173 log.cc:1199] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/34ef10dc2de8460c90dc0cf3bb5fe234
I20250625 14:02:01.800570 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d30fe5011e444ef3b51d36d17b6de02c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.800734 12173 ts_tablet_manager.cc:1939] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:01.800958 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d30fe5011e444ef3b51d36d17b6de02c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.801381 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_197e23eaa8114f5e87c9b4166f3f7995" } modify_external_catalogs: true
I20250625 14:02:01.801467 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_197e23eaa8114f5e87c9b4166f3f7995" } modify_external_catalogs: true
I20250625 14:02:01.801903 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_900afa9784ef451eaa2d34e700b4276b" } new_table_name: "default.Table_e3322169c32b4dd8af57a18e67156a86" modify_external_catalogs: true
I20250625 14:02:01.802134 13334 raft_consensus.cc:491] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.802211 13334 raft_consensus.cc:513] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.802589 13334 leader_election.cc:290] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.802650 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_89344a3eb7f34bc19ce8bc0bbda9de06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.802963 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89344a3eb7f34bc19ce8bc0bbda9de06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.804663 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b
I20250625 14:02:01.805119 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bcfd65365c914c8eada42500930f7185
I20250625 14:02:01.805173 12177 ts_tablet_manager.cc:1918] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.805277 12177 log.cc:1199] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/ccf9474414824e6c84c2e81c52bb802a
I20250625 14:02:01.805508 12177 ts_tablet_manager.cc:1939] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.805552 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8b1bf8f04694456e91687d89ceb39d56 (table default.Table_e11dc32e96254d3489a8f9c7028feaca [id=9644f5266f174f748510e2c26e6b102f]) successfully deleted
I20250625 14:02:01.805780 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 043622be53ec4198b6c9b25a0404c0d2 (table default.Table_5f98d59df4eb46318868cd55ce407c04 [id=dd7a0ca76f43401a945a0ed0fc973001]) successfully deleted
I20250625 14:02:01.805899 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b97c5c63a8184f07ad6e8054d056ff58 (table default.Table_bd047e00bc2045538f5a1a59bb15519f [id=afb45b5ae6fd44d79aeffec0dfa629c9]) successfully deleted
I20250625 14:02:01.806169 12177 tablet_replica.cc:331] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.806322 12177 raft_consensus.cc:2241] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.806418 12177 raft_consensus.cc:2270] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.806797 12173 tablet_replica.cc:331] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.806908 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a4ca3d5203a64d99912765b83af97c09 (table default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9]). Expected version 1 got 0
I20250625 14:02:01.806944 12177 ts_tablet_manager.cc:1905] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.806938 12173 raft_consensus.cc:2241] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.807008 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]). Expected version 3 got 0
I20250625 14:02:01.807058 12173 raft_consensus.cc:2270] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.807612 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.807747 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet bcfd65365c914c8eada42500930f7185 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.807904 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 34ef10dc2de8460c90dc0cf3bb5fe234 (table default.Table_67c0588df36842488fcf1789bb9e0c88 [id=ca4d9657d22c41cb8df831d8a7470745]) successfully deleted
I20250625 14:02:01.808046 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.808234 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet bcfd65365c914c8eada42500930f7185 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.808648 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00437d4f1cae420698471935887c2418" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:01.808892 12173 ts_tablet_manager.cc:1905] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.811161 12173 ts_tablet_manager.cc:1918] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.811242 12173 log.cc:1199] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/ccf9474414824e6c84c2e81c52bb802a
I20250625 14:02:01.811451 12173 ts_tablet_manager.cc:1939] T ccf9474414824e6c84c2e81c52bb802a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:01.811506 11990 leader_election.cc:343] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.811637 11990 leader_election.cc:343] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 34ef10dc2de8460c90dc0cf3bb5fe234
W20250625 14:02:01.811789 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b already in progress: creating tablet
W20250625 14:02:01.811975 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet bcfd65365c914c8eada42500930f7185 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcfd65365c914c8eada42500930f7185 already in progress: creating tablet
I20250625 14:02:01.813233 11525 catalog_manager.cc:5582] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:01.813439 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet ccf9474414824e6c84c2e81c52bb802a (table default.Table_14d8a31a1e8b4fa5a08673620892fc67 [id=a82f666dac0f4e8d829c04a3f68f18a0]) successfully deleted
I20250625 14:02:01.813485 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 2 got 0
I20250625 14:02:01.814401 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d596792632e4e32be161450f46b4168" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.814491 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet ccf9474414824e6c84c2e81c52bb802a (table default.Table_14d8a31a1e8b4fa5a08673620892fc67 [id=a82f666dac0f4e8d829c04a3f68f18a0]) successfully deleted
I20250625 14:02:01.814636 13334 raft_consensus.cc:491] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.814687 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d596792632e4e32be161450f46b4168" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.814725 13334 raft_consensus.cc:513] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.815104 13334 leader_election.cc:290] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:01.815399 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 34138099f8b248dbb6465f6137e3942b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34138099f8b248dbb6465f6137e3942b already in progress: creating tablet
I20250625 14:02:01.815408 12177 ts_tablet_manager.cc:1918] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.815477 12177 log.cc:1199] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c4a906afbc504981942d57221742e822
I20250625 14:02:01.815744 12177 ts_tablet_manager.cc:1939] T c4a906afbc504981942d57221742e822 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.815989 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.816023 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet bcfd65365c914c8eada42500930f7185 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.815996 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 6c8c667108694caab967bd91f74759b6 with delete_type TABLET_DATA_DELETED (replaced by tablet cbe2dcd1fb924dcba5c12aaa8e141435) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.816274 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:01.816377 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b already in progress: creating tablet
I20250625 14:02:01.816689 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet bb6f4cb8f8c9426bbbfcdd3b350e950e from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.816936 12177 tablet_replica.cc:331] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:02:01.816571 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet bcfd65365c914c8eada42500930f7185 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcfd65365c914c8eada42500930f7185 already in progress: creating tablet
I20250625 14:02:01.817199 12177 raft_consensus.cc:2241] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.817402 12177 raft_consensus.cc:2270] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.818058 13530 tablet.cc:1722] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:01.818598 12177 ts_tablet_manager.cc:1905] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.819183 11717 leader_election.cc:304] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:01.819226 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00437d4f1cae420698471935887c2418" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:01.819366 11783 raft_consensus.cc:3058] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:01.819291 11717 raft_consensus.cc:2684] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20250625 14:02:01.819583 11717 leader_election.cc:343] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.819653 11717 leader_election.cc:304] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.818120 13536 tablet.cc:1722] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:01.819779 13334 raft_consensus.cc:2747] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:01.820297 11717 leader_election.cc:343] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.820415 11717 leader_election.cc:343] T ccf9474414824e6c84c2e81c52bb802a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.820745 11717 leader_election.cc:343] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.821242 11717 leader_election.cc:304] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.821412 11783 raft_consensus.cc:2466] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:01.821457 12177 ts_tablet_manager.cc:1918] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.821494 13334 raft_consensus.cc:2747] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.821523 12177 log.cc:1199] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a05b09a3225f45db841978b7b9b1fe51
I20250625 14:02:01.822207 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c4a906afbc504981942d57221742e822 (table default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb [id=4f157d4de29f4618937525f9293e5049]) successfully deleted
W20250625 14:02:01.822579 11993 leader_election.cc:343] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 34ef10dc2de8460c90dc0cf3bb5fe234
I20250625 14:02:01.822722 11993 leader_election.cc:304] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:02:01.822853 11993 raft_consensus.cc:2684] T 34ef10dc2de8460c90dc0cf3bb5fe234 P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:01.822985 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "305009f335144f40b8a2dae61edb3801" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.823277 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "305009f335144f40b8a2dae61edb3801" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.823712 12177 ts_tablet_manager.cc:1939] T a05b09a3225f45db841978b7b9b1fe51 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.824564 12177 tablet_replica.cc:331] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.824759 12172 tablet_bootstrap.cc:492] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.824743 12177 raft_consensus.cc:2241] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.824860 12172 ts_tablet_manager.cc:1397] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.101s user 0.001s sys 0.000s
I20250625 14:02:01.825356 12172 raft_consensus.cc:357] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.825464 12172 raft_consensus.cc:383] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.825502 12172 raft_consensus.cc:738] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.825603 12172 consensus_queue.cc:260] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.825841 12172 ts_tablet_manager.cc:1428] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.826016 12172 tablet_bootstrap.cc:492] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.826488 13531 tablet.cc:1722] T 0542b05b9bd5489995ff972289d4b9c5 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:01.827044 12172 tablet_bootstrap.cc:654] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.827471 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cca9bd4d43014ac7851d0e0e7c2fa004"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.827921 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cca9bd4d43014ac7851d0e0e7c2fa004 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.828132 12177 raft_consensus.cc:2270] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.828580 12177 ts_tablet_manager.cc:1905] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.828843 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cf41c42a284541f293e7d495e77bee64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.829217 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf41c42a284541f293e7d495e77bee64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.830060 13536 tablet.cc:1722] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:01.830960 13537 tablet.cc:1722] T 0542b05b9bd5489995ff972289d4b9c5 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:01.832804 12177 ts_tablet_manager.cc:1918] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.832892 12177 log.cc:1199] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/1d596792632e4e32be161450f46b4168
I20250625 14:02:01.833343 12177 ts_tablet_manager.cc:1939] T 1d596792632e4e32be161450f46b4168 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.833734 12177 tablet_replica.cc:331] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.833932 12177 raft_consensus.cc:2241] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.835160 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 93a420268757402b8cd0609b79187e8b (DEFAULT_TABLE table=default.Table_5e70bbb4cf7547faa9581674e5c46cc2 [id=26170d4dcfda42fd8e177027cb5ceb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.835445 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a420268757402b8cd0609b79187e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.835477 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 93a420268757402b8cd0609b79187e8b (DEFAULT_TABLE table=default.Table_5e70bbb4cf7547faa9581674e5c46cc2 [id=26170d4dcfda42fd8e177027cb5ceb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.835701 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a420268757402b8cd0609b79187e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.836230 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7bcc674dc5e448c0871e4efe0c9100b8
I20250625 14:02:01.836565 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 7bcc674dc5e448c0871e4efe0c9100b8 deleted and replaced by tablet 8d600a46fc1c4a6194368f3cd8681364
I20250625 14:02:01.837388 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet df475b9c0f62419a9df86d4e0097dcba
I20250625 14:02:01.837862 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 3bff596192b2452cbddd499b77f49c7b (DEFAULT_TABLE table=default.Table_914775c66f004e21bd14f7c87028ca0a [id=700aae9d52a2412fb03deb9944e6af54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.837976 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 3bff596192b2452cbddd499b77f49c7b (DEFAULT_TABLE table=default.Table_914775c66f004e21bd14f7c87028ca0a [id=700aae9d52a2412fb03deb9944e6af54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.838114 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff596192b2452cbddd499b77f49c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.838153 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c06757067b3e465f8239b9ff38b68071
I20250625 14:02:01.838217 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff596192b2452cbddd499b77f49c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.838470 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b491668795ae4c0fb626d8c83c550243
W20250625 14:02:01.838729 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f325061ce4bb4468886cfe0a0d752596 consensus state has no leader
I20250625 14:02:01.839308 12177 raft_consensus.cc:2270] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.839654 13537 tablet.cc:1722] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:01.840456 12177 ts_tablet_manager.cc:1905] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.841648 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet b491668795ae4c0fb626d8c83c550243 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.841691 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet c06757067b3e465f8239b9ff38b68071 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.842494 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d600a46fc1c4a6194368f3cd8681364) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.842645 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet c06757067b3e465f8239b9ff38b68071 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.842800 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet b491668795ae4c0fb626d8c83c550243 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.842993 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet df475b9c0f62419a9df86d4e0097dcba with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.843194 12172 tablet_bootstrap.cc:492] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.843304 12172 ts_tablet_manager.cc:1397] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:02:01.843407 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d600a46fc1c4a6194368f3cd8681364) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.843706 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet df475b9c0f62419a9df86d4e0097dcba with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.843784 12172 raft_consensus.cc:357] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.843891 12172 raft_consensus.cc:383] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.843925 12172 raft_consensus.cc:738] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.844049 12172 consensus_queue.cc:260] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:01.844120 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b491668795ae4c0fb626d8c83c550243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b491668795ae4c0fb626d8c83c550243 already in progress: creating tablet
W20250625 14:02:01.844272 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c06757067b3e465f8239b9ff38b68071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c06757067b3e465f8239b9ff38b68071 already in progress: creating tablet
I20250625 14:02:01.844350 12172 ts_tablet_manager.cc:1428] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:01.844364 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7bcc674dc5e448c0871e4efe0c9100b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc674dc5e448c0871e4efe0c9100b8 already in progress: creating tablet
W20250625 14:02:01.844463 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet df475b9c0f62419a9df86d4e0097dcba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df475b9c0f62419a9df86d4e0097dcba already in progress: creating tablet
I20250625 14:02:01.844537 12172 tablet_bootstrap.cc:492] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:01.844646 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7bcc674dc5e448c0871e4efe0c9100b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc674dc5e448c0871e4efe0c9100b8 already in progress: creating tablet
W20250625 14:02:01.844735 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c06757067b3e465f8239b9ff38b68071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c06757067b3e465f8239b9ff38b68071 already in progress: creating tablet
W20250625 14:02:01.844813 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b491668795ae4c0fb626d8c83c550243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b491668795ae4c0fb626d8c83c550243 already in progress: creating tablet
W20250625 14:02:01.844915 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet df475b9c0f62419a9df86d4e0097dcba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df475b9c0f62419a9df86d4e0097dcba already in progress: creating tablet
I20250625 14:02:01.845811 12172 tablet_bootstrap.cc:654] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.850652 13352 consensus_queue.cc:1035] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.851336 12166 tablet_bootstrap.cc:492] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.851433 12166 ts_tablet_manager.cc:1397] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.125s user 0.002s sys 0.000s
I20250625 14:02:01.851927 12166 raft_consensus.cc:357] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.852056 12166 raft_consensus.cc:383] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.852098 12166 raft_consensus.cc:738] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.852205 12166 consensus_queue.cc:260] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.852524 12166 ts_tablet_manager.cc:1428] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.852700 12166 tablet_bootstrap.cc:492] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.849573 13257 mvcc.cc:204] Tried to move back new op lower bound from 7171523058619465728 to 7171523057368301568. Current Snapshot: MvccSnapshot[applied={T|T < 7171523058619465728}]
I20250625 14:02:01.854461 12177 ts_tablet_manager.cc:1918] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.854750 12166 tablet_bootstrap.cc:654] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.854794 12177 log.cc:1199] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/dce1b63ad2924626972ce7a42a4fdb60
I20250625 14:02:01.855017 12177 ts_tablet_manager.cc:1939] T dce1b63ad2924626972ce7a42a4fdb60 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.855345 12177 tablet_replica.cc:331] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.855513 12177 raft_consensus.cc:2241] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.855621 12177 raft_consensus.cc:2270] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.856077 12177 ts_tablet_manager.cc:1905] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.856165 13535 tablet.cc:1722] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:01.857971 12172 tablet_bootstrap.cc:492] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.858067 12172 ts_tablet_manager.cc:1397] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:01.858592 12172 raft_consensus.cc:357] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.858691 12172 raft_consensus.cc:383] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.858722 12172 raft_consensus.cc:738] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.858831 12172 consensus_queue.cc:260] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.859114 12172 ts_tablet_manager.cc:1428] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.860152 12172 tablet_bootstrap.cc:492] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.861150 12172 tablet_bootstrap.cc:654] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.861811 12166 tablet_bootstrap.cc:492] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.861915 12166 ts_tablet_manager.cc:1397] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250625 14:02:01.862494 12177 ts_tablet_manager.cc:1918] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.862452 12166 raft_consensus.cc:357] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.862560 12166 raft_consensus.cc:383] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.862602 12166 raft_consensus.cc:738] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.862711 12177 log.cc:1199] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/dff05950ded34f4bb554badc4ccd3e0f
I20250625 14:02:01.862721 12166 consensus_queue.cc:260] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.862972 12177 ts_tablet_manager.cc:1939] T dff05950ded34f4bb554badc4ccd3e0f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.863042 12166 ts_tablet_manager.cc:1428] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.863226 12166 tablet_bootstrap.cc:492] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.863277 12177 tablet_replica.cc:331] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.864041 12166 tablet_bootstrap.cc:654] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.864435 13334 raft_consensus.cc:491] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.864513 13334 raft_consensus.cc:513] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.864872 13334 leader_election.cc:290] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:01.865078 12172 tablet_bootstrap.cc:492] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.865159 12172 ts_tablet_manager.cc:1397] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:01.865633 12172 raft_consensus.cc:357] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.865727 12172 raft_consensus.cc:383] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.865759 12172 raft_consensus.cc:738] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.865867 12172 consensus_queue.cc:260] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.866592 11993 leader_election.cc:304] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:01.866772 13352 raft_consensus.cc:2802] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.866845 13352 raft_consensus.cc:695] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:01.866986 13352 consensus_queue.cc:237] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.863401 12177 raft_consensus.cc:2241] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.868466 12166 tablet_bootstrap.cc:492] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.868561 12166 ts_tablet_manager.cc:1397] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:01.869066 12166 raft_consensus.cc:357] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.869168 12166 raft_consensus.cc:383] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.869199 12166 raft_consensus.cc:738] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.869315 12166 consensus_queue.cc:260] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.869495 12172 ts_tablet_manager.cc:1428] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:01.869717 12172 tablet_bootstrap.cc:492] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.869699 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a05b09a3225f45db841978b7b9b1fe51 (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:02:01.870028 12166 ts_tablet_manager.cc:1428] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.870223 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 1d596792632e4e32be161450f46b4168 (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
I20250625 14:02:01.870296 12166 tablet_bootstrap.cc:492] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.870909 12172 tablet_bootstrap.cc:654] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.871237 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet dce1b63ad2924626972ce7a42a4fdb60 (table default.Table_06e8bc49777a442bbce90e7f4312b059 [id=336fd4d44f664c92b37b98b4f9198459]) successfully deleted
I20250625 14:02:01.871652 12177 raft_consensus.cc:2270] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.871734 12166 tablet_bootstrap.cc:654] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.872289 12177 ts_tablet_manager.cc:1905] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.872742 12172 tablet_bootstrap.cc:492] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.872830 12172 ts_tablet_manager.cc:1397] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:01.872874 12167 tablet_bootstrap.cc:492] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.872928 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet dff05950ded34f4bb554badc4ccd3e0f (table default.Table_8a19bb755ba242b59b812cd643e79646 [id=bc90345f034447a4b5220f58c4b52cf3]) successfully deleted
I20250625 14:02:01.872975 12167 ts_tablet_manager.cc:1397] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.143s user 0.002s sys 0.000s
I20250625 14:02:01.873370 12172 raft_consensus.cc:357] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.873494 12172 raft_consensus.cc:383] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.873430 12167 raft_consensus.cc:357] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.873526 12172 raft_consensus.cc:738] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.873536 12167 raft_consensus.cc:383] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.873571 12167 raft_consensus.cc:738] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.873662 12172 consensus_queue.cc:260] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.873682 12167 consensus_queue.cc:260] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.873944 12172 ts_tablet_manager.cc:1428] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.873955 12167 ts_tablet_manager.cc:1428] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.874135 12172 tablet_bootstrap.cc:492] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.874135 12167 tablet_bootstrap.cc:492] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.875252 12167 tablet_bootstrap.cc:654] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.875865 12172 tablet_bootstrap.cc:654] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.875964 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6c8c667108694caab967bd91f74759b6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.876434 12177 ts_tablet_manager.cc:1918] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.876503 12177 log.cc:1199] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b3819dec2c834c40846dcb3a11fa4f5f
I20250625 14:02:01.873440 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6c8c667108694caab967bd91f74759b6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.876721 12177 ts_tablet_manager.cc:1939] T b3819dec2c834c40846dcb3a11fa4f5f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.877254 12166 tablet_bootstrap.cc:492] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.877421 12166 ts_tablet_manager.cc:1397] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:02:01.877537 12177 tablet_replica.cc:331] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.877733 12177 raft_consensus.cc:2241] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.877893 12177 raft_consensus.cc:2270] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.878017 12166 raft_consensus.cc:357] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.878141 12166 raft_consensus.cc:383] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.878186 12166 raft_consensus.cc:738] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.878405 12166 consensus_queue.cc:260] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.878846 12167 tablet_bootstrap.cc:492] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.878939 12167 ts_tablet_manager.cc:1397] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:01.879487 12167 raft_consensus.cc:357] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.879873 12167 raft_consensus.cc:383] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.879917 12167 raft_consensus.cc:738] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.880084 13334 raft_consensus.cc:491] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.880184 13334 raft_consensus.cc:513] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.880250 12167 consensus_queue.cc:260] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.880571 12167 ts_tablet_manager.cc:1428] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:01.880574 13334 leader_election.cc:290] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.880764 12167 tablet_bootstrap.cc:492] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.880841 12166 ts_tablet_manager.cc:1428] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:01.881911 12166 tablet_bootstrap.cc:492] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.882054 12167 tablet_bootstrap.cc:654] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.883080 12166 tablet_bootstrap.cc:654] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.883391 12177 ts_tablet_manager.cc:1905] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.884007 12172 tablet_bootstrap.cc:492] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.884107 12172 ts_tablet_manager.cc:1397] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:02:01.884593 12172 raft_consensus.cc:357] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.884718 12172 raft_consensus.cc:383] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.884759 12172 raft_consensus.cc:738] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.884891 12172 consensus_queue.cc:260] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.885283 12172 ts_tablet_manager.cc:1428] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:01.886548 12177 ts_tablet_manager.cc:1918] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.886667 12177 log.cc:1199] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6c8c667108694caab967bd91f74759b6
I20250625 14:02:01.886655 11532 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974] alter complete (version 3)
I20250625 14:02:01.886943 12177 ts_tablet_manager.cc:1939] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.887637 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8facc6ed7757492ca9e7c7e7e26726dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.888031 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8facc6ed7757492ca9e7c7e7e26726dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.889051 12167 tablet_bootstrap.cc:492] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.889137 12167 ts_tablet_manager.cc:1397] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:02:01.889410 11782 raft_consensus.cc:3058] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.889617 12167 raft_consensus.cc:357] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.889724 12167 raft_consensus.cc:383] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.889760 12167 raft_consensus.cc:738] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.889868 12167 consensus_queue.cc:260] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.890146 12167 ts_tablet_manager.cc:1428] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.890146 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 93a420268757402b8cd0609b79187e8b (DEFAULT_TABLE table=default.Table_5e70bbb4cf7547faa9581674e5c46cc2 [id=26170d4dcfda42fd8e177027cb5ceb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.890589 12167 tablet_bootstrap.cc:492] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.890938 13535 tablet.cc:1722] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:01.891291 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_56c3d47ef76a41e19975ed30f65d487c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.891672 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56c3d47ef76a41e19975ed30f65d487c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.893103 12167 tablet_bootstrap.cc:654] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.894821 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a89682235f934b91a058bfd43e3b54b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.894902 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_76a7265ba1494e4f8aca832908235167"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:01.895221 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a89682235f934b91a058bfd43e3b54b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.895330 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3e48d799a62948839f3467f7aafcbc0e" } new_table_name: "default.Table_4f9c33e79caa412db635282d0138fe92" modify_external_catalogs: true
I20250625 14:02:01.894833 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9ef72fe56e5d459bb24f90a1299137e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.896029 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_798e019fc3a741d69e54f07c3fded18d" } new_table_name: "default.Table_a6b202cb3027445c92b5154b484b96ab" modify_external_catalogs: true
W20250625 14:02:01.896312 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ef72fe56e5d459bb24f90a1299137e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:01.895217 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76a7265ba1494e4f8aca832908235167 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.900310 12166 tablet_bootstrap.cc:492] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:01.900441 12166 ts_tablet_manager.cc:1397] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:02:01.900804 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 3bff596192b2452cbddd499b77f49c7b (DEFAULT_TABLE table=default.Table_914775c66f004e21bd14f7c87028ca0a [id=700aae9d52a2412fb03deb9944e6af54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.900977 12166 raft_consensus.cc:357] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.901204 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d600a46fc1c4a6194368f3cd8681364) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.901239 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet df475b9c0f62419a9df86d4e0097dcba with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.901098 12166 raft_consensus.cc:383] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.901371 12166 raft_consensus.cc:738] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.901363 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet b491668795ae4c0fb626d8c83c550243 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.901538 12166 consensus_queue.cc:260] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:01.901372 11717 leader_election.cc:343] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.901372 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet c06757067b3e465f8239b9ff38b68071 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:01.903111 11717 leader_election.cc:343] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:01.903219 11717 leader_election.cc:343] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.903272 11717 leader_election.cc:304] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.903405 13335 raft_consensus.cc:2747] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:01.903662 11717 leader_election.cc:343] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.903728 11717 leader_election.cc:304] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
W20250625 14:02:01.903811 11717 raft_consensus.cc:2684] T 6c8c667108694caab967bd91f74759b6 P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:01.903960 12166 ts_tablet_manager.cc:1428] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:01.904196 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b3819dec2c834c40846dcb3a11fa4f5f (table default.Table_2037e3cc66de4c68bc580a95e021e860 [id=46617722da444cc58422a5ce1d383cb0]) successfully deleted
W20250625 14:02:01.904515 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet bcfd65365c914c8eada42500930f7185 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bcfd65365c914c8eada42500930f7185 already in progress: creating tablet
I20250625 14:02:01.904978 12166 tablet_bootstrap.cc:492] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.905018 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0833d0e013f48f78cb6c616481b5dce" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.905275 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f0833d0e013f48f78cb6c616481b5dce" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.905625 13352 raft_consensus.cc:491] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.905720 13352 raft_consensus.cc:513] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.905748 13121 consensus_queue.cc:1035] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.906109 13352 leader_election.cc:290] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.906160 12166 tablet_bootstrap.cc:654] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.906424 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a05b09a3225f45db841978b7b9b1fe51" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.906538 11918 raft_consensus.cc:2466] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:01.906818 11990 leader_election.cc:304] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.907132 13121 raft_consensus.cc:2802] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.907204 13121 raft_consensus.cc:491] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.907251 13121 raft_consensus.cc:3058] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.908245 13121 raft_consensus.cc:513] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.908599 13121 leader_election.cc:290] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:01.908890 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a05b09a3225f45db841978b7b9b1fe51" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:01.908996 11918 raft_consensus.cc:3058] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.909595 12166 tablet_bootstrap.cc:492] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
W20250625 14:02:01.906276 11717 leader_election.cc:343] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.910002 11918 raft_consensus.cc:2466] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:01.910992 11990 leader_election.cc:304] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.911413 13121 raft_consensus.cc:2802] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.911550 13121 raft_consensus.cc:695] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:01.911691 13121 consensus_queue.cc:237] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:01.911962 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a951fa8b0cab485f9c221367c029fa4a consensus state has no leader
I20250625 14:02:01.913035 12558 raft_consensus.cc:491] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.913131 12558 raft_consensus.cc:513] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.913564 12558 leader_election.cc:290] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:01.913650 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 382a495348be45fc872f1602ee0c6165 has no consensus state
W20250625 14:02:01.914500 11858 leader_election.cc:343] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: ccf9474414824e6c84c2e81c52bb802a
W20250625 14:02:01.915021 11855 leader_election.cc:343] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: ccf9474414824e6c84c2e81c52bb802a
W20250625 14:02:01.915005 11717 leader_election.cc:343] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:01.915089 11855 leader_election.cc:304] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:01.915091 11717 leader_election.cc:304] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:01.915246 13335 raft_consensus.cc:2747] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.915354 12558 raft_consensus.cc:2747] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:01.916280 12166 ts_tablet_manager.cc:1397] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:02:01.917518 12166 raft_consensus.cc:357] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.917713 12166 raft_consensus.cc:383] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.917773 12166 raft_consensus.cc:738] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.918012 12166 consensus_queue.cc:260] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.920035 12166 ts_tablet_manager.cc:1428] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:01.920465 12166 tablet_bootstrap.cc:492] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:01.921613 12166 tablet_bootstrap.cc:654] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.923779 12172 tablet_bootstrap.cc:492] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.925050 12172 tablet_bootstrap.cc:654] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:01.927563 11993 leader_election.cc:343] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: a05b09a3225f45db841978b7b9b1fe51
W20250625 14:02:01.927874 11993 leader_election.cc:343] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: a05b09a3225f45db841978b7b9b1fe51
I20250625 14:02:01.928117 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet c6f1447498b74f3985cd2b3ef83f3ba6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.928328 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6c8c667108694caab967bd91f74759b6 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]) successfully deleted
W20250625 14:02:01.928516 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b5c8ce3d2ef4e78b4aa55bc45ee6a7b already in progress: creating tablet
I20250625 14:02:01.928584 12177 tablet_replica.cc:331] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:02:01.928645 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7bcc674dc5e448c0871e4efe0c9100b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bcc674dc5e448c0871e4efe0c9100b8 already in progress: creating tablet
I20250625 14:02:01.928730 12177 raft_consensus.cc:2241] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250625 14:02:01.928795 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b491668795ae4c0fb626d8c83c550243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b491668795ae4c0fb626d8c83c550243 already in progress: creating tablet
I20250625 14:02:01.928853 12177 raft_consensus.cc:2270] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.929929 12177 ts_tablet_manager.cc:1905] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.931890 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a420268757402b8cd0609b79187e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.934518 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff596192b2452cbddd499b77f49c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.934791 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_e9fd60167d824e34a9a990ec9994f4fe [id=416264ede8644650b07f6c60ffb3cc52]). Expected version 1 got 0
I20250625 14:02:01.935365 12167 tablet_bootstrap.cc:492] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.935461 12167 ts_tablet_manager.cc:1397] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.000s
I20250625 14:02:01.936069 12167 raft_consensus.cc:357] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:01.936177 12167 raft_consensus.cc:383] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.936208 12167 raft_consensus.cc:738] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.936189 11526 catalog_manager.cc:5582] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:01.936340 12167 consensus_queue.cc:260] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:01.936654 12167 ts_tablet_manager.cc:1428] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:01.936859 12167 tablet_bootstrap.cc:492] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.937091 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_ee2a6a17b42241cca1e5333b97a12735 [id=ca9692e6bb984585b43995ad4eceda1c] alter complete (version 2)
I20250625 14:02:01.937842 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bb1104be50d8484ab10c1efe62b44b88" } new_table_name: "default.Table_a5fc3132af7544519819617719f71e77" modify_external_catalogs: true
I20250625 14:02:01.937939 12167 tablet_bootstrap.cc:654] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.939710 12177 ts_tablet_manager.cc:1918] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:01.940905 12167 tablet_bootstrap.cc:492] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.941020 12167 ts_tablet_manager.cc:1397] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:01.941510 12167 raft_consensus.cc:357] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.941617 12167 raft_consensus.cc:383] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.941648 12167 raft_consensus.cc:738] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.941766 12167 consensus_queue.cc:260] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:01.942085 12167 ts_tablet_manager.cc:1428] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.942276 12167 tablet_bootstrap.cc:492] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.942658 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 841e9b31a488404ebaf8626b759702f5 (DEFAULT_TABLE table=default.Table_56a5f91af59040738b1802382d68ed19 [id=1e2f2d635a904db0b26e53e4d82796d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.943020 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841e9b31a488404ebaf8626b759702f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.943572 12167 tablet_bootstrap.cc:654] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.947280 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ee3d8927b7f94271bacd0a22d5855829"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:01.947342 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3fdd6c4a3751422b8f5f2d0a9c17a9ec" } new_table_name: "default.Table_cabcd06410bc4ee282294a6d0f1b2fe7" modify_external_catalogs: true
W20250625 14:02:01.947731 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee3d8927b7f94271bacd0a22d5855829 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:01.948086 12177 log.cc:1199] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/df475b9c0f62419a9df86d4e0097dcba
I20250625 14:02:01.948400 12177 ts_tablet_manager.cc:1939] T df475b9c0f62419a9df86d4e0097dcba P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:01.943363 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.946947 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet f0833d0e013f48f78cb6c616481b5dce with delete_type TABLET_DATA_DELETED (replaced by tablet 6980c62d63b34c67ad095ad9ea18a3f1) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.947057 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 628edde0bd0840c6a11c79f8ab810977 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b589e49a8844aa3acb9f8e27c0f6faf) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.949378 12177 tablet_replica.cc:331] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:01.949586 12177 raft_consensus.cc:2241] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.949749 12177 raft_consensus.cc:2270] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:01.950068 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dfbf6959677547a6a2582b73b2be4c03 consensus state has no leader
I20250625 14:02:01.950462 12177 ts_tablet_manager.cc:1905] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.951094 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c6f1447498b74f3985cd2b3ef83f3ba6
I20250625 14:02:01.951406 11528 catalog_manager.cc:6652] ReplaceTablet: tablet c6f1447498b74f3985cd2b3ef83f3ba6 deleted and replaced by tablet 68bf875082ce41e39093536bedf0333d
W20250625 14:02:01.951992 11517 catalog_manager.cc:5001] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): alter failed for tablet c1c05e534c804eb69e0c249a03418941 (table default.Table_d5005083292a472ab6b1824e5dfb65f7 [id=c6ffe56453b143ad961d9061478fccba]),no further retry: Not found: Tablet not found: c1c05e534c804eb69e0c249a03418941
I20250625 14:02:01.952514 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet c6f1447498b74f3985cd2b3ef83f3ba6 with delete_type TABLET_DATA_DELETED (replaced by tablet 68bf875082ce41e39093536bedf0333d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.952718 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet c6f1447498b74f3985cd2b3ef83f3ba6 with delete_type TABLET_DATA_DELETED (replaced by tablet 68bf875082ce41e39093536bedf0333d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.952919 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
W20250625 14:02:01.953181 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c6f1447498b74f3985cd2b3ef83f3ba6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6f1447498b74f3985cd2b3ef83f3ba6 already in progress: creating tablet
W20250625 14:02:01.953339 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c6f1447498b74f3985cd2b3ef83f3ba6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6f1447498b74f3985cd2b3ef83f3ba6 already in progress: creating tablet
I20250625 14:02:01.954102 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]). Expected version 2 got 0
I20250625 14:02:01.954838 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet c6f1447498b74f3985cd2b3ef83f3ba6 with delete_type TABLET_DATA_DELETED (replaced by tablet 68bf875082ce41e39093536bedf0333d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:01.955024 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet df475b9c0f62419a9df86d4e0097dcba (table default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d [id=d35a23a319d44785bff52098cd7247e4]) successfully deleted
W20250625 14:02:01.955155 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c06757067b3e465f8239b9ff38b68071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c06757067b3e465f8239b9ff38b68071 already in progress: creating tablet
I20250625 14:02:01.956370 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354]). Expected version 3 got 0
W20250625 14:02:01.956624 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c188bc758a4c4a71a5550fc11fe59b1a consensus state has no leader
I20250625 14:02:01.956946 12042 raft_consensus.cc:1273] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:01.957641 11918 raft_consensus.cc:1273] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:01.958724 12172 tablet_bootstrap.cc:492] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:01.958830 12172 ts_tablet_manager.cc:1397] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20250625 14:02:01.959066 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 841e9b31a488404ebaf8626b759702f5 (DEFAULT_TABLE table=default.Table_56a5f91af59040738b1802382d68ed19 [id=1e2f2d635a904db0b26e53e4d82796d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.959332 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841e9b31a488404ebaf8626b759702f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.959399 12172 raft_consensus.cc:357] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.959527 12172 raft_consensus.cc:383] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.959563 12172 raft_consensus.cc:738] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.959697 12172 consensus_queue.cc:260] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.960005 12172 ts_tablet_manager.cc:1428] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.960220 12172 tablet_bootstrap.cc:492] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:01.962574 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 382a495348be45fc872f1602ee0c6165 (DEFAULT_TABLE table=default.Table_a6b202cb3027445c92b5154b484b96ab [id=eabd417ea9e042bf981717b23d07b237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.962733 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 6c342fb25ade45bba64f2130972f70f9 (DEFAULT_TABLE table=default.Table_6db36f516279421ea24a5c80f1f505af [id=8e029d73de804f01842fc89435070d89]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.962846 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382a495348be45fc872f1602ee0c6165. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.962972 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c342fb25ade45bba64f2130972f70f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.963440 12167 tablet_bootstrap.cc:492] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.963519 12167 ts_tablet_manager.cc:1397] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20250625 14:02:01.964022 12167 raft_consensus.cc:357] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.964125 12167 raft_consensus.cc:383] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.964162 12167 raft_consensus.cc:738] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.964295 12167 consensus_queue.cc:260] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.964569 12167 ts_tablet_manager.cc:1428] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:01.964761 12167 tablet_bootstrap.cc:492] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.965169 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 010e364c62d941caba3f069423183aa5 (DEFAULT_TABLE table=default.Table_704a518792fb46d29f288f87261cfeb3 [id=cb705b59438543dd966141fef0504dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.965399 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010e364c62d941caba3f069423183aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.965493 12172 tablet_bootstrap.cc:654] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.965895 12167 tablet_bootstrap.cc:654] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.967024 13334 consensus_queue.cc:1035] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:01.968080 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 382a495348be45fc872f1602ee0c6165 (DEFAULT_TABLE table=default.Table_a6b202cb3027445c92b5154b484b96ab [id=eabd417ea9e042bf981717b23d07b237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.968168 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 6c342fb25ade45bba64f2130972f70f9 (DEFAULT_TABLE table=default.Table_6db36f516279421ea24a5c80f1f505af [id=8e029d73de804f01842fc89435070d89]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.968397 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382a495348be45fc872f1602ee0c6165. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.968550 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c342fb25ade45bba64f2130972f70f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.968786 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 010e364c62d941caba3f069423183aa5 (DEFAULT_TABLE table=default.Table_704a518792fb46d29f288f87261cfeb3 [id=cb705b59438543dd966141fef0504dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.969020 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010e364c62d941caba3f069423183aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.970872 11902 tablet_service.cc:1468] Processing CreateTablet for tablet a0e940193fc54a2caa49d3c5605b2c5d (DEFAULT_TABLE table=default.Table_551f8133109341f7a7045c081156ed57 [id=f3cf2027645f40fdaba2d27f806feb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.970207 12036 tablet_service.cc:1468] Processing CreateTablet for tablet a0e940193fc54a2caa49d3c5605b2c5d (DEFAULT_TABLE table=default.Table_551f8133109341f7a7045c081156ed57 [id=f3cf2027645f40fdaba2d27f806feb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.971107 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e940193fc54a2caa49d3c5605b2c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.971307 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e940193fc54a2caa49d3c5605b2c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.971312 11890 tablet_service.cc:1468] Processing CreateTablet for tablet c1a032922654409f96b77e038b4c02f8 (DEFAULT_TABLE table=default.Table_1028fee60eff416cb36b22bb6a320403 [id=131388766e5f4bd89eaaf95673544e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.971520 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a032922654409f96b77e038b4c02f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.973161 13121 raft_consensus.cc:491] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.973246 13121 raft_consensus.cc:513] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.973578 12558 raft_consensus.cc:491] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:01.973639 13121 leader_election.cc:290] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.973650 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e (DEFAULT_TABLE table=default.Table_bfc13b8c105c4d06a2bd6c6d773e2b42 [id=5f76d8f90a714d2db1c38c33b2246db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.970485 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e (DEFAULT_TABLE table=default.Table_bfc13b8c105c4d06a2bd6c6d773e2b42 [id=5f76d8f90a714d2db1c38c33b2246db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.973862 12032 tablet_service.cc:1468] Processing CreateTablet for tablet c1a032922654409f96b77e038b4c02f8 (DEFAULT_TABLE table=default.Table_1028fee60eff416cb36b22bb6a320403 [id=131388766e5f4bd89eaaf95673544e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.973922 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.970679 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 64170f3217f14c8583a96f1c47307643 (DEFAULT_TABLE table=default.Table_b14fc3a4b7354d878201d3685b0eb531 [id=d85c867b5bf741de9458e0c5cc92ab6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.973661 12558 raft_consensus.cc:513] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.974221 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet a753b44395994a4abaaa96fb9b6d594a from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:01.974473 12558 leader_election.cc:290] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.974515 11899 tablet_service.cc:1468] Processing CreateTablet for tablet e82d66db450e41faaa9e5ba2796bed2d (DEFAULT_TABLE table=default.Table_a2ff3964d6a24c2fa0471b420dba3238 [id=93af6c789cc948c9855d6a58544d2437]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.974771 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82d66db450e41faaa9e5ba2796bed2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.976068 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a032922654409f96b77e038b4c02f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.976070 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1af86cdb13f427ea61ee8ad56ca3f26" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:01.976446 12042 raft_consensus.cc:2466] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:01.976872 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "837e98e4e48a465fa9c3e697ae34c9ea" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:01.977005 11918 raft_consensus.cc:2466] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:01.977301 11990 leader_election.cc:304] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.977411 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 9613ce45d22240bb971fcced3e58a60b (DEFAULT_TABLE table=default.Table_875e11b27bb446218a901c940558ca2f [id=9b7b82daca56413cb9d5342456fe37a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.977473 13121 raft_consensus.cc:2802] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.977511 13121 raft_consensus.cc:491] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.977548 13121 raft_consensus.cc:3058] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.977653 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9613ce45d22240bb971fcced3e58a60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.978860 13121 raft_consensus.cc:513] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.979336 13121 leader_election.cc:290] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.981128 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1 [id=d02b8ccb415e4358832eb8334c21a8b9] alter complete (version 1)
I20250625 14:02:01.982462 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "837e98e4e48a465fa9c3e697ae34c9ea" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:01.982585 11918 raft_consensus.cc:3058] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.983217 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet fee20f2812d34d188b7181e6da00f823 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.983433 12173 tablet_replica.cc:331] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:01.983549 11918 raft_consensus.cc:2466] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:01.983592 12173 raft_consensus.cc:2241] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.983707 12173 raft_consensus.cc:2270] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.984282 12173 ts_tablet_manager.cc:1905] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:01.984607 12167 tablet_bootstrap.cc:492] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:01.984683 12167 ts_tablet_manager.cc:1397] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250625 14:02:01.985155 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d596792632e4e32be161450f46b4168 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fd261d824c34864a7b15e4736254062) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.985245 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 67002721ac274619b435e8bf16fc149a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.985388 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet ccf9474414824e6c84c2e81c52bb802a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.985174 12167 raft_consensus.cc:357] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.985586 12167 raft_consensus.cc:383] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:01.985622 12167 raft_consensus.cc:738] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:01.985749 12167 consensus_queue.cc:260] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.986044 12167 ts_tablet_manager.cc:1428] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:01.986234 12167 tablet_bootstrap.cc:492] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:01.986428 12175 tablet_replica.cc:331] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:01.986584 12175 raft_consensus.cc:2241] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:01.986702 12175 raft_consensus.cc:2270] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:01.987274 12167 tablet_bootstrap.cc:654] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:01.987752 11990 leader_election.cc:304] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.988723 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1af86cdb13f427ea61ee8ad56ca3f26" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:01.988876 11782 raft_consensus.cc:2466] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:01.990283 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 3c0c788abff9449797dd272d45e5fa7b (DEFAULT_TABLE table=default.Table_c3df90d585fc468fb479f6c7fb76d6c3 [id=b1c453d34b3e402a96750871da49e7da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.990597 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0c788abff9449797dd272d45e5fa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.990957 13121 raft_consensus.cc:2802] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.991055 13121 raft_consensus.cc:695] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:01.991108 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64170f3217f14c8583a96f1c47307643. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.991201 13121 consensus_queue.cc:237] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.992213 11858 leader_election.cc:304] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.992465 12558 raft_consensus.cc:2802] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:01.992511 12558 raft_consensus.cc:491] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:01.992544 12558 raft_consensus.cc:3058] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.993353 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.993433 12558 raft_consensus.cc:513] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.993737 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.993793 12558 leader_election.cc:290] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:01.993868 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 67002721ac274619b435e8bf16fc149a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.994551 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1af86cdb13f427ea61ee8ad56ca3f26" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:01.994685 11782 raft_consensus.cc:3058] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:01.994673 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 9613ce45d22240bb971fcced3e58a60b (DEFAULT_TABLE table=default.Table_875e11b27bb446218a901c940558ca2f [id=9b7b82daca56413cb9d5342456fe37a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:01.994930 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9613ce45d22240bb971fcced3e58a60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:01.995718 11782 raft_consensus.cc:2466] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:01.997138 11858 leader_election.cc:304] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:01.997335 12558 raft_consensus.cc:2802] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:01.990967 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet a05b09a3225f45db841978b7b9b1fe51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:01.997416 12558 raft_consensus.cc:695] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:01.997536 12558 consensus_queue.cc:237] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:01.999521 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d596792632e4e32be161450f46b4168 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fd261d824c34864a7b15e4736254062) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:01.999454 11527 catalog_manager.cc:5582] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:01.999724 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]). Expected version 2 got 0
I20250625 14:02:02.001042 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet a05b09a3225f45db841978b7b9b1fe51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.001222 12166 tablet_bootstrap.cc:492] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.001446 12166 ts_tablet_manager.cc:1397] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.081s user 0.001s sys 0.001s
I20250625 14:02:02.002074 12173 ts_tablet_manager.cc:1918] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.002171 12173 log.cc:1199] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/fee20f2812d34d188b7181e6da00f823
I20250625 14:02:02.002059 12166 raft_consensus.cc:357] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.002406 12166 raft_consensus.cc:383] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.002493 12166 raft_consensus.cc:738] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.002630 11896 tablet_service.cc:1468] Processing CreateTablet for tablet a3589745418e44adab10778ed1b0838a (DEFAULT_TABLE table=default.Table_e4c20f5076904d6d8060e5013a7512bf [id=b3d231b3023d4f1fb3228f89bad64e36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.002696 12166 consensus_queue.cc:260] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.002923 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3589745418e44adab10778ed1b0838a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.003058 11526 catalog_manager.cc:5582] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:02.003278 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
I20250625 14:02:02.003521 12166 ts_tablet_manager.cc:1428] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250625 14:02:02.004370 12166 tablet_bootstrap.cc:492] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.004998 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 5df4b218df7d4e4e9e634d3cd4f17633 (table default.Table_2142455242ee42d5820deea5646c9bc2 [id=6adcb3bc8e144f59bfe4d4f185b13a85]). Expected version 2 got 0
I20250625 14:02:02.006153 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2c2b195f74a64e3990919d0efcb9e1ac" } modify_external_catalogs: true
I20250625 14:02:02.006278 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2c2b195f74a64e3990919d0efcb9e1ac" } modify_external_catalogs: true
I20250625 14:02:02.006600 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a" } modify_external_catalogs: true
I20250625 14:02:02.006701 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a" } modify_external_catalogs: true
I20250625 14:02:02.006831 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 64170f3217f14c8583a96f1c47307643 (DEFAULT_TABLE table=default.Table_b14fc3a4b7354d878201d3685b0eb531 [id=d85c867b5bf741de9458e0c5cc92ab6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.007094 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64170f3217f14c8583a96f1c47307643. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.008177 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 3c0c788abff9449797dd272d45e5fa7b (DEFAULT_TABLE table=default.Table_c3df90d585fc468fb479f6c7fb76d6c3 [id=b1c453d34b3e402a96750871da49e7da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.008478 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0c788abff9449797dd272d45e5fa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.010809 12175 ts_tablet_manager.cc:1905] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.012133 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet fa2ccf77288144e5b81513dede9d4302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.012516 12036 tablet_service.cc:1468] Processing CreateTablet for tablet e82d66db450e41faaa9e5ba2796bed2d (DEFAULT_TABLE table=default.Table_a2ff3964d6a24c2fa0471b420dba3238 [id=93af6c789cc948c9855d6a58544d2437]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.013294 12175 ts_tablet_manager.cc:1918] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.013450 12175 log.cc:1199] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/67002721ac274619b435e8bf16fc149a
I20250625 14:02:02.013720 12175 ts_tablet_manager.cc:1939] T 67002721ac274619b435e8bf16fc149a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.014413 12175 tablet_replica.cc:331] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.014598 12175 raft_consensus.cc:2241] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.014748 12175 raft_consensus.cc:2270] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.015172 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 806e5502a95e4a0396c008267e16f2d5
I20250625 14:02:02.015794 12175 ts_tablet_manager.cc:1905] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.017307 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 67002721ac274619b435e8bf16fc149a (table default.Table_f41c7ed5d5c64d7196b15168dc43ccab [id=41cea1d0aade416ca6b75cbb14127245]) successfully deleted
W20250625 14:02:02.017724 11717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.39.130:45381, user_credentials={real_user=slave}} blocked reactor thread for 52641us
I20250625 14:02:02.019824 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 382a495348be45fc872f1602ee0c6165 (DEFAULT_TABLE table=default.Table_a6b202cb3027445c92b5154b484b96ab [id=eabd417ea9e042bf981717b23d07b237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.019994 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 6c342fb25ade45bba64f2130972f70f9 (DEFAULT_TABLE table=default.Table_6db36f516279421ea24a5c80f1f505af [id=8e029d73de804f01842fc89435070d89]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.020205 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382a495348be45fc872f1602ee0c6165. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.020233 11755 tablet_service.cc:1468] Processing CreateTablet for tablet e82d66db450e41faaa9e5ba2796bed2d (DEFAULT_TABLE table=default.Table_a2ff3964d6a24c2fa0471b420dba3238 [id=93af6c789cc948c9855d6a58544d2437]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.020378 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e (DEFAULT_TABLE table=default.Table_bfc13b8c105c4d06a2bd6c6d773e2b42 [id=5f76d8f90a714d2db1c38c33b2246db7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.020579 11753 tablet_service.cc:1468] Processing CreateTablet for tablet a3589745418e44adab10778ed1b0838a (DEFAULT_TABLE table=default.Table_e4c20f5076904d6d8060e5013a7512bf [id=b3d231b3023d4f1fb3228f89bad64e36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.020629 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 7491e070e86346b681817fb19d4608f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.020702 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 9613ce45d22240bb971fcced3e58a60b (DEFAULT_TABLE table=default.Table_875e11b27bb446218a901c940558ca2f [id=9b7b82daca56413cb9d5342456fe37a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.020819 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 64170f3217f14c8583a96f1c47307643 (DEFAULT_TABLE table=default.Table_b14fc3a4b7354d878201d3685b0eb531 [id=d85c867b5bf741de9458e0c5cc92ab6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.019843 11750 tablet_service.cc:1468] Processing CreateTablet for tablet a0e940193fc54a2caa49d3c5605b2c5d (DEFAULT_TABLE table=default.Table_551f8133109341f7a7045c081156ed57 [id=f3cf2027645f40fdaba2d27f806feb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.020936 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 3c0c788abff9449797dd272d45e5fa7b (DEFAULT_TABLE table=default.Table_c3df90d585fc468fb479f6c7fb76d6c3 [id=b1c453d34b3e402a96750871da49e7da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.020579 11756 tablet_service.cc:1468] Processing CreateTablet for tablet c1a032922654409f96b77e038b4c02f8 (DEFAULT_TABLE table=default.Table_1028fee60eff416cb36b22bb6a320403 [id=131388766e5f4bd89eaaf95673544e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.020421 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82d66db450e41faaa9e5ba2796bed2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.021075 13334 consensus_queue.cc:1035] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:02.021205 11748 tablet_service.cc:1515] Processing DeleteTablet for tablet 806e5502a95e4a0396c008267e16f2d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.021453 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9613ce45d22240bb971fcced3e58a60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.019843 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 010e364c62d941caba3f069423183aa5 (DEFAULT_TABLE table=default.Table_704a518792fb46d29f288f87261cfeb3 [id=cb705b59438543dd966141fef0504dc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.021701 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010e364c62d941caba3f069423183aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.022275 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64170f3217f14c8583a96f1c47307643. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.023553 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.023758 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a032922654409f96b77e038b4c02f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.023980 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c342fb25ade45bba64f2130972f70f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.024101 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3589745418e44adab10778ed1b0838a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.024811 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 841e9b31a488404ebaf8626b759702f5 (DEFAULT_TABLE table=default.Table_56a5f91af59040738b1802382d68ed19 [id=1e2f2d635a904db0b26e53e4d82796d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.025053 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841e9b31a488404ebaf8626b759702f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.025760 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e940193fc54a2caa49d3c5605b2c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.026029 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0c788abff9449797dd272d45e5fa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.029104 12175 ts_tablet_manager.cc:1918] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.029271 12175 log.cc:1199] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/ccf9474414824e6c84c2e81c52bb802a
I20250625 14:02:02.029563 12175 ts_tablet_manager.cc:1939] T ccf9474414824e6c84c2e81c52bb802a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.031471 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 49c8487f502b4f5299387daa9e89604b
I20250625 14:02:02.031490 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet ccf9474414824e6c84c2e81c52bb802a (table default.Table_14d8a31a1e8b4fa5a08673620892fc67 [id=a82f666dac0f4e8d829c04a3f68f18a0]) successfully deleted
I20250625 14:02:02.033161 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 49c8487f502b4f5299387daa9e89604b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.033403 12175 tablet_replica.cc:331] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.033600 12175 raft_consensus.cc:2241] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.033850 12175 raft_consensus.cc:2270] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.034533 12175 ts_tablet_manager.cc:1905] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.015219 13352 raft_consensus.cc:491] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.038465 13352 raft_consensus.cc:513] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.039012 13352 leader_election.cc:290] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.016815 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b1af86cdb13f427ea61ee8ad56ca3f26" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:02.039167 12042 raft_consensus.cc:3058] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.040195 12042 raft_consensus.cc:2466] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:02.040210 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d2a4eb7764fa443daa0ea76f615566f2" } new_table_name: "default.Table_c769119bc7a3472d91c5e524724929e9" modify_external_catalogs: true
I20250625 14:02:02.040624 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82d66db450e41faaa9e5ba2796bed2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.041584 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2928b645415547419a21192f44ad81ab" } modify_external_catalogs: true
I20250625 14:02:02.041700 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2928b645415547419a21192f44ad81ab" } modify_external_catalogs: true
I20250625 14:02:02.017288 12173 ts_tablet_manager.cc:1939] T fee20f2812d34d188b7181e6da00f823 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.043174 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_463848d52fef45a891bce13d122d7ee0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.043406 12173 tablet_replica.cc:331] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:02:02.043574 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_463848d52fef45a891bce13d122d7ee0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.043918 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e70f8d95174d4bfe8aad800cb1211138" } modify_external_catalogs: true
I20250625 14:02:02.044019 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e70f8d95174d4bfe8aad800cb1211138" } modify_external_catalogs: true
I20250625 14:02:02.044656 12172 tablet_bootstrap.cc:492] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:02.044770 12172 ts_tablet_manager.cc:1397] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.085s user 0.002s sys 0.000s
I20250625 14:02:02.045063 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_adab8acd3bfa4278a0007fbcaa2a79c8" } modify_external_catalogs: true
I20250625 14:02:02.045177 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_adab8acd3bfa4278a0007fbcaa2a79c8" } modify_external_catalogs: true
I20250625 14:02:02.045282 12172 raft_consensus.cc:357] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.045384 12172 raft_consensus.cc:383] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.045413 12172 raft_consensus.cc:738] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.045526 12172 consensus_queue.cc:260] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.045636 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dce1b63ad2924626972ce7a42a4fdb60" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:02.046169 11990 leader_election.cc:343] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.018416 12167 tablet_bootstrap.cc:492] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.046414 12167 ts_tablet_manager.cc:1397] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.000s
I20250625 14:02:02.047024 12175 ts_tablet_manager.cc:1918] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.047101 12175 log.cc:1199] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/1d596792632e4e32be161450f46b4168
I20250625 14:02:02.047222 12167 raft_consensus.cc:357] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.047343 12175 ts_tablet_manager.cc:1939] T 1d596792632e4e32be161450f46b4168 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.047336 12167 raft_consensus.cc:383] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.047372 12167 raft_consensus.cc:738] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.047513 12167 consensus_queue.cc:260] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.047676 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet fee20f2812d34d188b7181e6da00f823 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.047820 12167 ts_tablet_manager.cc:1428] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.048023 12167 tablet_bootstrap.cc:492] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.049067 12167 tablet_bootstrap.cc:654] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.049067 13334 raft_consensus.cc:491] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.049166 13334 raft_consensus.cc:513] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.049508 13334 leader_election.cc:290] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:02.049669 13335 raft_consensus.cc:491] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.049729 13335 raft_consensus.cc:513] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.050014 13335 leader_election.cc:290] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:02.032759 13121 raft_consensus.cc:491] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.050522 13121 raft_consensus.cc:513] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.050858 13121 leader_election.cc:290] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:02.050880 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "837e98e4e48a465fa9c3e697ae34c9ea" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:02.051013 11781 raft_consensus.cc:3058] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.051097 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "837e98e4e48a465fa9c3e697ae34c9ea" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:02.051617 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet fee20f2812d34d188b7181e6da00f823 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
I20250625 14:02:02.052071 11781 raft_consensus.cc:2466] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:02.054297 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e4cdf8f78d14c7d8ba3bda009d33719" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.055058 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b5c6c654c5704a41987a8d2016ab32b4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.055187 12042 raft_consensus.cc:2466] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:02.057289 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e4cdf8f78d14c7d8ba3bda009d33719" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.057564 11916 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b5c6c654c5704a41987a8d2016ab32b4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:02.059542 11993 leader_election.cc:343] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: dce1b63ad2924626972ce7a42a4fdb60
I20250625 14:02:02.059631 11993 leader_election.cc:304] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:02:02.059634 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b08135db764c4eb286d5f67ccba94ed5 consensus state has no leader
I20250625 14:02:02.059876 13121 raft_consensus.cc:2747] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.060213 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 806e5502a95e4a0396c008267e16f2d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.062829 12172 ts_tablet_manager.cc:1428] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20250625 14:02:02.063897 12172 tablet_bootstrap.cc:492] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:02.065094 12172 tablet_bootstrap.cc:654] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.065083 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3c825977e422407486587f28af36bd68
I20250625 14:02:02.069463 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 3c825977e422407486587f28af36bd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.069718 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 3c825977e422407486587f28af36bd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.069970 12173 raft_consensus.cc:2241] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.070374 12173 raft_consensus.cc:2270] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.033025 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 806e5502a95e4a0396c008267e16f2d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.068399 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 3c825977e422407486587f28af36bd68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.033170 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 49c8487f502b4f5299387daa9e89604b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.068429 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 49c8487f502b4f5299387daa9e89604b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:02.069233 11717 leader_election.cc:343] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.069348 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 with delete_type TABLET_DATA_DELETED (replaced by tablet 06d9ec116e8e4206940860c88c23eed2) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.071297 12173 ts_tablet_manager.cc:1905] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:02.071345 11717 leader_election.cc:343] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.071569 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
W20250625 14:02:02.073836 11717 leader_election.cc:343] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.073925 11717 leader_election.cc:304] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:02.074046 13334 raft_consensus.cc:2747] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.074481 12173 ts_tablet_manager.cc:1918] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.074548 12173 log.cc:1199] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/1d596792632e4e32be161450f46b4168
I20250625 14:02:02.074852 13535 tablet.cc:1722] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.074767 12173 ts_tablet_manager.cc:1939] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.077669 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 1d596792632e4e32be161450f46b4168 (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
I20250625 14:02:02.081243 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6b666076abf941a583399f3a072c302d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.081796 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b666076abf941a583399f3a072c302d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.005694 12166 tablet_bootstrap.cc:654] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.081307 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_992ed60a855e433995e83e54f5f7d7db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.082947 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_992ed60a855e433995e83e54f5f7d7db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.083724 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fe2254af415a4926ac7969b5478c2c1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.084053 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe2254af415a4926ac7969b5478c2c1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.085546 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet f2f25aaee07242329014de1834ca881d from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.035102 12032 tablet_service.cc:1468] Processing CreateTablet for tablet a3589745418e44adab10778ed1b0838a (DEFAULT_TABLE table=default.Table_e4c20f5076904d6d8060e5013a7512bf [id=b3d231b3023d4f1fb3228f89bad64e36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.086030 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3589745418e44adab10778ed1b0838a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.086901 11717 leader_election.cc:304] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:02.087073 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.087096 13335 raft_consensus.cc:2802] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:02.087174 13335 raft_consensus.cc:491] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:02.087225 13335 raft_consensus.cc:3058] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.087688 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7b817bda69f44497a6787d1d649ef5e9
I20250625 14:02:02.088402 13335 raft_consensus.cc:513] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.088780 13335 leader_election.cc:290] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:02.089211 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b817bda69f44497a6787d1d649ef5e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.090821 12173 tablet_replica.cc:331] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.091015 12173 raft_consensus.cc:2241] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.091140 12173 raft_consensus.cc:2270] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:02.091733 11993 leader_election.cc:343] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 1d596792632e4e32be161450f46b4168
I20250625 14:02:02.092921 13531 tablet.cc:1722] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.093381 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b5c6c654c5704a41987a8d2016ab32b4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:02.093500 12042 raft_consensus.cc:3058] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.094460 12042 raft_consensus.cc:2466] T b5c6c654c5704a41987a8d2016ab32b4 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:02.094846 12177 ts_tablet_manager.cc:1918] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.095317 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bb1d6934ab98482c9ae6b6cafc1ee9a6
I20250625 14:02:02.095489 12177 log.cc:1199] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/128dab7ad46048cc91fc20ddc1431d57
I20250625 14:02:02.095832 12177 ts_tablet_manager.cc:1939] T 128dab7ad46048cc91fc20ddc1431d57 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.097810 11529 catalog_manager.cc:6652] ReplaceTablet: tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 deleted and replaced by tablet c220c2fab2fb4628bd7ecf0cfc9d4a57
I20250625 14:02:02.098814 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 with delete_type TABLET_DATA_DELETED (replaced by tablet c220c2fab2fb4628bd7ecf0cfc9d4a57) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.100133 12173 ts_tablet_manager.cc:1905] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.100338 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 with delete_type TABLET_DATA_DELETED (replaced by tablet c220c2fab2fb4628bd7ecf0cfc9d4a57) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.100399 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b5c6c654c5704a41987a8d2016ab32b4" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:02.098663 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b817bda69f44497a6787d1d649ef5e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.098884 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b817bda69f44497a6787d1d649ef5e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.098971 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 with delete_type TABLET_DATA_DELETED (replaced by tablet c220c2fab2fb4628bd7ecf0cfc9d4a57) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.101454 12177 tablet_replica.cc:331] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.104554 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 5479ccdc39ce43c2a2727334235541b5 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.105001 12166 tablet_bootstrap.cc:492] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.105198 12166 ts_tablet_manager.cc:1397] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.101s user 0.000s sys 0.002s
I20250625 14:02:02.105747 12166 raft_consensus.cc:357] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:02.105945 12166 raft_consensus.cc:383] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.106019 12166 raft_consensus.cc:738] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.106256 12166 consensus_queue.cc:260] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:02.106714 12166 ts_tablet_manager.cc:1428] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.107991 12166 tablet_bootstrap.cc:492] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.110455 12177 raft_consensus.cc:2241] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.110721 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 128dab7ad46048cc91fc20ddc1431d57 (table default.Table_712e366118ea4a03a6e8a0f811b4a27d [id=da18d76cf3bc4ae79e0b3a779454d907]) successfully deleted
I20250625 14:02:02.111238 12177 raft_consensus.cc:2270] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.111339 12173 ts_tablet_manager.cc:1918] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.111433 12173 log.cc:1199] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/dce1b63ad2924626972ce7a42a4fdb60
W20250625 14:02:02.111066 11717 leader_election.cc:343] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.104363 12172 tablet_bootstrap.cc:492] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:02.111662 12173 ts_tablet_manager.cc:1939] T dce1b63ad2924626972ce7a42a4fdb60 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.111790 12172 ts_tablet_manager.cc:1397] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.001s
I20250625 14:02:02.112677 12172 raft_consensus.cc:357] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.112911 12172 raft_consensus.cc:383] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.112994 12172 raft_consensus.cc:738] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.113184 12172 consensus_queue.cc:260] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.114656 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3fc13d79731e4d07a486ac496fd081fc" } new_table_name: "default.Table_06f52f09f53f4abf9d515f309f225205" modify_external_catalogs: true
I20250625 14:02:02.114729 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9bbdb0114e0245cd9d194c455a61b97b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.115114 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bbdb0114e0245cd9d194c455a61b97b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.115695 12172 ts_tablet_manager.cc:1428] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:02.116676 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cf41c42a284541f293e7d495e77bee64" } new_table_name: "default.Table_2c96e22babf24bf2b5e2fe9f7c82da38" modify_external_catalogs: true
I20250625 14:02:02.117197 12172 tablet_bootstrap.cc:492] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:02.117992 11916 raft_consensus.cc:1273] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:02.119284 12177 ts_tablet_manager.cc:1905] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.119313 13352 consensus_queue.cc:1035] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:02.119971 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e0381b79b702498c8651956dccb37bd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.120409 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f2f25aaee07242329014de1834ca881d
I20250625 14:02:02.120710 11524 catalog_manager.cc:6652] ReplaceTablet: tablet f2f25aaee07242329014de1834ca881d deleted and replaced by tablet 08b3ba59f0374c6199cd470d136c59ee
I20250625 14:02:02.120851 12166 tablet_bootstrap.cc:654] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.119683 13335 raft_consensus.cc:491] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.121637 13335 raft_consensus.cc:513] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.122138 13335 leader_election.cc:290] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:02.122262 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9dc0f8c5c2384df382588ecd2cce8840"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.122517 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bd22422f2a084b93bfa750b1ac6b7ce9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.122674 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9dc0f8c5c2384df382588ecd2cce8840 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:02.122781 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd22422f2a084b93bfa750b1ac6b7ce9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.119849 11717 leader_election.cc:304] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:02.123411 13335 raft_consensus.cc:2802] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:02.123513 13335 raft_consensus.cc:695] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:02.123680 13335 consensus_queue.cc:237] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.124576 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f25aaee07242329014de1834ca881d with delete_type TABLET_DATA_DELETED (replaced by tablet 08b3ba59f0374c6199cd470d136c59ee) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.125581 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f25aaee07242329014de1834ca881d with delete_type TABLET_DATA_DELETED (replaced by tablet 08b3ba59f0374c6199cd470d136c59ee) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.130259 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet fa2ccf77288144e5b81513dede9d4302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.132483 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "714bb5a28ec648f990fa1525a1b50129" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.132579 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "714bb5a28ec648f990fa1525a1b50129" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.132220 11531 catalog_manager.cc:5582] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:02.120311 12172 tablet_bootstrap.cc:654] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.134184 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b817bda69f44497a6787d1d649ef5e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.134263 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4ed7734f171f4692ba7900844100c878
I20250625 14:02:02.135156 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f25aaee07242329014de1834ca881d with delete_type TABLET_DATA_DELETED (replaced by tablet 08b3ba59f0374c6199cd470d136c59ee) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.135638 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]). Expected version 2 got 0
I20250625 14:02:02.135666 11781 raft_consensus.cc:1273] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:02.136237 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ee1a7cdb917147a79756089dee89d7d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.136617 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee1a7cdb917147a79756089dee89d7d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.138509 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ed7734f171f4692ba7900844100c878 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.139469 13352 consensus_queue.cc:1035] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:02.139808 11717 leader_election.cc:343] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:02.139946 11717 leader_election.cc:343] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.139993 11717 leader_election.cc:304] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
W20250625 14:02:02.140360 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 680b915f4d574d419a611d05ca2ddcfe consensus state has no leader
I20250625 14:02:02.141971 13352 raft_consensus.cc:491] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.142078 13352 raft_consensus.cc:513] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.142527 13352 leader_election.cc:290] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:02.142971 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95a3fe866e9b42c989192913c25521d9 consensus state has no leader
I20250625 14:02:02.143942 13334 raft_consensus.cc:2747] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.145960 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ed7734f171f4692ba7900844100c878 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:02.120409 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0381b79b702498c8651956dccb37bd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.147642 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "305009f335144f40b8a2dae61edb3801" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:02.147775 11782 raft_consensus.cc:2466] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:02.148176 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "305009f335144f40b8a2dae61edb3801" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.149374 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5479ccdc39ce43c2a2727334235541b5
I20250625 14:02:02.149737 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 5479ccdc39ce43c2a2727334235541b5 deleted and replaced by tablet 9b01f5c2e7314475804cdc7ea0ba0fcd
I20250625 14:02:02.150106 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 5479ccdc39ce43c2a2727334235541b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b01f5c2e7314475804cdc7ea0ba0fcd) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.150282 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 5479ccdc39ce43c2a2727334235541b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b01f5c2e7314475804cdc7ea0ba0fcd) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.150854 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1d596792632e4e32be161450f46b4168" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.151506 11993 leader_election.cc:304] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:02.152027 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 5479ccdc39ce43c2a2727334235541b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b01f5c2e7314475804cdc7ea0ba0fcd) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:02.152081 11990 leader_election.cc:343] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:02.152288 11990 leader_election.cc:343] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: Tablet not RUNNING: STOPPED
I20250625 14:02:02.152349 11990 leader_election.cc:304] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:02:02.152434 11990 raft_consensus.cc:2684] T 1d596792632e4e32be161450f46b4168 P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:02.152539 13334 raft_consensus.cc:491] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.152633 13334 raft_consensus.cc:513] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.153007 13334 leader_election.cc:290] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:02.153621 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7491e070e86346b681817fb19d4608f9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.151788 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c3c339b91e554ca48078afe01a438fd6" } new_table_name: "default.Table_bd001e13c0144ddcbdd8ce1d81d37596" modify_external_catalogs: true
I20250625 14:02:02.154927 13352 raft_consensus.cc:2802] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:02.154989 13352 raft_consensus.cc:491] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:02.155031 13352 raft_consensus.cc:3058] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.156216 13352 raft_consensus.cc:513] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.156602 13352 leader_election.cc:290] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.156963 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7491e070e86346b681817fb19d4608f9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.158703 12177 ts_tablet_manager.cc:1918] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.158842 12177 log.cc:1199] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f0833d0e013f48f78cb6c616481b5dce
I20250625 14:02:02.159163 12177 ts_tablet_manager.cc:1939] T f0833d0e013f48f78cb6c616481b5dce P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.159112 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "305009f335144f40b8a2dae61edb3801" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:02.159575 12177 tablet_replica.cc:331] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.159617 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_062896f53a2645248ce16f4f2f19f506"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.159765 12177 raft_consensus.cc:2241] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.159906 12177 raft_consensus.cc:2270] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:02.160207 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_062896f53a2645248ce16f4f2f19f506 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.160490 12177 ts_tablet_manager.cc:1905] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.162501 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f0833d0e013f48f78cb6c616481b5dce (table default.Table_6d0b9ebb9ed4411394d69c7220244814 [id=f64f7d5b36ce42b39034f4439346303e]) successfully deleted
W20250625 14:02:02.162971 11990 leader_election.cc:343] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:02.163200 11717 leader_election.cc:343] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.163306 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_482a3dd3e80a424e8ffec8e002eeb7e9" } new_table_name: "default.Table_77bef9b021894ec9bb0a928e93c9d2fa" modify_external_catalogs: true
I20250625 14:02:02.163820 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "305009f335144f40b8a2dae61edb3801" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:02.163955 11784 raft_consensus.cc:3058] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.164904 11784 raft_consensus.cc:2466] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:02.165529 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ed7734f171f4692ba7900844100c878 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.168550 12175 tablet_replica.cc:331] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.168571 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 1d596792632e4e32be161450f46b4168 (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
I20250625 14:02:02.168833 12172 tablet_bootstrap.cc:492] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:02.168920 12175 raft_consensus.cc:2241] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.169003 12172 ts_tablet_manager.cc:1397] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.001s
I20250625 14:02:02.169132 12175 raft_consensus.cc:2270] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.169817 12172 raft_consensus.cc:357] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.170043 12172 raft_consensus.cc:383] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.170136 12172 raft_consensus.cc:738] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.170343 12172 consensus_queue.cc:260] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.170568 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]). Expected version 2 got 0
I20250625 14:02:02.172453 13334 raft_consensus.cc:491] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.172549 13334 raft_consensus.cc:513] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:02.172514 13510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250625 14:02:02.172801 13510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250625 14:02:02.172873 13510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250625 14:02:02.172881 13334 leader_election.cc:290] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:02.172922 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9169d58caf8b440abe39fe2b09859d07 consensus state has no leader
I20250625 14:02:02.173781 12172 ts_tablet_manager.cc:1428] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:02:02.174561 12172 tablet_bootstrap.cc:492] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:02.175684 12172 tablet_bootstrap.cc:654] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:02.176169 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e2c23049bc84d968e8cfb1f38c2c57e consensus state has no leader
W20250625 14:02:02.178227 13510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20250625 14:02:02.178252 12166 tablet_bootstrap.cc:492] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.178376 12166 ts_tablet_manager.cc:1397] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
W20250625 14:02:02.178459 13510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250625 14:02:02.178541 13510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250625 14:02:02.178614 13510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250625 14:02:02.178799 11897 tablet_service.cc:1468] Processing CreateTablet for tablet b20ed857212042a090eef437eea0fe15 (DEFAULT_TABLE table=default.Table_9ef72fe56e5d459bb24f90a1299137e8 [id=e575ae1a0dc44770bae255f0fab3f38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.179069 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20ed857212042a090eef437eea0fe15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.179191 12032 tablet_service.cc:1468] Processing CreateTablet for tablet b20ed857212042a090eef437eea0fe15 (DEFAULT_TABLE table=default.Table_9ef72fe56e5d459bb24f90a1299137e8 [id=e575ae1a0dc44770bae255f0fab3f38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.179450 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20ed857212042a090eef437eea0fe15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.179631 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet dce1b63ad2924626972ce7a42a4fdb60 (table default.Table_06e8bc49777a442bbce90e7f4312b059 [id=336fd4d44f664c92b37b98b4f9198459]) successfully deleted
I20250625 14:02:02.179852 12173 tablet_replica.cc:331] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.180001 12173 raft_consensus.cc:2241] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.180097 12173 raft_consensus.cc:2270] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.180788 12173 ts_tablet_manager.cc:1905] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.182158 12166 raft_consensus.cc:357] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.182385 12166 raft_consensus.cc:383] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.182464 12166 raft_consensus.cc:738] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.182664 12166 consensus_queue.cc:260] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.182744 12167 tablet_bootstrap.cc:492] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.182840 12167 ts_tablet_manager.cc:1397] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.135s user 0.002s sys 0.000s
I20250625 14:02:02.183004 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 33c266fa5d664800974626d1774600d3 (DEFAULT_TABLE table=default.Table_56c3d47ef76a41e19975ed30f65d487c [id=82cd5aea3075424b91e4b7fb7c9707a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.183266 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c266fa5d664800974626d1774600d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.183343 12167 raft_consensus.cc:357] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.183442 12167 raft_consensus.cc:383] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.183470 12167 raft_consensus.cc:738] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.183588 12167 consensus_queue.cc:260] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.183892 12167 ts_tablet_manager.cc:1428] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.184054 12167 tablet_bootstrap.cc:492] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.185027 12167 tablet_bootstrap.cc:654] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.185443 12166 ts_tablet_manager.cc:1428] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:02:02.185650 12166 tablet_bootstrap.cc:492] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.187239 12166 tablet_bootstrap.cc:654] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.188218 12173 ts_tablet_manager.cc:1918] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.188295 12173 log.cc:1199] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/67002721ac274619b435e8bf16fc149a
I20250625 14:02:02.188496 12173 ts_tablet_manager.cc:1939] T 67002721ac274619b435e8bf16fc149a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.188627 12175 ts_tablet_manager.cc:1905] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.186226 13510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.39.148:42445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.39.190:38199,127.11.39.189:44065,127.11.39.188:43359
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.39.190:38199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.39.190
--webserver_port=38689
--never_fsync=true
--heap_profile_path=/tmp/kudu.13510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 6d72d4a242076468501f3430b9a2cd050c634be2
build type DEBUG
built by None at 25 Jun 2025 13:43:15 UTC on 24a791456cd2
build id 6762
I20250625 14:02:02.189164 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:02.177496 11717 leader_election.cc:343] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.190248 11717 leader_election.cc:304] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:02.190505 13334 raft_consensus.cc:2747] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.190927 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 67002721ac274619b435e8bf16fc149a (table default.Table_f41c7ed5d5c64d7196b15168dc43ccab [id=41cea1d0aade416ca6b75cbb14127245]) successfully deleted
I20250625 14:02:02.191335 13334 raft_consensus.cc:491] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.191419 13334 raft_consensus.cc:513] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.191772 13334 leader_election.cc:290] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:02.193341 11752 tablet_service.cc:1468] Processing CreateTablet for tablet b20ed857212042a090eef437eea0fe15 (DEFAULT_TABLE table=default.Table_9ef72fe56e5d459bb24f90a1299137e8 [id=e575ae1a0dc44770bae255f0fab3f38d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.193598 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b20ed857212042a090eef437eea0fe15. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.193603 13510 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250625 14:02:02.190914 11993 leader_election.cc:304] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:02.191992 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "674b6cd0ec374505a340cfefb6df63bb" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.192451 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 95a3fe866e9b42c989192913c25521d9 (DEFAULT_TABLE table=default.Table_2c96e22babf24bf2b5e2fe9f7c82da38 [id=5bb7f34ebd0e4c4ea61cd481b20b0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.194623 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a3fe866e9b42c989192913c25521d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.195098 13510 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250625 14:02:02.196591 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 33c266fa5d664800974626d1774600d3 (DEFAULT_TABLE table=default.Table_56c3d47ef76a41e19975ed30f65d487c [id=82cd5aea3075424b91e4b7fb7c9707a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.193701 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 1650a3db682e4391bd1b850dd127f345 (DEFAULT_TABLE table=default.Table_8facc6ed7757492ca9e7c7e7e26726dc [id=ba420514bff242c9834523750f3c2fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.196915 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c266fa5d664800974626d1774600d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.197041 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1650a3db682e4391bd1b850dd127f345. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.197168 13121 raft_consensus.cc:2802] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:02.197244 13121 raft_consensus.cc:695] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:02.197376 13121 consensus_queue.cc:237] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.192085 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "674b6cd0ec374505a340cfefb6df63bb" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.192633 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 95a3fe866e9b42c989192913c25521d9 (DEFAULT_TABLE table=default.Table_2c96e22babf24bf2b5e2fe9f7c82da38 [id=5bb7f34ebd0e4c4ea61cd481b20b0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.199373 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a3fe866e9b42c989192913c25521d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.201530 12175 ts_tablet_manager.cc:1918] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.201610 12175 log.cc:1199] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/a05b09a3225f45db841978b7b9b1fe51
I20250625 14:02:02.202051 12175 ts_tablet_manager.cc:1939] T a05b09a3225f45db841978b7b9b1fe51 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.191175 12173 tablet_replica.cc:331] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.202781 12175 tablet_replica.cc:331] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.202924 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet a05b09a3225f45db841978b7b9b1fe51 (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:02:02.202328 12173 raft_consensus.cc:2241] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:02.204383 12173 pending_rounds.cc:70] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:02.204437 12173 pending_rounds.cc:77] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523059351433216 op_type: NO_OP noop_request { }
I20250625 14:02:02.204507 12173 raft_consensus.cc:2887] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:02.204567 12173 raft_consensus.cc:2270] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.205420 12173 ts_tablet_manager.cc:1905] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.205463 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 1650a3db682e4391bd1b850dd127f345 (DEFAULT_TABLE table=default.Table_8facc6ed7757492ca9e7c7e7e26726dc [id=ba420514bff242c9834523750f3c2fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.205854 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1650a3db682e4391bd1b850dd127f345. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.205791 11532 catalog_manager.cc:5582] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:02.208343 12173 ts_tablet_manager.cc:1918] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:02.208431 12173 log.cc:1199] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a05b09a3225f45db841978b7b9b1fe51
I20250625 14:02:02.208681 12173 ts_tablet_manager.cc:1939] T a05b09a3225f45db841978b7b9b1fe51 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.208985 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 31f843108ecf440090c05255afa1687e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.209650 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4f651f79ee034dd28e44092b7de29bf3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.209708 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a05b09a3225f45db841978b7b9b1fe51 (table default.Table_5a6cb21f6391471fad9ad3a56e283930 [id=6bfd01cfaea147a5bba5a784fd16c862]) successfully deleted
I20250625 14:02:02.209936 12173 tablet_replica.cc:331] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:02:02.210245 11717 leader_election.cc:343] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.210342 12173 raft_consensus.cc:2241] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.210515 12173 raft_consensus.cc:2270] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.210842 13535 tablet.cc:1722] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:02.211418 12173 ts_tablet_manager.cc:1905] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:02.211573 11717 leader_election.cc:343] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.211644 11717 leader_election.cc:304] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:02.211769 13334 raft_consensus.cc:2747] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.214018 12173 ts_tablet_manager.cc:1918] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.214089 12173 log.cc:1199] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/fa2ccf77288144e5b81513dede9d4302
I20250625 14:02:02.214287 12173 ts_tablet_manager.cc:1939] T fa2ccf77288144e5b81513dede9d4302 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.215370 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet fa2ccf77288144e5b81513dede9d4302 (table default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]) successfully deleted
I20250625 14:02:02.215600 12173 tablet_replica.cc:331] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.215728 12173 raft_consensus.cc:2241] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.215830 12173 raft_consensus.cc:2270] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.216182 12173 ts_tablet_manager.cc:1905] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.218086 13531 tablet.cc:1722] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.219184 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 33c266fa5d664800974626d1774600d3 (DEFAULT_TABLE table=default.Table_56c3d47ef76a41e19975ed30f65d487c [id=82cd5aea3075424b91e4b7fb7c9707a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.219461 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c266fa5d664800974626d1774600d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.220543 12173 ts_tablet_manager.cc:1918] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.220618 12173 log.cc:1199] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/3c825977e422407486587f28af36bd68
I20250625 14:02:02.220888 12173 ts_tablet_manager.cc:1939] T 3c825977e422407486587f28af36bd68 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.221568 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 3c825977e422407486587f28af36bd68 (table default.Table_2928b645415547419a21192f44ad81ab [id=c7bfff2cc8b84a5d83719cd96bc5af9c]) successfully deleted
W20250625 14:02:02.221791 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 806e5502a95e4a0396c008267e16f2d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 806e5502a95e4a0396c008267e16f2d5 already in progress: creating tablet
I20250625 14:02:02.221680 12173 tablet_replica.cc:331] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.222003 12173 raft_consensus.cc:2241] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.222126 12173 raft_consensus.cc:2270] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.222173 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]). Expected version 2 got 0
I20250625 14:02:02.222564 12173 ts_tablet_manager.cc:1905] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.222849 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bd22422f2a084b93bfa750b1ac6b7ce9" } modify_external_catalogs: true
I20250625 14:02:02.222973 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bd22422f2a084b93bfa750b1ac6b7ce9" } modify_external_catalogs: true
I20250625 14:02:02.224889 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 95a3fe866e9b42c989192913c25521d9 (DEFAULT_TABLE table=default.Table_2c96e22babf24bf2b5e2fe9f7c82da38 [id=5bb7f34ebd0e4c4ea61cd481b20b0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.225374 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a3fe866e9b42c989192913c25521d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.226760 12173 ts_tablet_manager.cc:1918] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.226852 12173 log.cc:1199] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/49c8487f502b4f5299387daa9e89604b
I20250625 14:02:02.227157 12173 ts_tablet_manager.cc:1939] T 49c8487f502b4f5299387daa9e89604b P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.227833 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]) successfully deleted
I20250625 14:02:02.227927 12173 tablet_replica.cc:331] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.228078 12173 raft_consensus.cc:2241] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.228212 12173 raft_consensus.cc:2270] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.228603 12173 ts_tablet_manager.cc:1905] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.230908 12173 ts_tablet_manager.cc:1918] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:02.231001 12173 log.cc:1199] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/bb1d6934ab98482c9ae6b6cafc1ee9a6
I20250625 14:02:02.231266 12173 ts_tablet_manager.cc:1939] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.232426 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 (table default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]) successfully deleted
W20250625 14:02:02.232887 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f2f25aaee07242329014de1834ca881d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f25aaee07242329014de1834ca881d already in progress: creating tablet
I20250625 14:02:02.233093 12173 tablet_replica.cc:331] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.233233 12173 raft_consensus.cc:2241] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.233356 12173 raft_consensus.cc:2270] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.233544 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2142455242ee42d5820deea5646c9bc2" } modify_external_catalogs: true
I20250625 14:02:02.233672 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2142455242ee42d5820deea5646c9bc2" } modify_external_catalogs: true
I20250625 14:02:02.233973 12173 ts_tablet_manager.cc:1905] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.234678 11531 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet e4f6162501ab432699bc258b73fc4744
I20250625 14:02:02.236187 12173 ts_tablet_manager.cc:1918] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.236248 12173 log.cc:1199] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7b817bda69f44497a6787d1d649ef5e9
I20250625 14:02:02.236474 12173 ts_tablet_manager.cc:1939] T 7b817bda69f44497a6787d1d649ef5e9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.236783 11532 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_20ecabab91ef4823a1c5d7bebb38f37e [id=f25d25a79da644d082f3ae135c27f354] alter complete (version 3)
I20250625 14:02:02.237150 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f] alter complete (version 2)
I20250625 14:02:02.238376 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]) successfully deleted
W20250625 14:02:02.238662 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5479ccdc39ce43c2a2727334235541b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5479ccdc39ce43c2a2727334235541b5 already in progress: creating tablet
I20250625 14:02:02.239246 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5df4b218df7d4e4e9e634d3cd4f17633
W20250625 14:02:02.239264 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4ed7734f171f4692ba7900844100c878 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ed7734f171f4692ba7900844100c878 already in progress: creating tablet
I20250625 14:02:02.239701 12173 tablet_replica.cc:331] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.239854 12173 raft_consensus.cc:2241] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.239982 12173 raft_consensus.cc:2270] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.240285 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 5df4b218df7d4e4e9e634d3cd4f17633 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.240442 12173 ts_tablet_manager.cc:1905] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.242272 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 (DEFAULT_TABLE table=default.Table_ee3d8927b7f94271bacd0a22d5855829 [id=e6863bc4893c45108e21256845b24f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.242476 12032 tablet_service.cc:1468] Processing CreateTablet for tablet d18d21ef2b9f4cb79bc3ed0bbf15634f (DEFAULT_TABLE table=default.Table_cca9bd4d43014ac7851d0e0e7c2fa004 [id=e4145a60589145f388ced78347c9ce61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.242622 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.245447 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 68bf875082ce41e39093536bedf0333d (DEFAULT_TABLE table=default.Table_3822190b351d490d9f98f42c7e7d6682 [id=53b9018326d3470a9671a9bd0ad94960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.245682 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bf875082ce41e39093536bedf0333d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.246492 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 46ecb994203f4405bb5af10b73fc97eb (DEFAULT_TABLE table=default.Table_d30fe5011e444ef3b51d36d17b6de02c [id=9cfec4cbb8be4db1885fe96cc1d33946]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.246696 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 66686457cf494eeabc1d3998fc66d4f5 (DEFAULT_TABLE table=default.Table_89344a3eb7f34bc19ce8bc0bbda9de06 [id=067c62d5b31c40a6ae288dd1e1b105d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.246752 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ecb994203f4405bb5af10b73fc97eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.246912 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66686457cf494eeabc1d3998fc66d4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.248646 12173 ts_tablet_manager.cc:1918] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.248780 12173 log.cc:1199] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/128dab7ad46048cc91fc20ddc1431d57
I20250625 14:02:02.249074 12173 ts_tablet_manager.cc:1939] T 128dab7ad46048cc91fc20ddc1431d57 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.249470 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 4e95e6f8df9c4883b3a19f8741ecb431 (DEFAULT_TABLE table=default.Table_76a7265ba1494e4f8aca832908235167 [id=934491a0f44843b3b11c0be0efa2473e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.249559 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 (DEFAULT_TABLE table=default.Table_a89682235f934b91a058bfd43e3b54b2 [id=348b0c0615ca4427a8ddfb32ea067cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.249742 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e95e6f8df9c4883b3a19f8741ecb431. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.249861 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7376f9dc4c8d4ed0a539eceead2a9a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.249886 12167 tablet_bootstrap.cc:492] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.249971 12167 ts_tablet_manager.cc:1397] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.000s
I20250625 14:02:02.250530 12167 raft_consensus.cc:357] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.250634 12167 raft_consensus.cc:383] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.250684 12167 raft_consensus.cc:738] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.250792 12167 consensus_queue.cc:260] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.251044 12167 ts_tablet_manager.cc:1428] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.251250 12167 tablet_bootstrap.cc:492] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.252414 12167 tablet_bootstrap.cc:654] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.252473 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 8d600a46fc1c4a6194368f3cd8681364 (DEFAULT_TABLE table=default.Table_6826e63ce5054cbea665e81b978621cf [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.252707 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d600a46fc1c4a6194368f3cd8681364. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.252930 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet d185c7be82b04fe2a30626a6fb082219 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.254917 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.257193 12173 tablet_replica.cc:331] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.257340 12173 raft_consensus.cc:2241] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.257445 12173 raft_consensus.cc:2270] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.258092 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 128dab7ad46048cc91fc20ddc1431d57 (table default.Table_712e366118ea4a03a6e8a0f811b4a27d [id=da18d76cf3bc4ae79e0b3a779454d907]) successfully deleted
W20250625 14:02:02.258255 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5df4b218df7d4e4e9e634d3cd4f17633 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5df4b218df7d4e4e9e634d3cd4f17633 already in progress: creating tablet
I20250625 14:02:02.259521 12173 ts_tablet_manager.cc:1905] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:02.260730 11717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.39.131:34921, user_credentials={real_user=slave}} blocked reactor thread for 49156.5us
I20250625 14:02:02.261059 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d18d21ef2b9f4cb79bc3ed0bbf15634f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:02.261294 11717 leader_election.cc:343] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.262454 12173 ts_tablet_manager.cc:1918] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.262527 12173 log.cc:1199] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b3819dec2c834c40846dcb3a11fa4f5f
I20250625 14:02:02.262738 12173 ts_tablet_manager.cc:1939] T b3819dec2c834c40846dcb3a11fa4f5f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.263371 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b3819dec2c834c40846dcb3a11fa4f5f (table default.Table_2037e3cc66de4c68bc580a95e021e860 [id=46617722da444cc58422a5ce1d383cb0]) successfully deleted
I20250625 14:02:02.263569 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ec61af86da054876a97a43f9e1e13a61" } new_table_name: "default.Table_5b6808ffcf1a4ed48bdf3cc3764595cc" modify_external_catalogs: true
I20250625 14:02:02.264709 13334 raft_consensus.cc:491] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.264753 13531 tablet.cc:1722] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:02.264801 13334 raft_consensus.cc:513] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.265075 11760 tablet_service.cc:1468] Processing CreateTablet for tablet d18d21ef2b9f4cb79bc3ed0bbf15634f (DEFAULT_TABLE table=default.Table_cca9bd4d43014ac7851d0e0e7c2fa004 [id=e4145a60589145f388ced78347c9ce61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.265146 13334 leader_election.cc:290] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:02.265355 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d18d21ef2b9f4cb79bc3ed0bbf15634f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.267918 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 (DEFAULT_TABLE table=default.Table_ee3d8927b7f94271bacd0a22d5855829 [id=e6863bc4893c45108e21256845b24f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.267918 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 46ecb994203f4405bb5af10b73fc97eb (DEFAULT_TABLE table=default.Table_d30fe5011e444ef3b51d36d17b6de02c [id=9cfec4cbb8be4db1885fe96cc1d33946]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.268241 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ecb994203f4405bb5af10b73fc97eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.270426 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.272732 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 66686457cf494eeabc1d3998fc66d4f5 (DEFAULT_TABLE table=default.Table_89344a3eb7f34bc19ce8bc0bbda9de06 [id=067c62d5b31c40a6ae288dd1e1b105d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.273058 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66686457cf494eeabc1d3998fc66d4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.273047 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2bf4e247b26749488956b3c0a2ad649e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.273459 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bf4e247b26749488956b3c0a2ad649e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.274750 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ee1a7cdb917147a79756089dee89d7d0" } modify_external_catalogs: true
I20250625 14:02:02.274852 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ee1a7cdb917147a79756089dee89d7d0" } modify_external_catalogs: true
I20250625 14:02:02.272732 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 68bf875082ce41e39093536bedf0333d (DEFAULT_TABLE table=default.Table_3822190b351d490d9f98f42c7e7d6682 [id=53b9018326d3470a9671a9bd0ad94960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.275647 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bf875082ce41e39093536bedf0333d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.280406 11532 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 6639b14976fa45758387c14addfd8cfb
I20250625 14:02:02.292083 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_86567b1d77d54cc5a0753ec84c8fa098"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.292363 12177 ts_tablet_manager.cc:1918] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.292428 12177 log.cc:1199] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/628edde0bd0840c6a11c79f8ab810977
W20250625 14:02:02.292548 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86567b1d77d54cc5a0753ec84c8fa098 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.292585 12177 ts_tablet_manager.cc:1939] T 628edde0bd0840c6a11c79f8ab810977 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.292969 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 5df4b218df7d4e4e9e634d3cd4f17633 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.294582 12172 tablet_bootstrap.cc:492] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:02.294689 12172 ts_tablet_manager.cc:1397] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.121s user 0.002s sys 0.000s
I20250625 14:02:02.192741 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 1650a3db682e4391bd1b850dd127f345 (DEFAULT_TABLE table=default.Table_8facc6ed7757492ca9e7c7e7e26726dc [id=ba420514bff242c9834523750f3c2fdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.295006 12175 raft_consensus.cc:2241] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.295140 12175 raft_consensus.cc:2270] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.295194 12172 raft_consensus.cc:357] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.295296 12172 raft_consensus.cc:383] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.295328 12172 raft_consensus.cc:738] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.295454 12172 consensus_queue.cc:260] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.295559 12175 ts_tablet_manager.cc:1905] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.295751 12172 ts_tablet_manager.cc:1428] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.295956 12172 tablet_bootstrap.cc:492] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:02.206897 11896 tablet_service.cc:1515] Processing DeleteTablet for tablet dce1b63ad2924626972ce7a42a4fdb60 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.296339 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1650a3db682e4391bd1b850dd127f345. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.210178 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4f651f79ee034dd28e44092b7de29bf3" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.297803 12172 tablet_bootstrap.cc:654] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.298084 12175 ts_tablet_manager.cc:1918] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.298163 12175 log.cc:1199] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/49c8487f502b4f5299387daa9e89604b
I20250625 14:02:02.218438 13532 tablet.cc:1722] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.231561 12166 tablet_bootstrap.cc:492] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.238128 11900 tablet_service.cc:1468] Processing CreateTablet for tablet d18d21ef2b9f4cb79bc3ed0bbf15634f (DEFAULT_TABLE table=default.Table_cca9bd4d43014ac7851d0e0e7c2fa004 [id=e4145a60589145f388ced78347c9ce61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.239756 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 5df4b218df7d4e4e9e634d3cd4f17633 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.241945 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 (DEFAULT_TABLE table=default.Table_ee3d8927b7f94271bacd0a22d5855829 [id=e6863bc4893c45108e21256845b24f36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.242909 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 46ecb994203f4405bb5af10b73fc97eb (DEFAULT_TABLE table=default.Table_d30fe5011e444ef3b51d36d17b6de02c [id=9cfec4cbb8be4db1885fe96cc1d33946]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.244951 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 68bf875082ce41e39093536bedf0333d (DEFAULT_TABLE table=default.Table_3822190b351d490d9f98f42c7e7d6682 [id=53b9018326d3470a9671a9bd0ad94960]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.245882 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 66686457cf494eeabc1d3998fc66d4f5 (DEFAULT_TABLE table=default.Table_89344a3eb7f34bc19ce8bc0bbda9de06 [id=067c62d5b31c40a6ae288dd1e1b105d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.249099 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 4e95e6f8df9c4883b3a19f8741ecb431 (DEFAULT_TABLE table=default.Table_76a7265ba1494e4f8aca832908235167 [id=934491a0f44843b3b11c0be0efa2473e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.253412 11889 tablet_service.cc:1468] Processing CreateTablet for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 (DEFAULT_TABLE table=default.Table_a89682235f934b91a058bfd43e3b54b2 [id=348b0c0615ca4427a8ddfb32ea067cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.253777 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 8d600a46fc1c4a6194368f3cd8681364 (DEFAULT_TABLE table=default.Table_6826e63ce5054cbea665e81b978621cf [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.264416 13530 tablet.cc:1722] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:02.290732 11915 raft_consensus.cc:3058] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.299500 12166 ts_tablet_manager.cc:1397] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.000s
I20250625 14:02:02.300359 12166 raft_consensus.cc:357] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.300529 12166 raft_consensus.cc:383] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.300575 12166 raft_consensus.cc:738] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.300794 12166 consensus_queue.cc:260] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.301314 12166 ts_tablet_manager.cc:1428] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:02.301807 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 4e95e6f8df9c4883b3a19f8741ecb431 (DEFAULT_TABLE table=default.Table_76a7265ba1494e4f8aca832908235167 [id=934491a0f44843b3b11c0be0efa2473e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.302726 13121 consensus_queue.cc:1035] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:02.304502 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e95e6f8df9c4883b3a19f8741ecb431. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.305612 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.305732 12177 tablet_replica.cc:331] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.305876 12177 raft_consensus.cc:2241] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.305975 12177 raft_consensus.cc:2270] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.307639 12177 ts_tablet_manager.cc:1905] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.307821 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68bf875082ce41e39093536bedf0333d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.308012 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e95e6f8df9c4883b3a19f8741ecb431. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.309919 12177 ts_tablet_manager.cc:1918] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.309998 12177 log.cc:1199] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7491e070e86346b681817fb19d4608f9
I20250625 14:02:02.310122 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7376f9dc4c8d4ed0a539eceead2a9a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.310243 12177 ts_tablet_manager.cc:1939] T 7491e070e86346b681817fb19d4608f9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.310755 12177 tablet_replica.cc:331] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.310890 12177 raft_consensus.cc:2241] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.311008 12177 raft_consensus.cc:2270] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.311431 12177 ts_tablet_manager.cc:1905] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.312567 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66686457cf494eeabc1d3998fc66d4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.313256 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9c3797c29c8749c0bc57daae5224dcab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.313509 12177 ts_tablet_manager.cc:1918] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.313575 12177 log.cc:1199] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/3c825977e422407486587f28af36bd68
W20250625 14:02:02.313725 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c3797c29c8749c0bc57daae5224dcab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.313848 12177 ts_tablet_manager.cc:1939] T 3c825977e422407486587f28af36bd68 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.314175 12177 tablet_replica.cc:331] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.314373 12177 raft_consensus.cc:2241] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:02.315021 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3f37b24906cb4ba7bd48f8b157211686"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.315407 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f37b24906cb4ba7bd48f8b157211686 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.315589 12177 raft_consensus.cc:2270] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.315830 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 (DEFAULT_TABLE table=default.Table_a89682235f934b91a058bfd43e3b54b2 [id=348b0c0615ca4427a8ddfb32ea067cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.315847 11760 tablet_service.cc:1468] Processing CreateTablet for tablet 8d600a46fc1c4a6194368f3cd8681364 (DEFAULT_TABLE table=default.Table_6826e63ce5054cbea665e81b978621cf [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.316033 12177 ts_tablet_manager.cc:1905] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.316092 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7376f9dc4c8d4ed0a539eceead2a9a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.317607 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d600a46fc1c4a6194368f3cd8681364. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.319348 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ecb994203f4405bb5af10b73fc97eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.321461 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d18d21ef2b9f4cb79bc3ed0bbf15634f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.321568 12166 tablet_bootstrap.cc:492] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.321681 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d600a46fc1c4a6194368f3cd8681364. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.323680 12166 tablet_bootstrap.cc:654] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.324237 12265 raft_consensus.cc:491] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.324321 12265 raft_consensus.cc:513] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.324635 12265 leader_election.cc:290] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:02.325281 11855 leader_election.cc:343] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: dce1b63ad2924626972ce7a42a4fdb60
W20250625 14:02:02.325608 11858 leader_election.cc:343] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: dce1b63ad2924626972ce7a42a4fdb60
I20250625 14:02:02.325671 11858 leader_election.cc:304] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:02.325912 12167 tablet_bootstrap.cc:492] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.326005 12167 ts_tablet_manager.cc:1397] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.000s
I20250625 14:02:02.326566 12167 raft_consensus.cc:357] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.326682 12167 raft_consensus.cc:383] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.326728 12167 raft_consensus.cc:738] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.326918 12177 ts_tablet_manager.cc:1918] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.326895 12167 consensus_queue.cc:260] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.326983 12177 log.cc:1199] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/49c8487f502b4f5299387daa9e89604b
I20250625 14:02:02.327199 12167 ts_tablet_manager.cc:1428] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.327394 12167 tablet_bootstrap.cc:492] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.328413 12167 tablet_bootstrap.cc:654] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.330206 12177 ts_tablet_manager.cc:1939] T 49c8487f502b4f5299387daa9e89604b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.330191 13535 tablet.cc:1722] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.330485 12265 raft_consensus.cc:2747] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.332834 12177 tablet_replica.cc:331] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.332989 12177 raft_consensus.cc:2241] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.333093 12177 raft_consensus.cc:2270] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.333595 12177 ts_tablet_manager.cc:1905] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:02.333945 11717 leader_election.cc:343] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.334017 11717 leader_election.cc:304] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
W20250625 14:02:02.334086 11717 raft_consensus.cc:2684] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:02.334540 12265 raft_consensus.cc:491] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.334646 12265 raft_consensus.cc:513] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:02.335036 12265 leader_election.cc:290] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.335237 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "268638793ff44216aa0663b0a3568940" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.335484 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9bcb6255870b4c80b484ff12bcfdca06" } modify_external_catalogs: true
I20250625 14:02:02.335546 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 628edde0bd0840c6a11c79f8ab810977 (table default.Table_522af79c54de47dca6f8f5b92399167d [id=f71426341d4c4fe0bd0342ea293e0110]) successfully deleted
I20250625 14:02:02.335610 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9bcb6255870b4c80b484ff12bcfdca06" } modify_external_catalogs: true
I20250625 14:02:02.335958 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "268638793ff44216aa0663b0a3568940" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:02.336010 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c6f1447498b74f3985cd2b3ef83f3ba6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6f1447498b74f3985cd2b3ef83f3ba6 already in progress: creating tablet
W20250625 14:02:02.336149 11858 leader_election.cc:343] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: fa2ccf77288144e5b81513dede9d4302
I20250625 14:02:02.336401 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7491e070e86346b681817fb19d4608f9 (table default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]) successfully deleted
W20250625 14:02:02.336632 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 806e5502a95e4a0396c008267e16f2d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 806e5502a95e4a0396c008267e16f2d5 already in progress: creating tablet
W20250625 14:02:02.336807 11855 leader_election.cc:343] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: fa2ccf77288144e5b81513dede9d4302
I20250625 14:02:02.336861 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 3c825977e422407486587f28af36bd68 (table default.Table_2928b645415547419a21192f44ad81ab [id=c7bfff2cc8b84a5d83719cd96bc5af9c]) successfully deleted
I20250625 14:02:02.336872 11855 leader_election.cc:304] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:02.337356 12558 raft_consensus.cc:2747] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.337631 13121 consensus_queue.cc:1035] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:02.338276 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]) successfully deleted
I20250625 14:02:02.339799 12177 ts_tablet_manager.cc:1918] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.339882 12177 log.cc:1199] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/4f651f79ee034dd28e44092b7de29bf3
I20250625 14:02:02.340121 12177 ts_tablet_manager.cc:1939] T 4f651f79ee034dd28e44092b7de29bf3 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:02:02.340257 11717 leader_election.cc:343] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:02.340382 11717 consensus_peers.cc:487] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb1d6934ab98482c9ae6b6cafc1ee9a6. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:02.340788 13532 tablet.cc:1722] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.340859 12166 tablet_bootstrap.cc:492] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.340946 12166 ts_tablet_manager.cc:1397] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:02:02.341445 12166 raft_consensus.cc:357] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.341548 12166 raft_consensus.cc:383] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.341586 12166 raft_consensus.cc:738] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:02:02.341565 11717 leader_election.cc:343] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.341629 11717 leader_election.cc:304] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:02.341696 12166 consensus_queue.cc:260] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.341742 13334 raft_consensus.cc:2747] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.341991 12166 ts_tablet_manager.cc:1428] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.342581 12166 tablet_bootstrap.cc:492] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.344941 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_05ba0d7a47814bd5b9443c9db8a32e6e" } new_table_name: "default.Table_a637b1b8c18a4d4a8fff61533730f0bd" modify_external_catalogs: true
I20250625 14:02:02.345187 12166 tablet_bootstrap.cc:654] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.345834 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2d83ef3351a4455fb0f4e370455cff01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.346179 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d83ef3351a4455fb0f4e370455cff01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.347200 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5b206d37132d4b99ba7dfe7bedef7677"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.347550 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b206d37132d4b99ba7dfe7bedef7677 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.347587 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f8c95bb7ee4a4466bccff25a7d276647" } modify_external_catalogs: true
I20250625 14:02:02.347666 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f8c95bb7ee4a4466bccff25a7d276647" } modify_external_catalogs: true
I20250625 14:02:02.349014 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4bbb7716799d4e6ba7c3a2d874b9ffe3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.349294 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bbb7716799d4e6ba7c3a2d874b9ffe3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:02.350804 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1b9e127f181474fa1571efd76a99536 consensus state has no leader
I20250625 14:02:02.351145 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_34dc11525e5c4255b2b2d4d9642807fd" } new_table_name: "default.Table_0483304fa1984d9598abfa11f4fbc472" modify_external_catalogs: true
I20250625 14:02:02.352484 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 4fd2ee633d464f7c8be1f06da7be0c70 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.354925 12166 tablet_bootstrap.cc:492] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.355026 12166 ts_tablet_manager.cc:1397] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:02.355593 12166 raft_consensus.cc:357] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.355707 12166 raft_consensus.cc:383] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.355743 12166 raft_consensus.cc:738] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.355756 13535 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 8
I20250625 14:02:02.355871 12166 consensus_queue.cc:260] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.356158 12166 ts_tablet_manager.cc:1428] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.356380 12166 tablet_bootstrap.cc:492] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.357511 12166 tablet_bootstrap.cc:654] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.357558 13532 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 8
I20250625 14:02:02.359369 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet df475b9c0f62419a9df86d4e0097dcba with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.355031 12175 ts_tablet_manager.cc:1939] T 49c8487f502b4f5299387daa9e89604b P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:02:02.360913 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01df2302397e41f882ea3578fe6351b1 consensus state has no leader
I20250625 14:02:02.362443 12166 tablet_bootstrap.cc:492] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.362548 12166 ts_tablet_manager.cc:1397] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:02:02.363006 12166 raft_consensus.cc:357] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.363132 12166 raft_consensus.cc:383] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.363178 12166 raft_consensus.cc:738] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.363307 12166 consensus_queue.cc:260] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.363593 12166 ts_tablet_manager.cc:1428] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.364580 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_23ec95f4e53c487fa735d0e9c7a5b3f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.364604 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a77f086339a047d5b0d22505879b5451"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.365061 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a77f086339a047d5b0d22505879b5451 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:02.365070 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23ec95f4e53c487fa735d0e9c7a5b3f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.367807 12177 tablet_replica.cc:331] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.367988 12177 raft_consensus.cc:2241] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:02.368175 12177 raft_consensus.cc:2270] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.368269 12166 tablet_bootstrap.cc:492] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.368777 12177 ts_tablet_manager.cc:1905] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.369498 12166 tablet_bootstrap.cc:654] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.372303 12177 ts_tablet_manager.cc:1918] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.372388 12177 log.cc:1199] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7b817bda69f44497a6787d1d649ef5e9
I20250625 14:02:02.372645 12177 ts_tablet_manager.cc:1939] T 7b817bda69f44497a6787d1d649ef5e9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.372985 12177 tablet_replica.cc:331] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.373124 12177 raft_consensus.cc:2241] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:02.373333 12177 raft_consensus.cc:2270] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.373867 12177 ts_tablet_manager.cc:1905] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.376252 12177 ts_tablet_manager.cc:1918] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:02.376327 12177 log.cc:1199] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/bb1d6934ab98482c9ae6b6cafc1ee9a6
I20250625 14:02:02.376577 12177 ts_tablet_manager.cc:1939] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.377817 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_5b6808ffcf1a4ed48bdf3cc3764595cc [id=05ba3fb82ea74715a67dbefb3018db83] alter complete (version 8)
I20250625 14:02:02.378252 12177 tablet_replica.cc:331] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.378412 12177 raft_consensus.cc:2241] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.378525 12177 raft_consensus.cc:2270] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.378268 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6669033348ee4fa6bce045320700534b" } new_table_name: "default.Table_973a04f557e94354bc87ff6469e5118f" modify_external_catalogs: true
I20250625 14:02:02.378803 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet dff05950ded34f4bb554badc4ccd3e0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.379216 12177 ts_tablet_manager.cc:1905] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.379516 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 6c8c667108694caab967bd91f74759b6 with delete_type TABLET_DATA_DELETED (replaced by tablet cbe2dcd1fb924dcba5c12aaa8e141435) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.379920 12175 tablet_replica.cc:331] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.379984 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 49c8487f502b4f5299387daa9e89604b (table default.Table_c5fc0aa2943e4b898dcfc8023dd0e15a [id=34fbaa73d2f1419384ee51b9dffb33f1]) successfully deleted
I20250625 14:02:02.380039 12175 raft_consensus.cc:2241] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.380131 12175 raft_consensus.cc:2270] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.380489 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet c6f1447498b74f3985cd2b3ef83f3ba6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.381376 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_56c3d47ef76a41e19975ed30f65d487c" } new_table_name: "default.Table_7040ae906f094ab29ddcdfed0c016e2a" modify_external_catalogs: true
I20250625 14:02:02.381956 12177 ts_tablet_manager.cc:1918] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.382033 12177 log.cc:1199] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/12c5e71b4a4f4efc81f822bdf95d0f99
I20250625 14:02:02.382251 12177 ts_tablet_manager.cc:1939] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.382484 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 4f651f79ee034dd28e44092b7de29bf3 (table default.Table_c055b1e8e56d4bd595e2312996eb6b5e [id=45522461146c457ebfe600569a8c8524]) successfully deleted
I20250625 14:02:02.382565 12175 ts_tablet_manager.cc:1905] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.382822 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]) successfully deleted
I20250625 14:02:02.382772 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d5328e63328444649fb3a4b665d3a222"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.383052 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 (table default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]) successfully deleted
W20250625 14:02:02.383194 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5328e63328444649fb3a4b665d3a222 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:02.383458 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f2f25aaee07242329014de1834ca881d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f25aaee07242329014de1834ca881d already in progress: creating tablet
W20250625 14:02:02.383690 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4ed7734f171f4692ba7900844100c878 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ed7734f171f4692ba7900844100c878 already in progress: creating tablet
W20250625 14:02:02.383926 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 5479ccdc39ce43c2a2727334235541b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5479ccdc39ce43c2a2727334235541b5 already in progress: creating tablet
W20250625 14:02:02.386883 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4 consensus state has no leader
W20250625 14:02:02.389761 13591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250625 14:02:02.390024 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33c266fa5d664800974626d1774600d3 consensus state has no leader
W20250625 14:02:02.390230 13590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:02:02.398005 11898 tablet_service.cc:1468] Processing CreateTablet for tablet bd284833ec6d41d5970227e3c36bebaf (DEFAULT_TABLE table=default.Table_fe2254af415a4926ac7969b5478c2c1a [id=2cf0ee62850b42ceb3ed3dc644f495f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.398243 12028 tablet_service.cc:1468] Processing CreateTablet for tablet a7d87f5ca2f74eaeae12f1a6b533c12c (DEFAULT_TABLE table=default.Table_992ed60a855e433995e83e54f5f7d7db [id=4b6ca272e844442db3e8cda112fae525]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.398411 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd284833ec6d41d5970227e3c36bebaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.398402 12032 tablet_service.cc:1468] Processing CreateTablet for tablet d993663af84942abb059dec1712396d1 (DEFAULT_TABLE table=default.Table_062896f53a2645248ce16f4f2f19f506 [id=7aed99532d7f45359ab37081248b648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.398516 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d87f5ca2f74eaeae12f1a6b533c12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.398669 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d993663af84942abb059dec1712396d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.400913 11902 tablet_service.cc:1468] Processing CreateTablet for tablet a7d87f5ca2f74eaeae12f1a6b533c12c (DEFAULT_TABLE table=default.Table_992ed60a855e433995e83e54f5f7d7db [id=4b6ca272e844442db3e8cda112fae525]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.401052 12021 tablet_service.cc:1468] Processing CreateTablet for tablet bd284833ec6d41d5970227e3c36bebaf (DEFAULT_TABLE table=default.Table_fe2254af415a4926ac7969b5478c2c1a [id=2cf0ee62850b42ceb3ed3dc644f495f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.401180 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d87f5ca2f74eaeae12f1a6b533c12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.401306 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd284833ec6d41d5970227e3c36bebaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.398027 11900 tablet_service.cc:1468] Processing CreateTablet for tablet d993663af84942abb059dec1712396d1 (DEFAULT_TABLE table=default.Table_062896f53a2645248ce16f4f2f19f506 [id=7aed99532d7f45359ab37081248b648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.402601 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d993663af84942abb059dec1712396d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.403048 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd (DEFAULT_TABLE table=default.Table_cedbc8ae8dab416789f47248c6ebfcbb [id=b79f84879db54e1ca2919c58cfcf8bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.403270 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.403375 12034 tablet_service.cc:1468] Processing CreateTablet for tablet c220c2fab2fb4628bd7ecf0cfc9d4a57 (DEFAULT_TABLE table=default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.403580 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c220c2fab2fb4628bd7ecf0cfc9d4a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.404803 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 6d854092f68a4665b29ebc281a032d5d (DEFAULT_TABLE table=default.Table_9bbdb0114e0245cd9d194c455a61b97b [id=18389c62f0c3442caeba77ad47486760]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.405035 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d854092f68a4665b29ebc281a032d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.405398 12027 tablet_service.cc:1468] Processing CreateTablet for tablet e83f77c487d948ceabb6c43366cc7154 (DEFAULT_TABLE table=default.Table_9dc0f8c5c2384df382588ecd2cce8840 [id=8ffdfb72d3624bec8d7f5d3e3dfb3c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.405586 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83f77c487d948ceabb6c43366cc7154. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.406211 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 08b3ba59f0374c6199cd470d136c59ee (DEFAULT_TABLE table=default.Table_16248c1613424ffabcdbfd0173d5678b [id=61ec0a905c47494993d61449ae285e91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.406513 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b3ba59f0374c6199cd470d136c59ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.408533 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 6d854092f68a4665b29ebc281a032d5d (DEFAULT_TABLE table=default.Table_9bbdb0114e0245cd9d194c455a61b97b [id=18389c62f0c3442caeba77ad47486760]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.408589 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 08b3ba59f0374c6199cd470d136c59ee (DEFAULT_TABLE table=default.Table_16248c1613424ffabcdbfd0173d5678b [id=61ec0a905c47494993d61449ae285e91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.408367 11902 tablet_service.cc:1468] Processing CreateTablet for tablet cc01d6d227254da4907eefe5e229e3a9 (DEFAULT_TABLE table=default.Table_6b666076abf941a583399f3a072c302d [id=d3cb6e0f77b14f24b6ce9f7d2dc749a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.408792 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d854092f68a4665b29ebc281a032d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.408968 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc01d6d227254da4907eefe5e229e3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.409050 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 114d0f7ab39348cf9e358c403b5ade10 (DEFAULT_TABLE table=default.Table_e0381b79b702498c8651956dccb37bd7 [id=a52beef85a2a48ebb3135fe7ea0c9ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.409165 11889 tablet_service.cc:1468] Processing CreateTablet for tablet c220c2fab2fb4628bd7ecf0cfc9d4a57 (DEFAULT_TABLE table=default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.409288 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114d0f7ab39348cf9e358c403b5ade10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.409358 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c220c2fab2fb4628bd7ecf0cfc9d4a57. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:02.409960 11517 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4 (table default.Table_973a04f557e94354bc87ff6469e5118f [id=5e8ec1bbbe4c4b3ba7d22d5907942c58], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0a539ba0c9ff472eb5d1f576f6fcf7c4 consensus state has no leader
I20250625 14:02:02.410413 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b3ba59f0374c6199cd470d136c59ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.410826 12028 tablet_service.cc:1468] Processing CreateTablet for tablet c68e055191704da8862b0fe6b30bfcfc (DEFAULT_TABLE table=default.Table_463848d52fef45a891bce13d122d7ee0 [id=686819fb676b4aa484ef5d51464f7bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.411032 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68e055191704da8862b0fe6b30bfcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.411408 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 114d0f7ab39348cf9e358c403b5ade10 (DEFAULT_TABLE table=default.Table_e0381b79b702498c8651956dccb37bd7 [id=a52beef85a2a48ebb3135fe7ea0c9ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.411607 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114d0f7ab39348cf9e358c403b5ade10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.412532 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd (DEFAULT_TABLE table=default.Table_cedbc8ae8dab416789f47248c6ebfcbb [id=b79f84879db54e1ca2919c58cfcf8bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.412734 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.413865 11890 tablet_service.cc:1468] Processing CreateTablet for tablet e83f77c487d948ceabb6c43366cc7154 (DEFAULT_TABLE table=default.Table_9dc0f8c5c2384df382588ecd2cce8840 [id=8ffdfb72d3624bec8d7f5d3e3dfb3c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.414172 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83f77c487d948ceabb6c43366cc7154. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.414906 11900 tablet_service.cc:1468] Processing CreateTablet for tablet c68e055191704da8862b0fe6b30bfcfc (DEFAULT_TABLE table=default.Table_463848d52fef45a891bce13d122d7ee0 [id=686819fb676b4aa484ef5d51464f7bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.415138 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68e055191704da8862b0fe6b30bfcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.418294 11752 tablet_service.cc:1468] Processing CreateTablet for tablet d993663af84942abb059dec1712396d1 (DEFAULT_TABLE table=default.Table_062896f53a2645248ce16f4f2f19f506 [id=7aed99532d7f45359ab37081248b648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.418607 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d993663af84942abb059dec1712396d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.419736 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 0f6c287461864f6dba5f47711eb69fae from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.420506 12600 consensus_queue.cc:1035] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:02.420655 11858 consensus_peers.cc:487] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c825977e422407486587f28af36bd68. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:02.420934 13335 raft_consensus.cc:491] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.420958 11752 tablet_service.cc:1468] Processing CreateTablet for tablet bd284833ec6d41d5970227e3c36bebaf (DEFAULT_TABLE table=default.Table_fe2254af415a4926ac7969b5478c2c1a [id=2cf0ee62850b42ceb3ed3dc644f495f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.421027 13335 raft_consensus.cc:513] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.421180 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd284833ec6d41d5970227e3c36bebaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.421378 13335 leader_election.cc:290] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:02.421463 13335 raft_consensus.cc:491] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.421518 13335 raft_consensus.cc:513] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.421772 13335 leader_election.cc:290] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:02.422565 12032 tablet_service.cc:1468] Processing CreateTablet for tablet cc01d6d227254da4907eefe5e229e3a9 (DEFAULT_TABLE table=default.Table_6b666076abf941a583399f3a072c302d [id=d3cb6e0f77b14f24b6ce9f7d2dc749a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.422860 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc01d6d227254da4907eefe5e229e3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.422843 11760 tablet_service.cc:1468] Processing CreateTablet for tablet a7d87f5ca2f74eaeae12f1a6b533c12c (DEFAULT_TABLE table=default.Table_992ed60a855e433995e83e54f5f7d7db [id=4b6ca272e844442db3e8cda112fae525]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.422996 11762 tablet_service.cc:1468] Processing CreateTablet for tablet c68e055191704da8862b0fe6b30bfcfc (DEFAULT_TABLE table=default.Table_463848d52fef45a891bce13d122d7ee0 [id=686819fb676b4aa484ef5d51464f7bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.423070 11757 tablet_service.cc:1468] Processing CreateTablet for tablet c220c2fab2fb4628bd7ecf0cfc9d4a57 (DEFAULT_TABLE table=default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.423221 11750 tablet_service.cc:1468] Processing CreateTablet for tablet cc01d6d227254da4907eefe5e229e3a9 (DEFAULT_TABLE table=default.Table_6b666076abf941a583399f3a072c302d [id=d3cb6e0f77b14f24b6ce9f7d2dc749a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.423333 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 6d854092f68a4665b29ebc281a032d5d (DEFAULT_TABLE table=default.Table_9bbdb0114e0245cd9d194c455a61b97b [id=18389c62f0c3442caeba77ad47486760]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.423530 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd (DEFAULT_TABLE table=default.Table_cedbc8ae8dab416789f47248c6ebfcbb [id=b79f84879db54e1ca2919c58cfcf8bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.423565 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 08b3ba59f0374c6199cd470d136c59ee (DEFAULT_TABLE table=default.Table_16248c1613424ffabcdbfd0173d5678b [id=61ec0a905c47494993d61449ae285e91]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.423806 11761 tablet_service.cc:1468] Processing CreateTablet for tablet e83f77c487d948ceabb6c43366cc7154 (DEFAULT_TABLE table=default.Table_9dc0f8c5c2384df382588ecd2cce8840 [id=8ffdfb72d3624bec8d7f5d3e3dfb3c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.423861 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 114d0f7ab39348cf9e358c403b5ade10 (DEFAULT_TABLE table=default.Table_e0381b79b702498c8651956dccb37bd7 [id=a52beef85a2a48ebb3135fe7ea0c9ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.423079 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d87f5ca2f74eaeae12f1a6b533c12c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.424247 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b3ba59f0374c6199cd470d136c59ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.424212 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "288e0c1644a34b8dabc06ccdda9f0fa9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.424386 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc01d6d227254da4907eefe5e229e3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.424582 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c220c2fab2fb4628bd7ecf0cfc9d4a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.424710 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68e055191704da8862b0fe6b30bfcfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.424827 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.425240 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5df4b218df7d4e4e9e634d3cd4f17633" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.425475 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d854092f68a4665b29ebc281a032d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.425592 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114d0f7ab39348cf9e358c403b5ade10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.425681 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5df4b218df7d4e4e9e634d3cd4f17633" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.426720 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "288e0c1644a34b8dabc06ccdda9f0fa9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.426939 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e83f77c487d948ceabb6c43366cc7154. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:02.427000 11717 leader_election.cc:343] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:02.427100 11717 leader_election.cc:343] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.433207 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
I20250625 14:02:02.436095 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ae35e73e14994aa7bd2820d5ceebcf76
I20250625 14:02:02.437796 13510 server_base.cc:1048] running on GCE node
I20250625 14:02:02.438654 12177 tablet_replica.cc:331] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.438836 12177 raft_consensus.cc:2241] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.438997 12177 raft_consensus.cc:2270] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.439253 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f7808bed1b8f4103bf728b8a525dad5d
I20250625 14:02:02.439504 12177 ts_tablet_manager.cc:1905] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.442626 12177 ts_tablet_manager.cc:1918] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.442706 12177 log.cc:1199] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/5df4b218df7d4e4e9e634d3cd4f17633
I20250625 14:02:02.442909 12177 ts_tablet_manager.cc:1939] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.443338 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_76a7265ba1494e4f8aca832908235167" } modify_external_catalogs: true
I20250625 14:02:02.443464 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_76a7265ba1494e4f8aca832908235167" } modify_external_catalogs: true
I20250625 14:02:02.444474 12558 consensus_queue.cc:1035] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:02.445590 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet ae35e73e14994aa7bd2820d5ceebcf76 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.445940 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet f7808bed1b8f4103bf728b8a525dad5d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.446193 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet f7808bed1b8f4103bf728b8a525dad5d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.446808 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dab2b89c092c432f989c600f2f724b87" } modify_external_catalogs: true
I20250625 14:02:02.446931 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dab2b89c092c432f989c600f2f724b87" } modify_external_catalogs: true
W20250625 14:02:02.447438 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f7808bed1b8f4103bf728b8a525dad5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7808bed1b8f4103bf728b8a525dad5d already in progress: creating tablet
I20250625 14:02:02.450137 11526 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
I20250625 14:02:02.451117 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet ae35e73e14994aa7bd2820d5ceebcf76 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.452364 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
I20250625 14:02:02.452965 12175 ts_tablet_manager.cc:1918] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.453116 12175 log.cc:1199] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/fee20f2812d34d188b7181e6da00f823
W20250625 14:02:02.453362 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet ae35e73e14994aa7bd2820d5ceebcf76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae35e73e14994aa7bd2820d5ceebcf76 already in progress: creating tablet
W20250625 14:02:02.438850 11717 leader_election.cc:343] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.453944 11717 leader_election.cc:304] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
W20250625 14:02:02.454046 11717 raft_consensus.cc:2684] T 5df4b218df7d4e4e9e634d3cd4f17633 P 56419e38d8e34f6985d4d970c1ce76e5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20250625 14:02:02.454197 11717 leader_election.cc:343] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.454260 11717 leader_election.cc:304] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:02.454463 13335 raft_consensus.cc:2747] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.454874 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
W20250625 14:02:02.455497 13593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250625 14:02:02.456440 13510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250625 14:02:02.457110 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 12c5e71b4a4f4efc81f822bdf95d0f99 (table default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]) successfully deleted
I20250625 14:02:02.457329 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 5df4b218df7d4e4e9e634d3cd4f17633 (table default.Table_2142455242ee42d5820deea5646c9bc2 [id=6adcb3bc8e144f59bfe4d4f185b13a85]) successfully deleted
I20250625 14:02:02.457671 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet ae35e73e14994aa7bd2820d5ceebcf76 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.457796 13510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250625 14:02:02.457829 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet f7808bed1b8f4103bf728b8a525dad5d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:02.458232 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ae35e73e14994aa7bd2820d5ceebcf76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae35e73e14994aa7bd2820d5ceebcf76 already in progress: creating tablet
W20250625 14:02:02.458720 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f7808bed1b8f4103bf728b8a525dad5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7808bed1b8f4103bf728b8a525dad5d already in progress: creating tablet
I20250625 14:02:02.462277 13510 hybrid_clock.cc:648] HybridClock initialized: now 1750860122461743 us; error 549 us; skew 500 ppm
I20250625 14:02:02.467602 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 36c63ccc18544937bb07634af6adbd82 (DEFAULT_TABLE table=default.Table_d5328e63328444649fb3a4b665d3a222 [id=476b16db211d4982b742d607fa3ece47]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.467972 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c63ccc18544937bb07634af6adbd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.468068 12028 tablet_service.cc:1468] Processing CreateTablet for tablet ee8757ca1f064d259b1dca36c431a0c2 (DEFAULT_TABLE table=default.Table_23ec95f4e53c487fa735d0e9c7a5b3f0 [id=6c5eca4c7aa34fdd84b05d25c22b0c21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.468339 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8757ca1f064d259b1dca36c431a0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.470618 13510 webserver.cc:469] Webserver started at http://127.11.39.190:38689/ using document root <none> and password file <none>
I20250625 14:02:02.470902 12265 raft_consensus.cc:491] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.470991 12265 raft_consensus.cc:513] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.471382 13510 fs_manager.cc:362] Metadata directory not provided
I20250625 14:02:02.471406 12265 leader_election.cc:290] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.471459 13510 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250625 14:02:02.473384 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 4559bd9d44c54f3c9bed696716851a5e (DEFAULT_TABLE table=default.Table_a77f086339a047d5b0d22505879b5451 [id=4a84014f80d342368553acc51e57c1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.473678 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4559bd9d44c54f3c9bed696716851a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.473887 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 0496a26f236541b68e246d9234064b05 (DEFAULT_TABLE table=default.Table_86567b1d77d54cc5a0753ec84c8fa098 [id=d9490d2374494fba96ae32ccafe94567]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.474026 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "df475b9c0f62419a9df86d4e0097dcba" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.474162 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0496a26f236541b68e246d9234064b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.474511 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 4d7bd3487d954aeab0053b755d8ffe09 (DEFAULT_TABLE table=default.Table_2d83ef3351a4455fb0f4e370455cff01 [id=d1ef2121e10b45059fa3137579b53df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.474720 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7bd3487d954aeab0053b755d8ffe09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.474820 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 1fafeeedcd2842f784e2096fc6a00c07 (DEFAULT_TABLE table=default.Table_4bbb7716799d4e6ba7c3a2d874b9ffe3 [id=2f262744ab7443d1b477b5df3e0cc23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.475080 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fafeeedcd2842f784e2096fc6a00c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.475430 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 75562ea1650c4bdcbf38574465f62ce2 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:02.476631 11855 leader_election.cc:343] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:02.477681 11858 leader_election.cc:343] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: df475b9c0f62419a9df86d4e0097dcba
I20250625 14:02:02.477761 11858 leader_election.cc:304] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:02.477835 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4e95e6f8df9c4883b3a19f8741ecb431
I20250625 14:02:02.478063 12265 raft_consensus.cc:2747] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.478876 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 1fafeeedcd2842f784e2096fc6a00c07 (DEFAULT_TABLE table=default.Table_4bbb7716799d4e6ba7c3a2d874b9ffe3 [id=2f262744ab7443d1b477b5df3e0cc23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.479167 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fafeeedcd2842f784e2096fc6a00c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.479315 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 4559bd9d44c54f3c9bed696716851a5e (DEFAULT_TABLE table=default.Table_a77f086339a047d5b0d22505879b5451 [id=4a84014f80d342368553acc51e57c1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.479550 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4559bd9d44c54f3c9bed696716851a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.480623 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 4e95e6f8df9c4883b3a19f8741ecb431 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.480659 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 4e95e6f8df9c4883b3a19f8741ecb431 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.480693 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9e69770668a04547a020086532fb0af9" } new_table_name: "default.Table_7e3a28e81f114ea487edc03961693f5c" modify_external_catalogs: true
W20250625 14:02:02.481114 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4e95e6f8df9c4883b3a19f8741ecb431 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e95e6f8df9c4883b3a19f8741ecb431 already in progress: creating tablet
I20250625 14:02:02.470992 11902 tablet_service.cc:1468] Processing CreateTablet for tablet ee8757ca1f064d259b1dca36c431a0c2 (DEFAULT_TABLE table=default.Table_23ec95f4e53c487fa735d0e9c7a5b3f0 [id=6c5eca4c7aa34fdd84b05d25c22b0c21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.481524 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8757ca1f064d259b1dca36c431a0c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.481519 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 4d7bd3487d954aeab0053b755d8ffe09 (DEFAULT_TABLE table=default.Table_2d83ef3351a4455fb0f4e370455cff01 [id=d1ef2121e10b45059fa3137579b53df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.481760 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7bd3487d954aeab0053b755d8ffe09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.485291 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7ff70668bede407c816db9779ce5221d
I20250625 14:02:02.485307 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 75562ea1650c4bdcbf38574465f62ce2
I20250625 14:02:02.486457 11530 catalog_manager.cc:6652] ReplaceTablet: tablet 75562ea1650c4bdcbf38574465f62ce2 deleted and replaced by tablet d015e28856e849898287bf4fd19626c3
I20250625 14:02:02.487286 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ff70668bede407c816db9779ce5221d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.487445 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 75562ea1650c4bdcbf38574465f62ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet d015e28856e849898287bf4fd19626c3) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.487694 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ff70668bede407c816db9779ce5221d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:02.488500 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 899b47cc4b9e4afc854dccac27d7fec0 consensus state has no leader
W20250625 14:02:02.488849 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7ff70668bede407c816db9779ce5221d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ff70668bede407c816db9779ce5221d already in progress: creating tablet
I20250625 14:02:02.489198 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
I20250625 14:02:02.489887 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 75562ea1650c4bdcbf38574465f62ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet d015e28856e849898287bf4fd19626c3) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.490092 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 36c63ccc18544937bb07634af6adbd82 (DEFAULT_TABLE table=default.Table_d5328e63328444649fb3a4b665d3a222 [id=476b16db211d4982b742d607fa3ece47]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.490267 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 0496a26f236541b68e246d9234064b05 (DEFAULT_TABLE table=default.Table_86567b1d77d54cc5a0753ec84c8fa098 [id=d9490d2374494fba96ae32ccafe94567]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.490438 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c63ccc18544937bb07634af6adbd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.490413 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 36c63ccc18544937bb07634af6adbd82 (DEFAULT_TABLE table=default.Table_d5328e63328444649fb3a4b665d3a222 [id=476b16db211d4982b742d607fa3ece47]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.490651 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0496a26f236541b68e246d9234064b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.490665 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c63ccc18544937bb07634af6adbd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.490828 11760 tablet_service.cc:1468] Processing CreateTablet for tablet ee8757ca1f064d259b1dca36c431a0c2 (DEFAULT_TABLE table=default.Table_23ec95f4e53c487fa735d0e9c7a5b3f0 [id=6c5eca4c7aa34fdd84b05d25c22b0c21]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.491041 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8757ca1f064d259b1dca36c431a0c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:02.492051 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 75562ea1650c4bdcbf38574465f62ce2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75562ea1650c4bdcbf38574465f62ce2 already in progress: creating tablet
I20250625 14:02:02.493321 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 4559bd9d44c54f3c9bed696716851a5e (DEFAULT_TABLE table=default.Table_a77f086339a047d5b0d22505879b5451 [id=4a84014f80d342368553acc51e57c1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.493556 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4559bd9d44c54f3c9bed696716851a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.494038 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b28f9c1348994d7da3bacbb75fa2fffa" } modify_external_catalogs: true
I20250625 14:02:02.494171 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b28f9c1348994d7da3bacbb75fa2fffa" } modify_external_catalogs: true
I20250625 14:02:02.495390 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 0496a26f236541b68e246d9234064b05 (DEFAULT_TABLE table=default.Table_86567b1d77d54cc5a0753ec84c8fa098 [id=d9490d2374494fba96ae32ccafe94567]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.495731 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0496a26f236541b68e246d9234064b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.495807 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 1fafeeedcd2842f784e2096fc6a00c07 (DEFAULT_TABLE table=default.Table_4bbb7716799d4e6ba7c3a2d874b9ffe3 [id=2f262744ab7443d1b477b5df3e0cc23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.496065 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fafeeedcd2842f784e2096fc6a00c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.496063 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 70a02be03e4f42929e3cd0c521a00859 (DEFAULT_TABLE table=default.Table_9c3797c29c8749c0bc57daae5224dcab [id=bfb37097b58543c2a558668c9fc1713c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.496394 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_edb4e5a8013a4b3bbe858f99d1dd630b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.496654 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a02be03e4f42929e3cd0c521a00859. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:02.496785 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edb4e5a8013a4b3bbe858f99d1dd630b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:02.498104 11855 consensus_peers.cc:487] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c825977e422407486587f28af36bd68. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:02.498236 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 4d7bd3487d954aeab0053b755d8ffe09 (DEFAULT_TABLE table=default.Table_2d83ef3351a4455fb0f4e370455cff01 [id=d1ef2121e10b45059fa3137579b53df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.498502 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7bd3487d954aeab0053b755d8ffe09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.499842 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 50f55f37173246bc8dab611f5d28c24e (DEFAULT_TABLE table=default.Table_3f37b24906cb4ba7bd48f8b157211686 [id=ac56e79cbdc54b86b123c1c40913079f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.500080 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 50f55f37173246bc8dab611f5d28c24e (DEFAULT_TABLE table=default.Table_3f37b24906cb4ba7bd48f8b157211686 [id=ac56e79cbdc54b86b123c1c40913079f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.500101 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f55f37173246bc8dab611f5d28c24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.500351 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f55f37173246bc8dab611f5d28c24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.502175 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 2e4822e4ed7a405e8940abf314052185
I20250625 14:02:02.502545 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 4e95e6f8df9c4883b3a19f8741ecb431 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.502859 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ff70668bede407c816db9779ce5221d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.503144 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 75562ea1650c4bdcbf38574465f62ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet d015e28856e849898287bf4fd19626c3) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.504766 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e4822e4ed7a405e8940abf314052185 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.505141 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 50f55f37173246bc8dab611f5d28c24e (DEFAULT_TABLE table=default.Table_3f37b24906cb4ba7bd48f8b157211686 [id=ac56e79cbdc54b86b123c1c40913079f]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:02.505667 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4e95e6f8df9c4883b3a19f8741ecb431 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e95e6f8df9c4883b3a19f8741ecb431 already in progress: creating tablet
I20250625 14:02:02.505788 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f55f37173246bc8dab611f5d28c24e. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:02.505815 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7ff70668bede407c816db9779ce5221d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ff70668bede407c816db9779ce5221d already in progress: creating tablet
W20250625 14:02:02.505959 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 75562ea1650c4bdcbf38574465f62ce2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75562ea1650c4bdcbf38574465f62ce2 already in progress: creating tablet
I20250625 14:02:02.506222 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 6d33b9a3fc3f4f33891256eeab59303c (DEFAULT_TABLE table=default.Table_5b206d37132d4b99ba7dfe7bedef7677 [id=1a0d18e17d2b490bb5c239f20eae0094]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.506479 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d33b9a3fc3f4f33891256eeab59303c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.506670 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 6d33b9a3fc3f4f33891256eeab59303c (DEFAULT_TABLE table=default.Table_5b206d37132d4b99ba7dfe7bedef7677 [id=1a0d18e17d2b490bb5c239f20eae0094]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.506932 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d33b9a3fc3f4f33891256eeab59303c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.508958 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 1720ecc42c24484ca48e1de588a29482 (DEFAULT_TABLE table=default.Table_2bf4e247b26749488956b3c0a2ad649e [id=c6c6e9eb02ce4e83bcb962a1b83ac856]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.509209 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1720ecc42c24484ca48e1de588a29482. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.506584 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 1720ecc42c24484ca48e1de588a29482 (DEFAULT_TABLE table=default.Table_2bf4e247b26749488956b3c0a2ad649e [id=c6c6e9eb02ce4e83bcb962a1b83ac856]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.509470 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 1720ecc42c24484ca48e1de588a29482 (DEFAULT_TABLE table=default.Table_2bf4e247b26749488956b3c0a2ad649e [id=c6c6e9eb02ce4e83bcb962a1b83ac856]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.509719 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1720ecc42c24484ca48e1de588a29482. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.509972 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1720ecc42c24484ca48e1de588a29482. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.510133 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e4822e4ed7a405e8940abf314052185 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:02.511538 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 2e4822e4ed7a405e8940abf314052185 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e4822e4ed7a405e8940abf314052185 already in progress: creating tablet
I20250625 14:02:02.511940 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 2e4822e4ed7a405e8940abf314052185 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.512337 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 70a02be03e4f42929e3cd0c521a00859 (DEFAULT_TABLE table=default.Table_9c3797c29c8749c0bc57daae5224dcab [id=bfb37097b58543c2a558668c9fc1713c]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:02.512395 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 2e4822e4ed7a405e8940abf314052185 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e4822e4ed7a405e8940abf314052185 already in progress: creating tablet
I20250625 14:02:02.512578 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a02be03e4f42929e3cd0c521a00859. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.514886 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 6d33b9a3fc3f4f33891256eeab59303c (DEFAULT_TABLE table=default.Table_5b206d37132d4b99ba7dfe7bedef7677 [id=1a0d18e17d2b490bb5c239f20eae0094]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.515141 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d33b9a3fc3f4f33891256eeab59303c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.517093 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 70a02be03e4f42929e3cd0c521a00859 (DEFAULT_TABLE table=default.Table_9c3797c29c8749c0bc57daae5224dcab [id=bfb37097b58543c2a558668c9fc1713c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.517215 13510 fs_manager.cc:714] Time spent opening directory manager: real 0.018s user 0.002s sys 0.000s
I20250625 14:02:02.517366 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a02be03e4f42929e3cd0c521a00859. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.522614 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 1d2cf613b4404dbb89de199e089f0116 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.523000 13616 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250625 14:02:02.523203 13335 consensus_queue.cc:1035] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:02.524400 13510 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20250625 14:02:02.524531 13510 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data,/tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
uuid: "b569e7a9e38b4882a89092d98a2f1b9b"
format_stamp: "Formatted at 2025-06-25 14:01:50 on dist-test-slave-b81v"
I20250625 14:02:02.525040 13510 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250625 14:02:02.527968 12167 tablet_bootstrap.cc:492] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.528071 12167 ts_tablet_manager.cc:1397] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.201s user 0.002s sys 0.000s
I20250625 14:02:02.528630 12167 raft_consensus.cc:357] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.528753 12167 raft_consensus.cc:383] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.528793 12167 raft_consensus.cc:738] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.528944 12167 consensus_queue.cc:260] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.529222 12167 ts_tablet_manager.cc:1428] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:02.529456 12167 tablet_bootstrap.cc:492] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.533322 12167 tablet_bootstrap.cc:654] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.533218 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_375b905217c342d7ae85bc905acc07c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.533691 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_375b905217c342d7ae85bc905acc07c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.535625 13531 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 7 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 8
I20250625 14:02:02.537726 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet c4a906afbc504981942d57221742e822 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.537920 12173 tablet_replica.cc:331] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.538089 12173 raft_consensus.cc:2241] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.538197 12173 raft_consensus.cc:2270] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.538074 12166 tablet_bootstrap.cc:492] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.538558 12166 ts_tablet_manager.cc:1397] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.170s user 0.002s sys 0.000s
I20250625 14:02:02.539083 12166 raft_consensus.cc:357] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.539204 12166 raft_consensus.cc:383] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.539242 12166 raft_consensus.cc:738] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.539374 12166 consensus_queue.cc:260] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.539652 12166 ts_tablet_manager.cc:1428] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.539884 12166 tablet_bootstrap.cc:492] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.540985 12166 tablet_bootstrap.cc:654] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.544458 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet b3819dec2c834c40846dcb3a11fa4f5f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.523443 12175 ts_tablet_manager.cc:1939] T fee20f2812d34d188b7181e6da00f823 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.544857 12173 ts_tablet_manager.cc:1905] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.545454 12175 tablet_replica.cc:331] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.545615 12175 raft_consensus.cc:2241] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:02.545822 12175 raft_consensus.cc:2270] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.546226 12175 ts_tablet_manager.cc:1905] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.547834 12173 ts_tablet_manager.cc:1918] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.547950 12173 log.cc:1199] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c4a906afbc504981942d57221742e822
I20250625 14:02:02.548198 12173 ts_tablet_manager.cc:1939] T c4a906afbc504981942d57221742e822 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.548765 12175 ts_tablet_manager.cc:1918] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.548843 12175 log.cc:1199] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/3c825977e422407486587f28af36bd68
I20250625 14:02:02.549091 12175 ts_tablet_manager.cc:1939] T 3c825977e422407486587f28af36bd68 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.549655 12175 tablet_replica.cc:331] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.549789 12175 raft_consensus.cc:2241] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.549937 12175 raft_consensus.cc:2270] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.550508 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c4a906afbc504981942d57221742e822 (table default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb [id=4f157d4de29f4618937525f9293e5049]) successfully deleted
I20250625 14:02:02.550678 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet fee20f2812d34d188b7181e6da00f823 (table default.Table_3f92afb1db03462ba4957327934a6f31 [id=7ed292d901604c21854902e16399f88f]) successfully deleted
W20250625 14:02:02.550796 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 806e5502a95e4a0396c008267e16f2d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 806e5502a95e4a0396c008267e16f2d5 already in progress: creating tablet
I20250625 14:02:02.550911 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 3c825977e422407486587f28af36bd68 (table default.Table_2928b645415547419a21192f44ad81ab [id=c7bfff2cc8b84a5d83719cd96bc5af9c]) successfully deleted
I20250625 14:02:02.553768 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5ee07cda0c99450d88a6ea98b3f81901"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.554281 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ee07cda0c99450d88a6ea98b3f81901 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.555198 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d5328e63328444649fb3a4b665d3a222" } new_table_name: "default.Table_956d6e4c09f34575804bf1beeb21e52f" modify_external_catalogs: true
I20250625 14:02:02.557227 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3a5a410c796c42c2b28e41b58263b19a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.557730 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a5a410c796c42c2b28e41b58263b19a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.561429 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b8ab1901af5043e58269241598c81482"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.561596 12167 tablet_bootstrap.cc:492] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.561691 12167 ts_tablet_manager.cc:1397] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
W20250625 14:02:02.561807 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8ab1901af5043e58269241598c81482 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.562325 12167 raft_consensus.cc:357] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.562433 12167 raft_consensus.cc:383] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.562472 12167 raft_consensus.cc:738] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.562604 12167 consensus_queue.cc:260] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.562872 12167 ts_tablet_manager.cc:1428] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.563048 12167 tablet_bootstrap.cc:492] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.563858 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5b6808ffcf1a4ed48bdf3cc3764595cc" } new_table_name: "default.Table_72962c13dc9b49749853b0198870ebc3" modify_external_catalogs: true
I20250625 14:02:02.564867 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_533afd5e6bb14c7697c5652f2c8ee713"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.565197 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_533afd5e6bb14c7697c5652f2c8ee713 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.566035 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e0a12379205a43b5be2ab7462a0db148"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.566344 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0a12379205a43b5be2ab7462a0db148 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.567703 12167 tablet_bootstrap.cc:654] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.572182 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 6c8c667108694caab967bd91f74759b6 with delete_type TABLET_DATA_DELETED (replaced by tablet cbe2dcd1fb924dcba5c12aaa8e141435) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.572402 12173 tablet_replica.cc:331] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.572566 12173 raft_consensus.cc:2241] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.572680 12173 raft_consensus.cc:2270] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:02.574923 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36c63ccc18544937bb07634af6adbd82 consensus state has no leader
W20250625 14:02:02.576436 11717 consensus_peers.cc:487] T b5c6c654c5704a41987a8d2016ab32b4 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Couldn't send request to peer bfff52620fea460d850827814b790c35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:02.579227 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_785978d07adb44d1832da1da036c86e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.579680 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_785978d07adb44d1832da1da036c86e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.579806 12173 ts_tablet_manager.cc:1905] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.582276 12173 ts_tablet_manager.cc:1918] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.583752 12173 log.cc:1199] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6c8c667108694caab967bd91f74759b6
I20250625 14:02:02.583992 12173 ts_tablet_manager.cc:1939] T 6c8c667108694caab967bd91f74759b6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.584887 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6c8c667108694caab967bd91f74759b6 (table default.Table_315e7726e574485ba15c66dfad56a12a [id=2e114a17eddf47f4b5522bcdad81bd16]) successfully deleted
I20250625 14:02:02.587599 13535 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 8 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 9
I20250625 14:02:02.591800 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cfe4202157b64beda5dac0c9c5b5f80c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.592199 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_98901b44c78a49e5ad4f237149a0ca11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.592278 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfe4202157b64beda5dac0c9c5b5f80c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:02.592552 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98901b44c78a49e5ad4f237149a0ca11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.593079 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0484c8fc78484d04841a05f84b8d7dfe" } new_table_name: "default.Table_ee2bfa38bd964932a98b687fe8472e56" modify_external_catalogs: true
I20250625 14:02:02.592247 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7f32473eae534d38a3e455dcc176d972" } new_table_name: "default.Table_f5a24d7ce7314e10b3318853de1b7b65" modify_external_catalogs: true
I20250625 14:02:02.594854 13532 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 8 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 9
I20250625 14:02:02.604264 13531 tablet.cc:1722] T 339813cd0c194f07bfc4edefd6a05ef3 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 8 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 9
I20250625 14:02:02.604907 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 268638793ff44216aa0663b0a3568940 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:02.606845 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41eb1c8d2afa4a4593a466bffae5dc23 consensus state has no leader
I20250625 14:02:02.608716 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_72962c13dc9b49749853b0198870ebc3 [id=05ba3fb82ea74715a67dbefb3018db83] alter complete (version 9)
I20250625 14:02:02.619328 12265 raft_consensus.cc:491] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.619467 12265 raft_consensus.cc:513] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.619951 12265 leader_election.cc:290] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.621551 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dff05950ded34f4bb554badc4ccd3e0f" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:02.621636 11858 leader_election.cc:343] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: dff05950ded34f4bb554badc4ccd3e0f
I20250625 14:02:02.622082 13510 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
W20250625 14:02:02.622248 11855 leader_election.cc:343] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:02.622356 11855 leader_election.cc:304] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:02.622520 12265 raft_consensus.cc:2747] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.623023 12166 tablet_bootstrap.cc:492] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.623121 12166 ts_tablet_manager.cc:1397] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.000s
I20250625 14:02:02.623414 13510 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250625 14:02:02.623663 12166 raft_consensus.cc:357] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.623750 13510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250625 14:02:02.623781 12166 raft_consensus.cc:383] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.623813 12166 raft_consensus.cc:738] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.623979 12166 consensus_queue.cc:260] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.624285 12166 ts_tablet_manager.cc:1428] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.624505 12166 tablet_bootstrap.cc:492] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.632977 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 128dab7ad46048cc91fc20ddc1431d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.633451 12166 tablet_bootstrap.cc:654] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.636801 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 837e98e4e48a465fa9c3e697ae34c9ea from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.637421 13510 rpc_server.cc:307] RPC server started. Bound to: 127.11.39.190:38199
I20250625 14:02:02.637997 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_65610e9b154a415e81112beb1f0412b4" } modify_external_catalogs: true
I20250625 14:02:02.638128 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_65610e9b154a415e81112beb1f0412b4" } modify_external_catalogs: true
I20250625 14:02:02.640833 13510 server_base.cc:1180] Dumped server information to /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/master-0/data/info.pb
I20250625 14:02:02.640784 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1e9b59f503d94b5cbb6c623f66e91d46" } modify_external_catalogs: true
I20250625 14:02:02.640921 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_1e9b59f503d94b5cbb6c623f66e91d46" } modify_external_catalogs: true
I20250625 14:02:02.642432 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 837e98e4e48a465fa9c3e697ae34c9ea
I20250625 14:02:02.642508 12167 tablet_bootstrap.cc:492] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.642603 12167 ts_tablet_manager.cc:1397] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.000s
I20250625 14:02:02.642901 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 837e98e4e48a465fa9c3e697ae34c9ea with delete_type TABLET_DATA_DELETED (replaced by tablet 3246a7f3fa924b268ba4e263754cb4fd) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.643141 12167 raft_consensus.cc:357] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.643260 12167 raft_consensus.cc:383] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.643286 11526 catalog_manager.cc:6652] ReplaceTablet: tablet 837e98e4e48a465fa9c3e697ae34c9ea deleted and replaced by tablet 3246a7f3fa924b268ba4e263754cb4fd
I20250625 14:02:02.643298 12167 raft_consensus.cc:738] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.643445 12167 consensus_queue.cc:260] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.644021 12167 ts_tablet_manager.cc:1428] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:02.644224 12167 tablet_bootstrap.cc:492] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.644447 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 837e98e4e48a465fa9c3e697ae34c9ea with delete_type TABLET_DATA_DELETED (replaced by tablet 3246a7f3fa924b268ba4e263754cb4fd) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.644650 12177 tablet_replica.cc:331] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.644767 12177 raft_consensus.cc:2241] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.644873 12177 raft_consensus.cc:2270] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.645364 12167 tablet_bootstrap.cc:654] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.645541 12177 ts_tablet_manager.cc:1905] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.646205 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 837e98e4e48a465fa9c3e697ae34c9ea with delete_type TABLET_DATA_DELETED (replaced by tablet 3246a7f3fa924b268ba4e263754cb4fd) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.648026 12177 ts_tablet_manager.cc:1918] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.648098 12177 log.cc:1199] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/837e98e4e48a465fa9c3e697ae34c9ea
I20250625 14:02:02.648355 12177 ts_tablet_manager.cc:1939] T 837e98e4e48a465fa9c3e697ae34c9ea P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.648854 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]) successfully deleted
I20250625 14:02:02.650933 11422 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu as pid 13510
I20250625 14:02:02.651710 12173 tablet_replica.cc:331] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.651882 12173 raft_consensus.cc:2241] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:02.652117 12173 raft_consensus.cc:2270] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.652931 12173 ts_tablet_manager.cc:1905] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.655175 11915 raft_consensus.cc:3058] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.656780 13121 consensus_queue.cc:1035] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:02.662107 13678 sys_catalog.cc:263] Verifying existing consensus state
I20250625 14:02:02.663499 12173 ts_tablet_manager.cc:1918] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.663604 12173 log.cc:1199] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/837e98e4e48a465fa9c3e697ae34c9ea
I20250625 14:02:02.663863 12173 ts_tablet_manager.cc:1939] T 837e98e4e48a465fa9c3e697ae34c9ea P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.664674 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]) successfully deleted
I20250625 14:02:02.665045 13678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: Bootstrap starting.
I20250625 14:02:02.666363 13532 tablet.cc:1722] T 51440ec50d1c4dc89644b0be321d6f73 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:02.666648 13531 tablet.cc:1722] T 51440ec50d1c4dc89644b0be321d6f73 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:02.667519 13535 tablet.cc:1722] T 51440ec50d1c4dc89644b0be321d6f73 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:02.668362 12166 tablet_bootstrap.cc:492] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.668479 12166 ts_tablet_manager.cc:1397] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20250625 14:02:02.669068 12166 raft_consensus.cc:357] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.669350 12166 raft_consensus.cc:383] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.669390 12166 raft_consensus.cc:738] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.669518 12166 consensus_queue.cc:260] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.669811 12166 ts_tablet_manager.cc:1428] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.676430 12175 ts_tablet_manager.cc:1905] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.677245 12166 tablet_bootstrap.cc:492] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.678424 12166 tablet_bootstrap.cc:654] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.679493 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_92f186752e894a628d90ac456558a555" } modify_external_catalogs: true
I20250625 14:02:02.679641 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_92f186752e894a628d90ac456558a555" } modify_external_catalogs: true
I20250625 14:02:02.680706 12175 ts_tablet_manager.cc:1918] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:02.680794 12175 log.cc:1199] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7b817bda69f44497a6787d1d649ef5e9
I20250625 14:02:02.681061 12175 ts_tablet_manager.cc:1939] T 7b817bda69f44497a6787d1d649ef5e9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.681788 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7b817bda69f44497a6787d1d649ef5e9 (table default.Table_e70f8d95174d4bfe8aad800cb1211138 [id=eb9c04f498934429a3cbc198525b7489]) successfully deleted
I20250625 14:02:02.682778 12175 tablet_replica.cc:331] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.682942 12175 raft_consensus.cc:2241] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.683072 12175 raft_consensus.cc:2270] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.683472 12175 ts_tablet_manager.cc:1905] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.686906 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a2ff3964d6a24c2fa0471b420dba3238" } modify_external_catalogs: true
I20250625 14:02:02.687045 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a2ff3964d6a24c2fa0471b420dba3238" } modify_external_catalogs: true
I20250625 14:02:02.687978 12166 tablet_bootstrap.cc:492] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.688068 12166 ts_tablet_manager.cc:1397] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20250625 14:02:02.688561 12166 raft_consensus.cc:357] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.688661 12166 raft_consensus.cc:383] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.688689 12166 raft_consensus.cc:738] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.688805 12166 consensus_queue.cc:260] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.689056 12166 ts_tablet_manager.cc:1428] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:02.689250 12166 tablet_bootstrap.cc:492] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.689728 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_af79ed183b6647f6a50aea9885a847b5" } new_table_name: "default.Table_e8cdfa18fef245548571944b984ac01f" modify_external_catalogs: true
I20250625 14:02:02.691071 12172 tablet_bootstrap.cc:492] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:02.691177 12172 ts_tablet_manager.cc:1397] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.395s user 0.002s sys 0.001s
I20250625 14:02:02.691668 12172 raft_consensus.cc:357] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.691781 12172 raft_consensus.cc:383] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.691815 12172 raft_consensus.cc:738] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.690297 12166 tablet_bootstrap.cc:654] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.691956 12172 consensus_queue.cc:260] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.692253 12172 ts_tablet_manager.cc:1428] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.692458 12172 tablet_bootstrap.cc:492] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:02.697280 12172 tablet_bootstrap.cc:654] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.702245 13677 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.39.190:38199 every 8 connection(s)
I20250625 14:02:02.704895 12167 tablet_bootstrap.cc:492] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.705169 12167 ts_tablet_manager.cc:1397] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.061s user 0.001s sys 0.001s
I20250625 14:02:02.705776 12167 raft_consensus.cc:357] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.705991 12167 raft_consensus.cc:383] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.706140 12167 raft_consensus.cc:738] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.706568 12167 consensus_queue.cc:260] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.707052 12167 ts_tablet_manager.cc:1428] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:02.711047 12167 tablet_bootstrap.cc:492] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.717924 12166 tablet_bootstrap.cc:492] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.718050 12166 ts_tablet_manager.cc:1397] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250625 14:02:02.718729 12166 raft_consensus.cc:357] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:02.718822 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a5c9b1852a847188bb7e2f08a37fded consensus state has no leader
I20250625 14:02:02.718847 12166 raft_consensus.cc:383] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.718880 12166 raft_consensus.cc:738] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.719012 12166 consensus_queue.cc:260] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.719058 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cedbc8ae8dab416789f47248c6ebfcbb" } modify_external_catalogs: true
I20250625 14:02:02.719156 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cedbc8ae8dab416789f47248c6ebfcbb" } modify_external_catalogs: true
I20250625 14:02:02.719357 12166 ts_tablet_manager.cc:1428] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:02.719422 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_f5a24d7ce7314e10b3318853de1b7b65 [id=754d4fbc3d2b46288bf352ff3a4c7010] alter complete (version 1)
I20250625 14:02:02.719558 12166 tablet_bootstrap.cc:492] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.719622 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 8d600a46fc1c4a6194368f3cd8681364 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.719659 12558 raft_consensus.cc:491] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.719750 12558 raft_consensus.cc:513] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.720099 12558 leader_election.cc:290] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.720691 12166 tablet_bootstrap.cc:654] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:02.721377 11855 leader_election.cc:343] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: b3819dec2c834c40846dcb3a11fa4f5f
W20250625 14:02:02.722119 11858 leader_election.cc:343] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: b3819dec2c834c40846dcb3a11fa4f5f
I20250625 14:02:02.722185 11858 leader_election.cc:304] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:02.722707 12600 raft_consensus.cc:2747] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.715878 12167 tablet_bootstrap.cc:654] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.729636 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1d2cf613b4404dbb89de199e089f0116
I20250625 14:02:02.730006 11531 catalog_manager.cc:6652] ReplaceTablet: tablet 1d2cf613b4404dbb89de199e089f0116 deleted and replaced by tablet 0805f8be98bc45efb901ca138e425908
I20250625 14:02:02.730511 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d2cf613b4404dbb89de199e089f0116 with delete_type TABLET_DATA_DELETED (replaced by tablet 0805f8be98bc45efb901ca138e425908) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.730639 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d2cf613b4404dbb89de199e089f0116 with delete_type TABLET_DATA_DELETED (replaced by tablet 0805f8be98bc45efb901ca138e425908) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:02.730969 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1d2cf613b4404dbb89de199e089f0116 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2cf613b4404dbb89de199e089f0116 already in progress: creating tablet
I20250625 14:02:02.732514 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 1d2cf613b4404dbb89de199e089f0116 with delete_type TABLET_DATA_DELETED (replaced by tablet 0805f8be98bc45efb901ca138e425908) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.732582 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 268638793ff44216aa0663b0a3568940
I20250625 14:02:02.732851 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 268638793ff44216aa0663b0a3568940 deleted and replaced by tablet 11d75509046746fe8016c9182923d83c
I20250625 14:02:02.733088 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_99d99d9329bb457a9b08726b913019ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.733530 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99d99d9329bb457a9b08726b913019ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:02.734510 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1d2cf613b4404dbb89de199e089f0116 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2cf613b4404dbb89de199e089f0116 already in progress: creating tablet
I20250625 14:02:02.735298 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 185a1a5f14344caa89473baa57f0b02d
I20250625 14:02:02.735891 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 268638793ff44216aa0663b0a3568940 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d75509046746fe8016c9182923d83c) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.735992 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 185a1a5f14344caa89473baa57f0b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.736110 12177 tablet_replica.cc:331] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.736249 12177 raft_consensus.cc:2241] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.736344 12177 raft_consensus.cc:2270] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.736752 12177 ts_tablet_manager.cc:1905] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.737564 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 268638793ff44216aa0663b0a3568940 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d75509046746fe8016c9182923d83c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.738045 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 185a1a5f14344caa89473baa57f0b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.738130 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 185a1a5f14344caa89473baa57f0b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.739409 12177 ts_tablet_manager.cc:1918] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.739481 12177 log.cc:1199] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/268638793ff44216aa0663b0a3568940
I20250625 14:02:02.739692 12177 ts_tablet_manager.cc:1939] T 268638793ff44216aa0663b0a3568940 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.740115 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 268638793ff44216aa0663b0a3568940 (table default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]) successfully deleted
I20250625 14:02:02.740165 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 268638793ff44216aa0663b0a3568940 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d75509046746fe8016c9182923d83c) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:02.740401 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 185a1a5f14344caa89473baa57f0b02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 185a1a5f14344caa89473baa57f0b02d already in progress: creating tablet
W20250625 14:02:02.740447 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 268638793ff44216aa0663b0a3568940 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 268638793ff44216aa0663b0a3568940 already in progress: creating tablet
W20250625 14:02:02.740828 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 185a1a5f14344caa89473baa57f0b02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 185a1a5f14344caa89473baa57f0b02d already in progress: creating tablet
I20250625 14:02:02.741277 12104 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:02.742259 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]). Expected version 1 got 0
I20250625 14:02:02.746781 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 2dc474dd92134a96a8e755537fd431c6
I20250625 14:02:02.747591 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3be69a38ec234025af3e9c2c54dca57e
I20250625 14:02:02.748519 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 2dc474dd92134a96a8e755537fd431c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.748565 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 3be69a38ec234025af3e9c2c54dca57e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.749274 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a2dfbabfeab54b618fc02d53b577e01e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.749728 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2dfbabfeab54b618fc02d53b577e01e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.750458 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet df475b9c0f62419a9df86d4e0097dcba with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:02.750687 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 2dc474dd92134a96a8e755537fd431c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dc474dd92134a96a8e755537fd431c6 already in progress: creating tablet
I20250625 14:02:02.751076 13121 raft_consensus.cc:491] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.751170 13121 raft_consensus.cc:513] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.751310 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 3be69a38ec234025af3e9c2c54dca57e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.751552 13121 leader_election.cc:290] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.751768 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 2dc474dd92134a96a8e755537fd431c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:02.752373 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 3be69a38ec234025af3e9c2c54dca57e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3be69a38ec234025af3e9c2c54dca57e already in progress: creating tablet
I20250625 14:02:02.752385 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "674b6cd0ec374505a340cfefb6df63bb" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:02.752568 11918 raft_consensus.cc:2466] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:02.752628 12173 tablet_replica.cc:331] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.752755 12173 raft_consensus.cc:2241] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.752863 12173 raft_consensus.cc:2270] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.753165 11990 leader_election.cc:304] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:02.753386 13121 raft_consensus.cc:2802] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:02.753455 13121 raft_consensus.cc:491] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:02.753500 13121 raft_consensus.cc:3058] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.754137 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "674b6cd0ec374505a340cfefb6df63bb" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:02.754267 11784 raft_consensus.cc:2466] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:02.754453 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 3be69a38ec234025af3e9c2c54dca57e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3be69a38ec234025af3e9c2c54dca57e already in progress: creating tablet
W20250625 14:02:02.754627 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 2dc474dd92134a96a8e755537fd431c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dc474dd92134a96a8e755537fd431c6 already in progress: creating tablet
I20250625 14:02:02.754683 13121 raft_consensus.cc:513] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.755420 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "674b6cd0ec374505a340cfefb6df63bb" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:02.755517 11784 raft_consensus.cc:3058] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.755577 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "674b6cd0ec374505a340cfefb6df63bb" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:02.755685 11918 raft_consensus.cc:3058] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.756489 11784 raft_consensus.cc:2466] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:02.756489 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 2dc474dd92134a96a8e755537fd431c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.756635 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet c4a906afbc504981942d57221742e822 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.756742 11918 raft_consensus.cc:2466] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:02.757375 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 3be69a38ec234025af3e9c2c54dca57e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.755008 13121 leader_election.cc:290] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.757391 11993 leader_election.cc:304] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:02.758844 13121 raft_consensus.cc:2802] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:02.758929 13121 raft_consensus.cc:695] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:02.759054 13121 consensus_queue.cc:237] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.763110 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_86ae8abcddf74fbf84c7d743f803e7d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.763576 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86ae8abcddf74fbf84c7d743f803e7d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.765354 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8d600a46fc1c4a6194368f3cd8681364
I20250625 14:02:02.765642 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 8d600a46fc1c4a6194368f3cd8681364 deleted and replaced by tablet fd9424c993d2416c85604a188c349ad5
I20250625 14:02:02.765826 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d600a46fc1c4a6194368f3cd8681364 with delete_type TABLET_DATA_DELETED (replaced by tablet fd9424c993d2416c85604a188c349ad5) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.765978 12265 raft_consensus.cc:491] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.766076 12265 raft_consensus.cc:513] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.766465 12265 leader_election.cc:290] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:02.767119 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d600a46fc1c4a6194368f3cd8681364 with delete_type TABLET_DATA_DELETED (replaced by tablet fd9424c993d2416c85604a188c349ad5) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.767308 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d600a46fc1c4a6194368f3cd8681364 with delete_type TABLET_DATA_DELETED (replaced by tablet fd9424c993d2416c85604a188c349ad5) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:02.767325 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8d600a46fc1c4a6194368f3cd8681364 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d600a46fc1c4a6194368f3cd8681364 already in progress: creating tablet
W20250625 14:02:02.767460 11858 leader_election.cc:343] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 6c8c667108694caab967bd91f74759b6
W20250625 14:02:02.768028 11855 leader_election.cc:343] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 6c8c667108694caab967bd91f74759b6
I20250625 14:02:02.768100 11855 leader_election.cc:304] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:02.768906 11533 catalog_manager.cc:5582] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:02.769554 12265 raft_consensus.cc:2747] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.769690 11969 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:02.758074 12173 ts_tablet_manager.cc:1905] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.776875 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_20ecabab91ef4823a1c5d7bebb38f37e" } new_table_name: "default.Table_bdb8c169c9af4735b29c0aaa9981261f" modify_external_catalogs: true
I20250625 14:02:02.776949 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b2a1c6f9e7c44a158891bc3de8408c68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.777361 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2a1c6f9e7c44a158891bc3de8408c68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.779685 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e9fd60167d824e34a9a990ec9994f4fe" } new_table_name: "default.Table_47b438711bb4412895672499cd53a2d0" modify_external_catalogs: true
I20250625 14:02:02.782060 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_673d4f709a6046da8ce9e476d447782f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.783021 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_673d4f709a6046da8ce9e476d447782f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.784041 11831 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:02.785468 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5847bff0cf8442b7aa5507ff6d3d293c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.785844 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5847bff0cf8442b7aa5507ff6d3d293c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.785914 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a8cf7c9cdc674edd9250a057b4c4e28a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.786209 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8cf7c9cdc674edd9250a057b4c4e28a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.792742 13352 consensus_queue.cc:1035] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:02.792835 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_139840ae17524fa698ac29386ff88f38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.793275 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_139840ae17524fa698ac29386ff88f38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:02.797677 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e4cdf8f78d14c7d8ba3bda009d33719 consensus state has no leader
I20250625 14:02:02.800798 12104 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:02.804589 12265 raft_consensus.cc:491] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.804706 12265 raft_consensus.cc:513] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.805071 12265 leader_election.cc:290] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:02.805367 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "714bb5a28ec648f990fa1525a1b50129" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:02.805505 11784 raft_consensus.cc:2466] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:02.805799 11858 leader_election.cc:304] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:02.805969 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "714bb5a28ec648f990fa1525a1b50129" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:02.806078 12042 raft_consensus.cc:2466] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:02.806234 12265 raft_consensus.cc:2802] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:02.806285 12265 raft_consensus.cc:491] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:02.806386 12265 raft_consensus.cc:3058] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.807432 12265 raft_consensus.cc:513] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.807780 12265 leader_election.cc:290] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:02.808154 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2baa220e01444322a4a589f1757b7ed7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.808636 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2baa220e01444322a4a589f1757b7ed7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.808694 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "714bb5a28ec648f990fa1525a1b50129" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:02.808694 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "714bb5a28ec648f990fa1525a1b50129" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:02.808818 11784 raft_consensus.cc:3058] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.808836 12042 raft_consensus.cc:3058] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:02.809854 11784 raft_consensus.cc:2466] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:02.809854 12042 raft_consensus.cc:2466] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:02.810190 11858 leader_election.cc:304] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:02.810462 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_315e7726e574485ba15c66dfad56a12a" } new_table_name: "default.Table_d0b3e2e69d20402f990444c966a8f3c0" modify_external_catalogs: true
I20250625 14:02:02.810629 12600 raft_consensus.cc:2802] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:02.810720 12600 raft_consensus.cc:695] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:02.810859 12600 consensus_queue.cc:237] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.811606 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ac5d44672af04e189c94e99f0c66515e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.812144 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac5d44672af04e189c94e99f0c66515e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.815824 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_892620871def4b818f36f2c0b4f1cbed" } new_table_name: "default.Table_e6fede9f2fc246539a5250da539ab467" modify_external_catalogs: true
I20250625 14:02:02.817229 11969 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:02.818051 11530 catalog_manager.cc:5582] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:02.820407 13535 tablet.cc:1722] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:02.824199 13531 tablet.cc:1722] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:02.828521 13532 tablet.cc:1722] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:02.829253 13678 log.cc:826] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: Log is configured to *not* fsync() on all Append() calls
I20250625 14:02:02.835525 12173 ts_tablet_manager.cc:1918] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.835808 12173 log.cc:1199] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/df475b9c0f62419a9df86d4e0097dcba
I20250625 14:02:02.836061 12173 ts_tablet_manager.cc:1939] T df475b9c0f62419a9df86d4e0097dcba P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:02.837004 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cbe2dcd1fb924dcba5c12aaa8e141435 consensus state has no leader
I20250625 14:02:02.842213 12172 tablet_bootstrap.cc:492] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:02.842366 12172 ts_tablet_manager.cc:1397] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.150s user 0.002s sys 0.000s
I20250625 14:02:02.842456 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet df475b9c0f62419a9df86d4e0097dcba (table default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d [id=d35a23a319d44785bff52098cd7247e4]) successfully deleted
W20250625 14:02:02.842628 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8d600a46fc1c4a6194368f3cd8681364 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d600a46fc1c4a6194368f3cd8681364 already in progress: creating tablet
I20250625 14:02:02.842888 12172 raft_consensus.cc:357] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.843003 12172 raft_consensus.cc:383] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.843034 12172 raft_consensus.cc:738] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.843350 11890 tablet_service.cc:1468] Processing CreateTablet for tablet d015e28856e849898287bf4fd19626c3 (DEFAULT_TABLE table=default.Table_c147de4a592443e78b2ef153e8783ed6 [id=93904e68de784a798391f426f62e28bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.843448 12172 consensus_queue.cc:260] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.843660 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d015e28856e849898287bf4fd19626c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.846215 12032 tablet_service.cc:1468] Processing CreateTablet for tablet d015e28856e849898287bf4fd19626c3 (DEFAULT_TABLE table=default.Table_c147de4a592443e78b2ef153e8783ed6 [id=93904e68de784a798391f426f62e28bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.846511 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d015e28856e849898287bf4fd19626c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.843871 12172 ts_tablet_manager.cc:1428] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.843463 11750 tablet_service.cc:1468] Processing CreateTablet for tablet d015e28856e849898287bf4fd19626c3 (DEFAULT_TABLE table=default.Table_c147de4a592443e78b2ef153e8783ed6 [id=93904e68de784a798391f426f62e28bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:02.850346 12172 tablet_bootstrap.cc:492] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:02.850611 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d015e28856e849898287bf4fd19626c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:02.851241 12166 tablet_bootstrap.cc:492] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.851329 12166 ts_tablet_manager.cc:1397] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.132s user 0.000s sys 0.002s
I20250625 14:02:02.851529 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet b1af86cdb13f427ea61ee8ad56ca3f26 (table default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947]). Expected version 1 got 0
I20250625 14:02:02.851814 12166 raft_consensus.cc:357] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.851927 12166 raft_consensus.cc:383] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.851964 12166 raft_consensus.cc:738] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.852092 12166 consensus_queue.cc:260] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.852432 12166 ts_tablet_manager.cc:1428] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250625 14:02:02.852669 12166 tablet_bootstrap.cc:492] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.853602 12166 tablet_bootstrap.cc:654] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.859489 12175 ts_tablet_manager.cc:1918] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:02.859853 12175 log.cc:1199] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/bb1d6934ab98482c9ae6b6cafc1ee9a6
I20250625 14:02:02.860321 12175 ts_tablet_manager.cc:1939] T bb1d6934ab98482c9ae6b6cafc1ee9a6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.859956 11528 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_bdb8c169c9af4735b29c0aaa9981261f [id=f25d25a79da644d082f3ae135c27f354] alter complete (version 4)
I20250625 14:02:02.864923 12172 tablet_bootstrap.cc:654] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.868265 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 6d2adc01621f40b8bebd532ad491df2f from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.863323 13532 tablet.cc:1722] T 56250a60d7104f22bd4b2206f3a5df14 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.865036 12166 tablet_bootstrap.cc:492] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.868712 12166 ts_tablet_manager.cc:1397] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250625 14:02:02.865973 13535 tablet.cc:1722] T 56250a60d7104f22bd4b2206f3a5df14 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.869396 12166 raft_consensus.cc:357] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.869529 12166 raft_consensus.cc:383] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.869565 12166 raft_consensus.cc:738] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.869670 12166 consensus_queue.cc:260] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.869966 12166 ts_tablet_manager.cc:1428] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.870211 12166 tablet_bootstrap.cc:492] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.870997 13531 tablet.cc:1722] T 56250a60d7104f22bd4b2206f3a5df14 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:02.871186 12166 tablet_bootstrap.cc:654] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.877117 12167 tablet_bootstrap.cc:492] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.877256 12167 ts_tablet_manager.cc:1397] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.166s user 0.002s sys 0.001s
I20250625 14:02:02.877826 12167 raft_consensus.cc:357] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.877952 12167 raft_consensus.cc:383] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.877995 12167 raft_consensus.cc:738] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.878152 12167 consensus_queue.cc:260] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.878504 12167 ts_tablet_manager.cc:1428] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.878722 12167 tablet_bootstrap.cc:492] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.878800 12172 tablet_bootstrap.cc:492] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:02.878895 12172 ts_tablet_manager.cc:1397] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250625 14:02:02.879344 12172 raft_consensus.cc:357] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.879462 12172 raft_consensus.cc:383] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.879495 12172 raft_consensus.cc:738] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.879624 12172 consensus_queue.cc:260] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.879781 12167 tablet_bootstrap.cc:654] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.882972 12172 ts_tablet_manager.cc:1428] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:02.883220 12172 tablet_bootstrap.cc:492] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:02.884235 12172 tablet_bootstrap.cc:654] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.893692 12167 tablet_bootstrap.cc:492] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.893821 12167 ts_tablet_manager.cc:1397] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:02:02.894325 12175 tablet_replica.cc:331] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.894496 12175 raft_consensus.cc:2241] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.894604 12175 raft_consensus.cc:2270] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.894515 12167 raft_consensus.cc:357] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.894651 12167 raft_consensus.cc:383] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.894685 12167 raft_consensus.cc:738] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.895020 12175 ts_tablet_manager.cc:1905] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.895437 12167 consensus_queue.cc:260] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.895888 12167 ts_tablet_manager.cc:1428] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:02.896165 12167 tablet_bootstrap.cc:492] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.897162 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9b01f5c2e7314475804cdc7ea0ba0fcd
I20250625 14:02:02.897847 12167 tablet_bootstrap.cc:654] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.897846 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e82d66db450e41faaa9e5ba2796bed2d
I20250625 14:02:02.897959 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.898399 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet c9a67a7c7c8a4c6eb331676ea4d126a6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.898674 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet e82d66db450e41faaa9e5ba2796bed2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:02.899897 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b01f5c2e7314475804cdc7ea0ba0fcd already in progress: creating tablet
W20250625 14:02:02.900352 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet e82d66db450e41faaa9e5ba2796bed2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e82d66db450e41faaa9e5ba2796bed2d already in progress: creating tablet
I20250625 14:02:02.901108 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.901468 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet e82d66db450e41faaa9e5ba2796bed2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.903736 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_47b438711bb4412895672499cd53a2d0 [id=416264ede8644650b07f6c60ffb3cc52]). Expected version 2 got 0
I20250625 14:02:02.907903 12175 ts_tablet_manager.cc:1918] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.907996 12175 log.cc:1199] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/fa2ccf77288144e5b81513dede9d4302
I20250625 14:02:02.908221 12175 ts_tablet_manager.cc:1939] T fa2ccf77288144e5b81513dede9d4302 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.910101 12175 tablet_replica.cc:331] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.902489 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.910422 12175 raft_consensus.cc:2241] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.910563 12175 raft_consensus.cc:2270] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.910993 12175 ts_tablet_manager.cc:1905] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.902609 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet e82d66db450e41faaa9e5ba2796bed2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:02.912375 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b01f5c2e7314475804cdc7ea0ba0fcd already in progress: creating tablet
W20250625 14:02:02.912580 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet e82d66db450e41faaa9e5ba2796bed2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e82d66db450e41faaa9e5ba2796bed2d already in progress: creating tablet
I20250625 14:02:02.912695 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet bb1d6934ab98482c9ae6b6cafc1ee9a6 (table default.Table_ab0822cedbab4155af1fea06eaf34d5b [id=cab8c809888c4bdbb4ed0ceb7107866f]) successfully deleted
W20250625 14:02:02.912798 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f2f25aaee07242329014de1834ca881d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f25aaee07242329014de1834ca881d already in progress: creating tablet
I20250625 14:02:02.912886 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet fa2ccf77288144e5b81513dede9d4302 (table default.Table_3a4c3cc5db934840bc6467d6478d117e [id=4bba5201a2244ff49ae45267e77136ca]) successfully deleted
W20250625 14:02:02.913018 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 4ed7734f171f4692ba7900844100c878 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ed7734f171f4692ba7900844100c878 already in progress: creating tablet
I20250625 14:02:02.915999 12175 ts_tablet_manager.cc:1918] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.916167 12175 log.cc:1199] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/dce1b63ad2924626972ce7a42a4fdb60
I20250625 14:02:02.916509 12175 ts_tablet_manager.cc:1939] T dce1b63ad2924626972ce7a42a4fdb60 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.917073 12166 tablet_bootstrap.cc:492] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.917171 12166 ts_tablet_manager.cc:1397] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.000s
I20250625 14:02:02.917649 12175 tablet_replica.cc:331] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.917622 12166 raft_consensus.cc:357] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.917740 12166 raft_consensus.cc:383] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.917773 12166 raft_consensus.cc:738] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.917896 12166 consensus_queue.cc:260] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.917984 12175 raft_consensus.cc:2241] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.918092 12175 raft_consensus.cc:2270] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.918188 12166 ts_tablet_manager.cc:1428] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.918401 12166 tablet_bootstrap.cc:492] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.918474 12175 ts_tablet_manager.cc:1905] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.919296 12166 tablet_bootstrap.cc:654] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.919751 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet dce1b63ad2924626972ce7a42a4fdb60 (table default.Table_06e8bc49777a442bbce90e7f4312b059 [id=336fd4d44f664c92b37b98b4f9198459]) successfully deleted
W20250625 14:02:02.919940 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 5df4b218df7d4e4e9e634d3cd4f17633 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5df4b218df7d4e4e9e634d3cd4f17633 already in progress: creating tablet
I20250625 14:02:02.921510 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c9a67a7c7c8a4c6eb331676ea4d126a6
I20250625 14:02:02.921790 11529 catalog_manager.cc:6652] ReplaceTablet: tablet c9a67a7c7c8a4c6eb331676ea4d126a6 deleted and replaced by tablet 1fa9aeec4f564a8b83f055e2e53810ec
I20250625 14:02:02.922554 12167 tablet_bootstrap.cc:492] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.923023 12167 ts_tablet_manager.cc:1397] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20250625 14:02:02.923403 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6d2adc01621f40b8bebd532ad491df2f
I20250625 14:02:02.923653 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 6d2adc01621f40b8bebd532ad491df2f deleted and replaced by tablet 990d03f434044571aa2b61577495ab77
I20250625 14:02:02.923669 12167 raft_consensus.cc:357] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.923837 12167 raft_consensus.cc:383] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.923869 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_17d82633b136412b84fe29a827c8bd5f" } new_table_name: "default.Table_8d26d05c61514ef9b0546647f4587999" modify_external_catalogs: true
I20250625 14:02:02.923911 12167 raft_consensus.cc:738] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.924290 12167 consensus_queue.cc:260] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.923187 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_e6fede9f2fc246539a5250da539ab467 [id=e1d9126672684e808d499d3902fc371b] alter complete (version 2)
I20250625 14:02:02.925872 12175 ts_tablet_manager.cc:1918] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.925962 12175 log.cc:1199] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/df475b9c0f62419a9df86d4e0097dcba
I20250625 14:02:02.926185 12175 ts_tablet_manager.cc:1939] T df475b9c0f62419a9df86d4e0097dcba P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.927059 12175 tablet_replica.cc:331] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.927248 12175 raft_consensus.cc:2241] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.927480 12175 raft_consensus.cc:2270] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.927958 12175 ts_tablet_manager.cc:1905] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.928427 12167 ts_tablet_manager.cc:1428] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:02:02.929665 12167 tablet_bootstrap.cc:492] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.930179 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa9aeec4f564a8b83f055e2e53810ec) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.930685 12175 ts_tablet_manager.cc:1918] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.930816 12175 log.cc:1199] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/dff05950ded34f4bb554badc4ccd3e0f
I20250625 14:02:02.930821 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d99e27063554845bea98bbe70eba3b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e4822e4ed7a405e8940abf314052185) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.931002 12177 tablet_replica.cc:331] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.931124 12167 tablet_bootstrap.cc:654] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.931172 12177 raft_consensus.cc:2241] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.931293 12175 ts_tablet_manager.cc:1939] T dff05950ded34f4bb554badc4ccd3e0f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.931317 12177 raft_consensus.cc:2270] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.931854 12177 ts_tablet_manager.cc:1905] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.934437 12177 ts_tablet_manager.cc:1918] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.934522 12177 log.cc:1199] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8d99e27063554845bea98bbe70eba3b9
I20250625 14:02:02.934737 12177 ts_tablet_manager.cc:1939] T 8d99e27063554845bea98bbe70eba3b9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.935277 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d2adc01621f40b8bebd532ad491df2f with delete_type TABLET_DATA_DELETED (replaced by tablet 990d03f434044571aa2b61577495ab77) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.935914 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d8501126146425baa26ba7741963085) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:02.936060 12177 tablet_replica.cc:331] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:02.936213 12177 raft_consensus.cc:2241] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.936336 12177 raft_consensus.cc:2270] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.936638 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_139840ae17524fa698ac29386ff88f38" } modify_external_catalogs: true
I20250625 14:02:02.936765 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_139840ae17524fa698ac29386ff88f38" } modify_external_catalogs: true
I20250625 14:02:02.936854 12167 tablet_bootstrap.cc:492] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.936970 12167 ts_tablet_manager.cc:1397] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20250625 14:02:02.937489 12167 raft_consensus.cc:357] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.937695 12167 raft_consensus.cc:383] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.937781 12167 raft_consensus.cc:738] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.938007 12167 consensus_queue.cc:260] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:02.938756 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9a67a7c7c8a4c6eb331676ea4d126a6 already in progress: creating tablet
I20250625 14:02:02.939062 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8d99e27063554845bea98bbe70eba3b9 (table default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]) successfully deleted
W20250625 14:02:02.939332 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6d2adc01621f40b8bebd532ad491df2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d2adc01621f40b8bebd532ad491df2f already in progress: creating tablet
I20250625 14:02:02.939888 12172 tablet_bootstrap.cc:492] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:02.939973 12172 ts_tablet_manager.cc:1397] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.000s
I20250625 14:02:02.940135 12265 raft_consensus.cc:491] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.940222 12265 raft_consensus.cc:513] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.940433 12172 raft_consensus.cc:357] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:02.940526 12172 raft_consensus.cc:383] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.940555 12172 raft_consensus.cc:738] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.940634 12265 leader_election.cc:290] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:02.941926 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa9aeec4f564a8b83f055e2e53810ec) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.942373 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d2adc01621f40b8bebd532ad491df2f with delete_type TABLET_DATA_DELETED (replaced by tablet 990d03f434044571aa2b61577495ab77) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:02.942468 11858 leader_election.cc:343] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 128dab7ad46048cc91fc20ddc1431d57
I20250625 14:02:02.941771 12172 consensus_queue.cc:260] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:02.943091 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet dff05950ded34f4bb554badc4ccd3e0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.943286 12173 tablet_replica.cc:331] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:02:02.943405 11855 leader_election.cc:343] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 128dab7ad46048cc91fc20ddc1431d57
I20250625 14:02:02.943462 12173 raft_consensus.cc:2241] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.943480 11855 leader_election.cc:304] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:02.943575 12173 raft_consensus.cc:2270] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.943687 12265 raft_consensus.cc:2747] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:02.943728 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa9aeec4f564a8b83f055e2e53810ec) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.944316 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 628edde0bd0840c6a11c79f8ab810977 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b589e49a8844aa3acb9f8e27c0f6faf) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.944705 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_0edcafdd98474f9591d5f2c451b3775a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.945139 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0edcafdd98474f9591d5f2c451b3775a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.946869 12173 ts_tablet_manager.cc:1905] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.947337 12177 ts_tablet_manager.cc:1905] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.949640 12173 ts_tablet_manager.cc:1918] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.949736 12173 log.cc:1199] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/dff05950ded34f4bb554badc4ccd3e0f
I20250625 14:02:02.949967 12173 ts_tablet_manager.cc:1939] T dff05950ded34f4bb554badc4ccd3e0f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.950416 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 6d2adc01621f40b8bebd532ad491df2f with delete_type TABLET_DATA_DELETED (replaced by tablet 990d03f434044571aa2b61577495ab77) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:02.951486 12177 ts_tablet_manager.cc:1918] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.951572 12177 log.cc:1199] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d4eb86621bba4f3a897d4331ef30dc7f
I20250625 14:02:02.951786 12177 ts_tablet_manager.cc:1939] T d4eb86621bba4f3a897d4331ef30dc7f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:02.952016 12167 ts_tablet_manager.cc:1428] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20250625 14:02:02.952306 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ee455592e1bf4f1596f36d91b207154f" } modify_external_catalogs: true
I20250625 14:02:02.952454 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ee455592e1bf4f1596f36d91b207154f" } modify_external_catalogs: true
I20250625 14:02:02.952574 12167 tablet_bootstrap.cc:492] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.952721 12173 tablet_replica.cc:331] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:02.952814 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_17050ff370b3439593f2c49820554432" } modify_external_catalogs: true
I20250625 14:02:02.952858 12173 raft_consensus.cc:2241] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.952915 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_17050ff370b3439593f2c49820554432" } modify_external_catalogs: true
I20250625 14:02:02.952978 12173 raft_consensus.cc:2270] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.953526 12173 ts_tablet_manager.cc:1905] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.955225 12172 ts_tablet_manager.cc:1428] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:02:02.955976 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 628edde0bd0840c6a11c79f8ab810977 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b589e49a8844aa3acb9f8e27c0f6faf) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.956166 12167 tablet_bootstrap.cc:654] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.956553 12173 ts_tablet_manager.cc:1918] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.956676 12173 log.cc:1199] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/628edde0bd0840c6a11c79f8ab810977
I20250625 14:02:02.956993 12173 ts_tablet_manager.cc:1939] T 628edde0bd0840c6a11c79f8ab810977 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:02.956447 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet df475b9c0f62419a9df86d4e0097dcba (table default.Table_1d2c4f6d9e8d4bd1b81631fc4c99818d [id=d35a23a319d44785bff52098cd7247e4]) successfully deleted
I20250625 14:02:02.957036 11831 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:02.957409 12172 tablet_bootstrap.cc:492] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:02.956681 12104 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:02.961362 12265 raft_consensus.cc:491] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.961483 12265 raft_consensus.cc:513] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.961849 12265 leader_election.cc:290] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:02.962884 11858 leader_election.cc:343] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: c4a906afbc504981942d57221742e822
I20250625 14:02:02.963095 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_de402d9ab83f4c2abf49ddacfaf6bfa2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:02.963227 11855 leader_election.cc:343] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: c4a906afbc504981942d57221742e822
I20250625 14:02:02.963284 11855 leader_election.cc:304] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:02.963459 12265 raft_consensus.cc:2747] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:02.963537 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de402d9ab83f4c2abf49ddacfaf6bfa2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.967077 12175 tablet_replica.cc:331] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.967316 12175 raft_consensus.cc:2241] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.967487 12175 raft_consensus.cc:2270] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.967953 12175 ts_tablet_manager.cc:1905] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:02.968808 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 55ede5e94e12449abbbec9146331deb5 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:02.957726 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet dff05950ded34f4bb554badc4ccd3e0f (table default.Table_8a19bb755ba242b59b812cd643e79646 [id=bc90345f034447a4b5220f58c4b52cf3]) successfully deleted
I20250625 14:02:02.975667 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d4eb86621bba4f3a897d4331ef30dc7f (table default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]) successfully deleted
W20250625 14:02:02.975667 11517 catalog_manager.cc:5001] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): alter failed for tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]),no further retry: Not found: Tablet not found: 837e98e4e48a465fa9c3e697ae34c9ea
I20250625 14:02:02.977509 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet dff05950ded34f4bb554badc4ccd3e0f (table default.Table_8a19bb755ba242b59b812cd643e79646 [id=bc90345f034447a4b5220f58c4b52cf3]) successfully deleted
I20250625 14:02:02.978600 12175 ts_tablet_manager.cc:1918] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.978982 12175 log.cc:1199] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6c8c667108694caab967bd91f74759b6
I20250625 14:02:02.978921 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet e9de91633ba3404d9002d4f27449ea48 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:02.978847 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9a67a7c7c8a4c6eb331676ea4d126a6 already in progress: creating tablet
I20250625 14:02:02.980033 12175 ts_tablet_manager.cc:1939] T 6c8c667108694caab967bd91f74759b6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:02.980422 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 628edde0bd0840c6a11c79f8ab810977 (table default.Table_522af79c54de47dca6f8f5b92399167d [id=f71426341d4c4fe0bd0342ea293e0110]) successfully deleted
I20250625 14:02:02.981299 12166 tablet_bootstrap.cc:492] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.981386 12166 ts_tablet_manager.cc:1397] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.000s
I20250625 14:02:02.981396 12167 tablet_bootstrap.cc:492] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:02.981495 12167 ts_tablet_manager.cc:1397] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.001s
I20250625 14:02:02.981880 12166 raft_consensus.cc:357] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.982002 12166 raft_consensus.cc:383] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.982038 12166 raft_consensus.cc:738] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.982089 12167 raft_consensus.cc:357] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.982161 12166 consensus_queue.cc:260] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:02.982203 12167 raft_consensus.cc:383] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.982244 12167 raft_consensus.cc:738] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
W20250625 14:02:02.982115 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 6d2adc01621f40b8bebd532ad491df2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d2adc01621f40b8bebd532ad491df2f already in progress: creating tablet
I20250625 14:02:02.982414 12167 consensus_queue.cc:260] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.982506 12166 ts_tablet_manager.cc:1428] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.982713 12166 tablet_bootstrap.cc:492] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.982712 12167 ts_tablet_manager.cc:1428] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:02.982897 12167 tablet_bootstrap.cc:492] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:02.983611 12166 tablet_bootstrap.cc:654] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.983850 12167 tablet_bootstrap.cc:654] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.988788 12175 tablet_replica.cc:331] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:02.982568 12172 tablet_bootstrap.cc:654] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.989058 12175 raft_consensus.cc:2241] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:02.989228 12175 raft_consensus.cc:2270] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:02.989902 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 31f843108ecf440090c05255afa1687e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:02.990247 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4f53ff9a13b84b4c997fd1123d48f383"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:02.990610 12175 ts_tablet_manager.cc:1905] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:02.990684 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f53ff9a13b84b4c997fd1123d48f383 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:02.993841 12175 ts_tablet_manager.cc:1918] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:02.994004 12175 log.cc:1199] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b3819dec2c834c40846dcb3a11fa4f5f
I20250625 14:02:02.994066 12166 tablet_bootstrap.cc:492] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:02.994184 12166 ts_tablet_manager.cc:1397] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:02.994745 12166 raft_consensus.cc:357] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.994861 12166 raft_consensus.cc:383] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:02.994896 12166 raft_consensus.cc:738] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:02.995030 12166 consensus_queue.cc:260] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:02.995335 12166 ts_tablet_manager.cc:1428] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:02.995555 12166 tablet_bootstrap.cc:492] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:02.996711 12166 tablet_bootstrap.cc:654] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:02.997396 12265 raft_consensus.cc:491] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:02.997478 12265 raft_consensus.cc:513] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:02.997841 12265 leader_election.cc:290] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:02.999572 11858 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 082a46d213c545b18acbcac1b699d140
W20250625 14:02:03.000962 11855 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 082a46d213c545b18acbcac1b699d140
I20250625 14:02:03.001057 11855 leader_election.cc:304] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:03.001385 12600 raft_consensus.cc:2747] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:03.001317 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6c8c667108694caab967bd91f74759b6 (table default.Table_d0b3e2e69d20402f990444c966a8f3c0 [id=2e114a17eddf47f4b5522bcdad81bd16]) successfully deleted
W20250625 14:02:03.002370 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet ae35e73e14994aa7bd2820d5ceebcf76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae35e73e14994aa7bd2820d5ceebcf76 already in progress: creating tablet
I20250625 14:02:03.003360 12175 ts_tablet_manager.cc:1939] T b3819dec2c834c40846dcb3a11fa4f5f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:02:03.003360 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f7808bed1b8f4103bf728b8a525dad5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7808bed1b8f4103bf728b8a525dad5d already in progress: creating tablet
I20250625 14:02:03.004328 12166 tablet_bootstrap.cc:492] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.004426 12166 ts_tablet_manager.cc:1397] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
W20250625 14:02:03.004382 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 4e95e6f8df9c4883b3a19f8741ecb431 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e95e6f8df9c4883b3a19f8741ecb431 already in progress: creating tablet
W20250625 14:02:03.004807 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7ff70668bede407c816db9779ce5221d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ff70668bede407c816db9779ce5221d already in progress: creating tablet
I20250625 14:02:03.004979 12166 raft_consensus.cc:357] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.005085 12166 raft_consensus.cc:383] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.005117 12166 raft_consensus.cc:738] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.005250 12166 consensus_queue.cc:260] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:03.005332 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 75562ea1650c4bdcbf38574465f62ce2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75562ea1650c4bdcbf38574465f62ce2 already in progress: creating tablet
I20250625 14:02:03.005559 12166 ts_tablet_manager.cc:1428] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:03.005853 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 2e4822e4ed7a405e8940abf314052185 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e4822e4ed7a405e8940abf314052185 already in progress: creating tablet
I20250625 14:02:03.006220 12172 tablet_bootstrap.cc:492] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.006335 12172 ts_tablet_manager.cc:1397] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20250625 14:02:03.006808 12172 raft_consensus.cc:357] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.006999 12172 raft_consensus.cc:383] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.007073 12172 raft_consensus.cc:738] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.009049 12166 tablet_bootstrap.cc:492] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.008965 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b3819dec2c834c40846dcb3a11fa4f5f (table default.Table_2037e3cc66de4c68bc580a95e021e860 [id=46617722da444cc58422a5ce1d383cb0]) successfully deleted
I20250625 14:02:03.009685 12172 consensus_queue.cc:260] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.010197 12166 tablet_bootstrap.cc:654] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.010820 12172 ts_tablet_manager.cc:1428] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:03.015095 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_47b438711bb4412895672499cd53a2d0 [id=416264ede8644650b07f6c60ffb3cc52]). Expected version 2 got 0
I20250625 14:02:03.015791 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b8ab1901af5043e58269241598c81482" } new_table_name: "default.Table_4faa1262ecb3411c80b52f71f6418114" modify_external_catalogs: true
I20250625 14:02:03.015930 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5e70bbb4cf7547faa9581674e5c46cc2" } new_table_name: "default.Table_a3abe4bcfef84e699da5c76f2ea31feb" modify_external_catalogs: true
I20250625 14:02:03.016590 12175 tablet_replica.cc:331] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.016800 12175 raft_consensus.cc:2241] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.016938 12175 raft_consensus.cc:2270] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.017252 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e616a8e959f54cbdad84ecef02057829"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.017525 12175 ts_tablet_manager.cc:1905] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:03.017640 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e616a8e959f54cbdad84ecef02057829 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.022082 12175 ts_tablet_manager.cc:1918] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.022287 12175 log.cc:1199] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/128dab7ad46048cc91fc20ddc1431d57
I20250625 14:02:03.022567 11915 raft_consensus.cc:3058] T b5c6c654c5704a41987a8d2016ab32b4 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.022686 12175 ts_tablet_manager.cc:1939] T 128dab7ad46048cc91fc20ddc1431d57 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.023586 12175 tablet_replica.cc:331] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:02:03.023886 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d73b0124af54007b4e16a3f653836af consensus state has no leader
I20250625 14:02:03.024114 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet f5e271b27ac349d6bb8cf47aa8b9668a from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.029706 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_75938816cd3645378c59436086614ed8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.029804 12175 raft_consensus.cc:2241] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.030042 12175 raft_consensus.cc:2270] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:03.030112 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75938816cd3645378c59436086614ed8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.031075 12175 ts_tablet_manager.cc:1905] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.018982 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 2ca031c3707f4b4ea3a734081ae57a70 (DEFAULT_TABLE table=default.Table_a2dfbabfeab54b618fc02d53b577e01e [id=7dbbdcf7722b458cb461a45b4a27ddd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.032490 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca031c3707f4b4ea3a734081ae57a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.035101 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 8598123fc94c40d68904cde7f83634ed (DEFAULT_TABLE table=default.Table_b2a1c6f9e7c44a158891bc3de8408c68 [id=740c4a0d6da04298a41b93ba5dd20acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.035369 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8598123fc94c40d68904cde7f83634ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.035578 12175 ts_tablet_manager.cc:1918] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:03.035761 12175 log.cc:1199] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/837e98e4e48a465fa9c3e697ae34c9ea
I20250625 14:02:03.036222 12175 ts_tablet_manager.cc:1939] T 837e98e4e48a465fa9c3e697ae34c9ea P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.019253 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 372c9793e7fb433ba1b62ae520250ab7 (DEFAULT_TABLE table=default.Table_785978d07adb44d1832da1da036c86e0 [id=fb1a0e1a0eec43fdb99be2db268aa363]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.038122 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372c9793e7fb433ba1b62ae520250ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.019361 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cb56a7e714d45038feaf1132a5e06af with delete_type TABLET_DATA_DELETED (replaced by tablet 725a0db4c6374805903657f755ca1783) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.038522 12177 tablet_replica.cc:331] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.038630 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 4f9f1bb1076b4dfda5e6206cea5df312 (DEFAULT_TABLE table=default.Table_cfe4202157b64beda5dac0c9c5b5f80c [id=e49f6819db224436acc2df3b6c355c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.038862 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9f1bb1076b4dfda5e6206cea5df312. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.039811 12167 tablet_bootstrap.cc:492] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.039913 12167 ts_tablet_manager.cc:1397] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.000s
I20250625 14:02:03.039950 12175 tablet_replica.cc:331] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.040174 12175 raft_consensus.cc:2241] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.040359 12175 raft_consensus.cc:2270] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.040511 12167 raft_consensus.cc:357] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.040633 12167 raft_consensus.cc:383] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.040668 12167 raft_consensus.cc:738] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.040827 12167 consensus_queue.cc:260] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.041077 11756 tablet_service.cc:1468] Processing CreateTablet for tablet f66aff43813a4455aca34d82e7a4c1a3 (DEFAULT_TABLE table=default.Table_a8cf7c9cdc674edd9250a057b4c4e28a [id=aa530da6a9ad4cd188066b7e2a9f6e16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.041115 12167 ts_tablet_manager.cc:1428] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.041217 12175 ts_tablet_manager.cc:1905] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.041309 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66aff43813a4455aca34d82e7a4c1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.041368 12167 tablet_bootstrap.cc:492] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.021279 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 0fa45ae948254d51bf545969d7587fc7 (DEFAULT_TABLE table=default.Table_3a5a410c796c42c2b28e41b58263b19a [id=f6301381a1af44bf91ed7a00812c62ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.021754 11755 tablet_service.cc:1468] Processing CreateTablet for tablet 060fdb27749049d48664b30a23afa37f (DEFAULT_TABLE table=default.Table_5ee07cda0c99450d88a6ea98b3f81901 [id=3e5bda022c7c41518c3791968bfa82ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.022140 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 6f7ca3dce9494136ac625a6979a8da03 (DEFAULT_TABLE table=default.Table_375b905217c342d7ae85bc905acc07c9 [id=c3078002a2874dc1a46038edbb8adc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.022181 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 022a3fb45dda44cfa58273f7fdb65d6e (DEFAULT_TABLE table=default.Table_ac5d44672af04e189c94e99f0c66515e [id=1d5804ba11c84759b1ac945fdc5d15ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.022415 11760 tablet_service.cc:1468] Processing CreateTablet for tablet df57043b1da2406a800aea1081600740 (DEFAULT_TABLE table=default.Table_139840ae17524fa698ac29386ff88f38 [id=a2076108de85461bb79ec366e6cbefba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.022642 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 21b0e99fed5e410b964ca71432a2a704 (DEFAULT_TABLE table=default.Table_673d4f709a6046da8ce9e476d447782f [id=18f06c8ac89641ec92a37f83d70ae6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.022861 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 00eced716772420a91849c371ed35486 (DEFAULT_TABLE table=default.Table_99d99d9329bb457a9b08726b913019ab [id=244b8d9e95214e5ba75ff76377e673c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.042584 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa45ae948254d51bf545969d7587fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.022878 11748 tablet_service.cc:1468] Processing CreateTablet for tablet 5321fcb7bece43098c638eaa8c5d121d (DEFAULT_TABLE table=default.Table_edb4e5a8013a4b3bbe858f99d1dd630b [id=3598950292934387bad368af6b1fdc4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.023054 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 809f57b6886a42ca90af05f24ae9f8f5 (DEFAULT_TABLE table=default.Table_98901b44c78a49e5ad4f237149a0ca11 [id=19d648a47ed640d68eb029dcfa07f440]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.021940 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 (DEFAULT_TABLE table=default.Table_2baa220e01444322a4a589f1757b7ed7 [id=2c825331d8de49adace9f09298d17f01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.023252 11752 tablet_service.cc:1468] Processing CreateTablet for tablet bd256d017f8448dcae20baacebbdcf09 (DEFAULT_TABLE table=default.Table_e0a12379205a43b5be2ab7462a0db148 [id=a799b0d61fef46e7840f6c885d6c3440]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.024832 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 9b2af6e1b3524fe69352dce05784fa5f (DEFAULT_TABLE table=default.Table_5847bff0cf8442b7aa5507ff6d3d293c [id=8ef2ada0d586471c929a2fee686df3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.023821 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 0805f8be98bc45efb901ca138e425908 (DEFAULT_TABLE table=default.Table_75443e5e812b45d9bc5d267fc83bde83 [id=42b227ba030346b09b1e987c80ae0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.026716 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 3a2a685254f8447d977fda8fb8dc6e0d (DEFAULT_TABLE table=default.Table_86ae8abcddf74fbf84c7d743f803e7d3 [id=c0f0354c5b0348f98ea019b8a09fa4b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.027504 11746 tablet_service.cc:1468] Processing CreateTablet for tablet 3246a7f3fa924b268ba4e263754cb4fd (DEFAULT_TABLE table=default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.046270 12167 tablet_bootstrap.cc:654] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.028820 11745 tablet_service.cc:1468] Processing CreateTablet for tablet 11d75509046746fe8016c9182923d83c (DEFAULT_TABLE table=default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.026755 11747 tablet_service.cc:1468] Processing CreateTablet for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 (DEFAULT_TABLE table=default.Table_b8ab1901af5043e58269241598c81482 [id=5a6188df168f48048057af1707d743ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.038676 12177 raft_consensus.cc:2241] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.047783 12177 raft_consensus.cc:2270] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.048058 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 (DEFAULT_TABLE table=default.Table_2baa220e01444322a4a589f1757b7ed7 [id=2c825331d8de49adace9f09298d17f01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.048135 11763 tablet_service.cc:1468] Processing CreateTablet for tablet fd9424c993d2416c85604a188c349ad5 (DEFAULT_TABLE table=default.Table_6826e63ce5054cbea665e81b978621cf [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.048331 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db1f7bf20fa47ccb4e937f21ea0d020. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.048671 11762 tablet_service.cc:1468] Processing CreateTablet for tablet bf448c94caf447bd8ddbad9c6ace0712 (DEFAULT_TABLE table=default.Table_533afd5e6bb14c7697c5652f2c8ee713 [id=b7922d34fc8e4ddabe12e07003b3171c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.050560 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 (DEFAULT_TABLE table=default.Table_2baa220e01444322a4a589f1757b7ed7 [id=2c825331d8de49adace9f09298d17f01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.051537 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 022a3fb45dda44cfa58273f7fdb65d6e (DEFAULT_TABLE table=default.Table_ac5d44672af04e189c94e99f0c66515e [id=1d5804ba11c84759b1ac945fdc5d15ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.051685 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db1f7bf20fa47ccb4e937f21ea0d020. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.051309 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 022a3fb45dda44cfa58273f7fdb65d6e (DEFAULT_TABLE table=default.Table_ac5d44672af04e189c94e99f0c66515e [id=1d5804ba11c84759b1ac945fdc5d15ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.051765 12028 tablet_service.cc:1468] Processing CreateTablet for tablet df57043b1da2406a800aea1081600740 (DEFAULT_TABLE table=default.Table_139840ae17524fa698ac29386ff88f38 [id=a2076108de85461bb79ec366e6cbefba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.052034 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022a3fb45dda44cfa58273f7fdb65d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.052184 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df57043b1da2406a800aea1081600740. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.052320 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022a3fb45dda44cfa58273f7fdb65d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.055015 12175 ts_tablet_manager.cc:1918] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.055215 12175 log.cc:1199] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/268638793ff44216aa0663b0a3568940
I20250625 14:02:03.055639 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 21b0e99fed5e410b964ca71432a2a704 (DEFAULT_TABLE table=default.Table_673d4f709a6046da8ce9e476d447782f [id=18f06c8ac89641ec92a37f83d70ae6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.055784 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 21b0e99fed5e410b964ca71432a2a704 (DEFAULT_TABLE table=default.Table_673d4f709a6046da8ce9e476d447782f [id=18f06c8ac89641ec92a37f83d70ae6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.055900 11890 tablet_service.cc:1468] Processing CreateTablet for tablet df57043b1da2406a800aea1081600740 (DEFAULT_TABLE table=default.Table_139840ae17524fa698ac29386ff88f38 [id=a2076108de85461bb79ec366e6cbefba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.056026 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b0e99fed5e410b964ca71432a2a704. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.056068 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b0e99fed5e410b964ca71432a2a704. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.056248 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df57043b1da2406a800aea1081600740. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.058909 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 2ca031c3707f4b4ea3a734081ae57a70 (DEFAULT_TABLE table=default.Table_a2dfbabfeab54b618fc02d53b577e01e [id=7dbbdcf7722b458cb461a45b4a27ddd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.059077 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 2ca031c3707f4b4ea3a734081ae57a70 (DEFAULT_TABLE table=default.Table_a2dfbabfeab54b618fc02d53b577e01e [id=7dbbdcf7722b458cb461a45b4a27ddd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.059197 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca031c3707f4b4ea3a734081ae57a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.059303 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca031c3707f4b4ea3a734081ae57a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.061910 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 00eced716772420a91849c371ed35486 (DEFAULT_TABLE table=default.Table_99d99d9329bb457a9b08726b913019ab [id=244b8d9e95214e5ba75ff76377e673c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.062054 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 00eced716772420a91849c371ed35486 (DEFAULT_TABLE table=default.Table_99d99d9329bb457a9b08726b913019ab [id=244b8d9e95214e5ba75ff76377e673c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.062175 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00eced716772420a91849c371ed35486. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.062284 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00eced716772420a91849c371ed35486. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.065023 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 809f57b6886a42ca90af05f24ae9f8f5 (DEFAULT_TABLE table=default.Table_98901b44c78a49e5ad4f237149a0ca11 [id=19d648a47ed640d68eb029dcfa07f440]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.064970 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 809f57b6886a42ca90af05f24ae9f8f5 (DEFAULT_TABLE table=default.Table_98901b44c78a49e5ad4f237149a0ca11 [id=19d648a47ed640d68eb029dcfa07f440]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.065294 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809f57b6886a42ca90af05f24ae9f8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.065688 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809f57b6886a42ca90af05f24ae9f8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.070525 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 12c5e71b4a4f4efc81f822bdf95d0f99 with delete_type TABLET_DATA_DELETED (replaced by tablet 31f843108ecf440090c05255afa1687e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.070763 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 7491e070e86346b681817fb19d4608f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.070858 12173 tablet_replica.cc:331] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.071024 12173 raft_consensus.cc:2241] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.071135 12173 raft_consensus.cc:2270] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.071568 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 372c9793e7fb433ba1b62ae520250ab7 (DEFAULT_TABLE table=default.Table_785978d07adb44d1832da1da036c86e0 [id=fb1a0e1a0eec43fdb99be2db268aa363]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.071914 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 372c9793e7fb433ba1b62ae520250ab7 (DEFAULT_TABLE table=default.Table_785978d07adb44d1832da1da036c86e0 [id=fb1a0e1a0eec43fdb99be2db268aa363]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.072301 12173 ts_tablet_manager.cc:1905] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.072469 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 0fa45ae948254d51bf545969d7587fc7 (DEFAULT_TABLE table=default.Table_3a5a410c796c42c2b28e41b58263b19a [id=f6301381a1af44bf91ed7a00812c62ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.072531 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372c9793e7fb433ba1b62ae520250ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.072742 11890 tablet_service.cc:1468] Processing CreateTablet for tablet bd256d017f8448dcae20baacebbdcf09 (DEFAULT_TABLE table=default.Table_e0a12379205a43b5be2ab7462a0db148 [id=a799b0d61fef46e7840f6c885d6c3440]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.072944 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd256d017f8448dcae20baacebbdcf09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.072813 12028 tablet_service.cc:1468] Processing CreateTablet for tablet bd256d017f8448dcae20baacebbdcf09 (DEFAULT_TABLE table=default.Table_e0a12379205a43b5be2ab7462a0db148 [id=a799b0d61fef46e7840f6c885d6c3440]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.073321 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa45ae948254d51bf545969d7587fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.075111 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 0fa45ae948254d51bf545969d7587fc7 (DEFAULT_TABLE table=default.Table_3a5a410c796c42c2b28e41b58263b19a [id=f6301381a1af44bf91ed7a00812c62ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.075384 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa45ae948254d51bf545969d7587fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.075855 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372c9793e7fb433ba1b62ae520250ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.077093 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd256d017f8448dcae20baacebbdcf09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.078473 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 060fdb27749049d48664b30a23afa37f (DEFAULT_TABLE table=default.Table_5ee07cda0c99450d88a6ea98b3f81901 [id=3e5bda022c7c41518c3791968bfa82ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.078666 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 060fdb27749049d48664b30a23afa37f (DEFAULT_TABLE table=default.Table_5ee07cda0c99450d88a6ea98b3f81901 [id=3e5bda022c7c41518c3791968bfa82ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.078728 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060fdb27749049d48664b30a23afa37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.078933 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060fdb27749049d48664b30a23afa37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.081483 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 6f7ca3dce9494136ac625a6979a8da03 (DEFAULT_TABLE table=default.Table_375b905217c342d7ae85bc905acc07c9 [id=c3078002a2874dc1a46038edbb8adc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.081645 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 6f7ca3dce9494136ac625a6979a8da03 (DEFAULT_TABLE table=default.Table_375b905217c342d7ae85bc905acc07c9 [id=c3078002a2874dc1a46038edbb8adc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.081739 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7ca3dce9494136ac625a6979a8da03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.081911 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7ca3dce9494136ac625a6979a8da03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.084524 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 5321fcb7bece43098c638eaa8c5d121d (DEFAULT_TABLE table=default.Table_edb4e5a8013a4b3bbe858f99d1dd630b [id=3598950292934387bad368af6b1fdc4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.084800 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5321fcb7bece43098c638eaa8c5d121d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.085100 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 5321fcb7bece43098c638eaa8c5d121d (DEFAULT_TABLE table=default.Table_edb4e5a8013a4b3bbe858f99d1dd630b [id=3598950292934387bad368af6b1fdc4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.085374 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5321fcb7bece43098c638eaa8c5d121d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.087004 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 0805f8be98bc45efb901ca138e425908 (DEFAULT_TABLE table=default.Table_75443e5e812b45d9bc5d267fc83bde83 [id=42b227ba030346b09b1e987c80ae0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.088042 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0805f8be98bc45efb901ca138e425908. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.088351 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 0805f8be98bc45efb901ca138e425908 (DEFAULT_TABLE table=default.Table_75443e5e812b45d9bc5d267fc83bde83 [id=42b227ba030346b09b1e987c80ae0436]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.088819 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0805f8be98bc45efb901ca138e425908. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.088795 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 9b2af6e1b3524fe69352dce05784fa5f (DEFAULT_TABLE table=default.Table_5847bff0cf8442b7aa5507ff6d3d293c [id=8ef2ada0d586471c929a2fee686df3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.089497 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 3a2a685254f8447d977fda8fb8dc6e0d (DEFAULT_TABLE table=default.Table_86ae8abcddf74fbf84c7d743f803e7d3 [id=c0f0354c5b0348f98ea019b8a09fa4b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.089684 12036 tablet_service.cc:1468] Processing CreateTablet for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 (DEFAULT_TABLE table=default.Table_b8ab1901af5043e58269241598c81482 [id=5a6188df168f48048057af1707d743ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.089740 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a2a685254f8447d977fda8fb8dc6e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.089210 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 9b2af6e1b3524fe69352dce05784fa5f (DEFAULT_TABLE table=default.Table_5847bff0cf8442b7aa5507ff6d3d293c [id=8ef2ada0d586471c929a2fee686df3ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.089912 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.090718 11894 tablet_service.cc:1468] Processing CreateTablet for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 (DEFAULT_TABLE table=default.Table_b8ab1901af5043e58269241598c81482 [id=5a6188df168f48048057af1707d743ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.090854 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 3246a7f3fa924b268ba4e263754cb4fd (DEFAULT_TABLE table=default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.090932 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.091079 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3246a7f3fa924b268ba4e263754cb4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.092072 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2af6e1b3524fe69352dce05784fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.092796 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2af6e1b3524fe69352dce05784fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.093293 12175 ts_tablet_manager.cc:1939] T 268638793ff44216aa0663b0a3568940 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.097031 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 3246a7f3fa924b268ba4e263754cb4fd (DEFAULT_TABLE table=default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.097311 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3246a7f3fa924b268ba4e263754cb4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.089287 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 3a2a685254f8447d977fda8fb8dc6e0d (DEFAULT_TABLE table=default.Table_86ae8abcddf74fbf84c7d743f803e7d3 [id=c0f0354c5b0348f98ea019b8a09fa4b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.097941 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a2a685254f8447d977fda8fb8dc6e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.098239 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 11d75509046746fe8016c9182923d83c (DEFAULT_TABLE table=default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.098531 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d75509046746fe8016c9182923d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.098802 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 8598123fc94c40d68904cde7f83634ed (DEFAULT_TABLE table=default.Table_b2a1c6f9e7c44a158891bc3de8408c68 [id=740c4a0d6da04298a41b93ba5dd20acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.099027 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8598123fc94c40d68904cde7f83634ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.098603 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 8598123fc94c40d68904cde7f83634ed (DEFAULT_TABLE table=default.Table_b2a1c6f9e7c44a158891bc3de8408c68 [id=740c4a0d6da04298a41b93ba5dd20acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.099754 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 11d75509046746fe8016c9182923d83c (DEFAULT_TABLE table=default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.102723 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 4f9f1bb1076b4dfda5e6206cea5df312 (DEFAULT_TABLE table=default.Table_cfe4202157b64beda5dac0c9c5b5f80c [id=e49f6819db224436acc2df3b6c355c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.102797 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d75509046746fe8016c9182923d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.102957 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9f1bb1076b4dfda5e6206cea5df312. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.102423 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 4f9f1bb1076b4dfda5e6206cea5df312 (DEFAULT_TABLE table=default.Table_cfe4202157b64beda5dac0c9c5b5f80c [id=e49f6819db224436acc2df3b6c355c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.104032 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8598123fc94c40d68904cde7f83634ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.105590 12036 tablet_service.cc:1468] Processing CreateTablet for tablet f66aff43813a4455aca34d82e7a4c1a3 (DEFAULT_TABLE table=default.Table_a8cf7c9cdc674edd9250a057b4c4e28a [id=aa530da6a9ad4cd188066b7e2a9f6e16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.105590 11901 tablet_service.cc:1468] Processing CreateTablet for tablet f66aff43813a4455aca34d82e7a4c1a3 (DEFAULT_TABLE table=default.Table_a8cf7c9cdc674edd9250a057b4c4e28a [id=aa530da6a9ad4cd188066b7e2a9f6e16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.105850 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66aff43813a4455aca34d82e7a4c1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.048731 12177 ts_tablet_manager.cc:1905] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.048928 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9424c993d2416c85604a188c349ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.108542 11901 tablet_service.cc:1468] Processing CreateTablet for tablet fd9424c993d2416c85604a188c349ad5 (DEFAULT_TABLE table=default.Table_6826e63ce5054cbea665e81b978621cf [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.108798 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9424c993d2416c85604a188c349ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.108800 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66aff43813a4455aca34d82e7a4c1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.109982 12034 tablet_service.cc:1468] Processing CreateTablet for tablet fd9424c993d2416c85604a188c349ad5 (DEFAULT_TABLE table=default.Table_6826e63ce5054cbea665e81b978621cf [id=0cc4d60231684c63a378ce32eadc8106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.110164 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 128dab7ad46048cc91fc20ddc1431d57 (table default.Table_712e366118ea4a03a6e8a0f811b4a27d [id=da18d76cf3bc4ae79e0b3a779454d907]) successfully deleted
I20250625 14:02:03.110404 12033 tablet_service.cc:1468] Processing CreateTablet for tablet bf448c94caf447bd8ddbad9c6ace0712 (DEFAULT_TABLE table=default.Table_533afd5e6bb14c7697c5652f2c8ee713 [id=b7922d34fc8e4ddabe12e07003b3171c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.110961 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 837e98e4e48a465fa9c3e697ae34c9ea (table default.Table_ed347c6c07c34e2f8d012b4137ef0af3 [id=740dddd095854d55afb3091ebf06d72f]) successfully deleted
W20250625 14:02:03.111145 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1d2cf613b4404dbb89de199e089f0116 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2cf613b4404dbb89de199e089f0116 already in progress: creating tablet
W20250625 14:02:03.111271 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 185a1a5f14344caa89473baa57f0b02d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 185a1a5f14344caa89473baa57f0b02d already in progress: creating tablet
I20250625 14:02:03.110754 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9f1bb1076b4dfda5e6206cea5df312. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.111923 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf448c94caf447bd8ddbad9c6ace0712. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.112629 12177 ts_tablet_manager.cc:1918] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.112699 12177 log.cc:1199] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/9cb56a7e714d45038feaf1132a5e06af
I20250625 14:02:03.112898 12177 ts_tablet_manager.cc:1939] T 9cb56a7e714d45038feaf1132a5e06af P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.113171 11746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3246a7f3fa924b268ba4e263754cb4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.113932 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 268638793ff44216aa0663b0a3568940 (table default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]) successfully deleted
I20250625 14:02:03.114269 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9424c993d2416c85604a188c349ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.115749 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7ca3dce9494136ac625a6979a8da03. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.117827 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0805f8be98bc45efb901ca138e425908. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.119225 12175 tablet_replica.cc:331] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.119927 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df57043b1da2406a800aea1081600740. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.120149 12167 tablet_bootstrap.cc:492] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.120249 12167 ts_tablet_manager.cc:1397] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.000s
I20250625 14:02:03.120785 12167 raft_consensus.cc:357] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.120891 12167 raft_consensus.cc:383] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.120640 12175 raft_consensus.cc:2241] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.120924 12167 raft_consensus.cc:738] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.121079 12167 consensus_queue.cc:260] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.121385 12167 ts_tablet_manager.cc:1428] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.121601 12167 tablet_bootstrap.cc:492] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.121455 12175 raft_consensus.cc:2270] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.122027 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00eced716772420a91849c371ed35486. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.123900 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022a3fb45dda44cfa58273f7fdb65d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.125676 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809f57b6886a42ca90af05f24ae9f8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.127575 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd256d017f8448dcae20baacebbdcf09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.128257 12167 tablet_bootstrap.cc:654] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.128065 12175 ts_tablet_manager.cc:1905] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.129582 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060fdb27749049d48664b30a23afa37f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:03.132578 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 2dc474dd92134a96a8e755537fd431c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dc474dd92134a96a8e755537fd431c6 already in progress: creating tablet
I20250625 14:02:03.134613 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b0e99fed5e410b964ca71432a2a704. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.135324 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet df57043b1da2406a800aea1081600740
I20250625 14:02:03.137419 12175 ts_tablet_manager.cc:1918] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.137570 12175 log.cc:1199] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c4a906afbc504981942d57221742e822
I20250625 14:02:03.137603 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5ea3aa2ef74f467dbb4238f58028a270
I20250625 14:02:03.138092 12175 ts_tablet_manager.cc:1939] T c4a906afbc504981942d57221742e822 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.138084 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_545ed70704b9480980d400c1c14a4edf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.138456 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e9de91633ba3404d9002d4f27449ea48
W20250625 14:02:03.138605 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_545ed70704b9480980d400c1c14a4edf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.138690 11531 catalog_manager.cc:6652] ReplaceTablet: tablet e9de91633ba3404d9002d4f27449ea48 deleted and replaced by tablet 6a2969a3b9574196b4a8b962cbd09b11
I20250625 14:02:03.138861 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_74d4c613af8640fdbbc68a8c323375a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.139186 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74d4c613af8640fdbbc68a8c323375a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.139652 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b70d39bc77e04f20837ca83f42058db5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.139974 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b70d39bc77e04f20837ca83f42058db5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.140697 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 75f6dce2462e47cca6a262eb3f871f06
I20250625 14:02:03.141088 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c82fd0cae3c6425fab9bc4911fd81d51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.141415 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c82fd0cae3c6425fab9bc4911fd81d51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.141584 12175 tablet_replica.cc:331] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.141815 12175 raft_consensus.cc:2241] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.142095 12175 raft_consensus.cc:2270] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.142166 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f5e271b27ac349d6bb8cf47aa8b9668a
I20250625 14:02:03.142517 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5321fcb7bece43098c638eaa8c5d121d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:03.142524 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 93a420268757402b8cd0609b79187e8b consensus state has no leader
I20250625 14:02:03.142716 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_360fe7f59412486a937f42de9bb0bf9a" } new_table_name: "default.Table_71ef7f1a37884d13b6e66e0635ecdf6b" modify_external_catalogs: true
I20250625 14:02:03.144084 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.145524 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2af6e1b3524fe69352dce05784fa5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.145577 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b8218761d9fd4d17889a2b82dc4a9cea" } new_table_name: "default.Table_c19538ed4dc54dc28630c3cce5efe689" modify_external_catalogs: true
I20250625 14:02:03.146440 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d75509046746fe8016c9182923d83c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.146509 12175 ts_tablet_manager.cc:1905] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.147220 11529 catalog_manager.cc:6652] ReplaceTablet: tablet f5e271b27ac349d6bb8cf47aa8b9668a deleted and replaced by tablet d66fe36f250c45a3bc7df9c3dc05be12
I20250625 14:02:03.147413 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_14086cdd295d418ca5f7e209ed33ede6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.147728 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14086cdd295d418ca5f7e209ed33ede6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.148330 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a2a685254f8447d977fda8fb8dc6e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.148687 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 55ede5e94e12449abbbec9146331deb5
I20250625 14:02:03.148906 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 55ede5e94e12449abbbec9146331deb5 deleted and replaced by tablet 73f64982ad194dfe9dcbf6b77e047db2
I20250625 14:02:03.149055 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f67df6002e4a4dbab5f5e582fd21e7a3" } modify_external_catalogs: true
I20250625 14:02:03.149134 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f67df6002e4a4dbab5f5e582fd21e7a3" } modify_external_catalogs: true
I20250625 14:02:03.149727 12175 ts_tablet_manager.cc:1918] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.149802 12175 log.cc:1199] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/628edde0bd0840c6a11c79f8ab810977
I20250625 14:02:03.150038 12175 ts_tablet_manager.cc:1939] T 628edde0bd0840c6a11c79f8ab810977 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.150142 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db1f7bf20fa47ccb4e937f21ea0d020. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.150825 12175 tablet_replica.cc:331] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:02:03.150821 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 consensus state has no leader
I20250625 14:02:03.151010 12175 raft_consensus.cc:2241] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.151021 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_67a78b6cc247483798a3ca2332498af2" } modify_external_catalogs: true
I20250625 14:02:03.151103 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_67a78b6cc247483798a3ca2332498af2" } modify_external_catalogs: true
I20250625 14:02:03.151141 12175 raft_consensus.cc:2270] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.151686 12175 ts_tablet_manager.cc:1905] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.097707 12173 ts_tablet_manager.cc:1918] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.153187 12173 log.cc:1199] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/12c5e71b4a4f4efc81f822bdf95d0f99
I20250625 14:02:03.153599 12173 ts_tablet_manager.cc:1939] T 12c5e71b4a4f4efc81f822bdf95d0f99 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.153928 12175 ts_tablet_manager.cc:1918] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.154021 12175 log.cc:1199] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/12c5e71b4a4f4efc81f822bdf95d0f99
I20250625 14:02:03.154336 12175 ts_tablet_manager.cc:1939] T 12c5e71b4a4f4efc81f822bdf95d0f99 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.154736 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 10fa4d981de8405ebf2a1bdb82a41cd3 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.155001 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 12c5e71b4a4f4efc81f822bdf95d0f99 (table default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]) successfully deleted
I20250625 14:02:03.155047 12175 tablet_replica.cc:331] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.155176 12175 raft_consensus.cc:2241] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.155336 12175 raft_consensus.cc:2270] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.155484 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet df57043b1da2406a800aea1081600740 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.155912 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet f0833d0e013f48f78cb6c616481b5dce with delete_type TABLET_DATA_DELETED (replaced by tablet 6980c62d63b34c67ad095ad9ea18a3f1) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.155951 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 7491e070e86346b681817fb19d4608f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.156241 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ea3aa2ef74f467dbb4238f58028a270 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.156265 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ea3aa2ef74f467dbb4238f58028a270 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.156325 12175 ts_tablet_manager.cc:1905] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.156586 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet df57043b1da2406a800aea1081600740 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.157864 13699 raft_consensus.cc:491] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.157967 13699 raft_consensus.cc:513] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.158409 13699 leader_election.cc:290] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.158587 12175 ts_tablet_manager.cc:1918] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.158694 12175 log.cc:1199] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7491e070e86346b681817fb19d4608f9
I20250625 14:02:03.158962 12175 ts_tablet_manager.cc:1939] T 7491e070e86346b681817fb19d4608f9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.159890 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3a5c9b1852a847188bb7e2f08a37fded" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:03.160187 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ea3aa2ef74f467dbb4238f58028a270 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.160362 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet df57043b1da2406a800aea1081600740 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:03.160399 11717 leader_election.cc:343] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.160485 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet e9de91633ba3404d9002d4f27449ea48 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2969a3b9574196b4a8b962cbd09b11) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.160543 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3a5c9b1852a847188bb7e2f08a37fded" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.160607 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet f5e271b27ac349d6bb8cf47aa8b9668a with delete_type TABLET_DATA_DELETED (replaced by tablet d66fe36f250c45a3bc7df9c3dc05be12) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.160718 11758 tablet_service.cc:1515] Processing DeleteTablet for tablet 75f6dce2462e47cca6a262eb3f871f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:03.160884 11717 leader_election.cc:343] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.160984 11717 leader_election.cc:304] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:03.161046 12173 tablet_replica.cc:331] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.161202 12173 raft_consensus.cc:2241] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.161321 13699 raft_consensus.cc:2747] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:03.161346 12173 raft_consensus.cc:2270] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.161537 11746 tablet_service.cc:1515] Processing DeleteTablet for tablet 55ede5e94e12449abbbec9146331deb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73f64982ad194dfe9dcbf6b77e047db2) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.161669 11756 tablet_service.cc:1515] Processing DeleteTablet for tablet f2576ff766494c37b316552a66a5ff31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.161932 12173 ts_tablet_manager.cc:1905] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.164965 12173 ts_tablet_manager.cc:1918] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.165393 12173 log.cc:1199] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f0833d0e013f48f78cb6c616481b5dce
I20250625 14:02:03.165652 12173 ts_tablet_manager.cc:1939] T f0833d0e013f48f78cb6c616481b5dce P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.166227 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf448c94caf447bd8ddbad9c6ace0712. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.166702 12173 tablet_replica.cc:331] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.166886 12173 raft_consensus.cc:2241] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.166970 12177 tablet_replica.cc:331] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.167076 12173 raft_consensus.cc:2270] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.167112 12177 raft_consensus.cc:2241] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.167244 12177 raft_consensus.cc:2270] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.167661 12173 ts_tablet_manager.cc:1905] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.167650 12177 ts_tablet_manager.cc:1905] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.167944 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 9cb56a7e714d45038feaf1132a5e06af (table default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]) successfully deleted
W20250625 14:02:03.168394 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 5ea3aa2ef74f467dbb4238f58028a270 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ea3aa2ef74f467dbb4238f58028a270 already in progress: creating tablet
W20250625 14:02:03.169209 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet df57043b1da2406a800aea1081600740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df57043b1da2406a800aea1081600740 already in progress: creating tablet
W20250625 14:02:03.169803 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet e9de91633ba3404d9002d4f27449ea48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9de91633ba3404d9002d4f27449ea48 already in progress: creating tablet
I20250625 14:02:03.170586 12177 ts_tablet_manager.cc:1918] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:03.170675 12177 log.cc:1199] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f5e271b27ac349d6bb8cf47aa8b9668a
I20250625 14:02:03.171382 12173 ts_tablet_manager.cc:1918] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.171509 12173 log.cc:1199] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7491e070e86346b681817fb19d4608f9
I20250625 14:02:03.171808 12172 tablet_bootstrap.cc:492] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:03.172798 12177 ts_tablet_manager.cc:1939] T f5e271b27ac349d6bb8cf47aa8b9668a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.172972 12172 tablet_bootstrap.cc:654] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.173274 12177 tablet_replica.cc:331] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.173400 12177 raft_consensus.cc:2241] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.173507 12177 raft_consensus.cc:2270] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.173975 12173 ts_tablet_manager.cc:1939] T 7491e070e86346b681817fb19d4608f9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.174000 12177 ts_tablet_manager.cc:1905] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.174842 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 75f6dce2462e47cca6a262eb3f871f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.174997 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet f5e271b27ac349d6bb8cf47aa8b9668a with delete_type TABLET_DATA_DELETED (replaced by tablet d66fe36f250c45a3bc7df9c3dc05be12) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.175042 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet e9de91633ba3404d9002d4f27449ea48 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2969a3b9574196b4a8b962cbd09b11) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.175096 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 55ede5e94e12449abbbec9146331deb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73f64982ad194dfe9dcbf6b77e047db2) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.176288 12173 tablet_replica.cc:331] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.176507 12173 raft_consensus.cc:2241] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.176746 12177 ts_tablet_manager.cc:1918] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.177115 12173 raft_consensus.cc:2270] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.177644 12173 ts_tablet_manager.cc:1905] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.178961 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet f5e271b27ac349d6bb8cf47aa8b9668a with delete_type TABLET_DATA_DELETED (replaced by tablet d66fe36f250c45a3bc7df9c3dc05be12) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.179183 12175 tablet_replica.cc:331] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.179255 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 75f6dce2462e47cca6a262eb3f871f06 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.179332 12175 raft_consensus.cc:2241] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:03.179487 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet e9de91633ba3404d9002d4f27449ea48 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2969a3b9574196b4a8b962cbd09b11) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.179162 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 55ede5e94e12449abbbec9146331deb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73f64982ad194dfe9dcbf6b77e047db2) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.179785 12175 raft_consensus.cc:2270] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.180190 12175 ts_tablet_manager.cc:1905] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.180738 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f5e271b27ac349d6bb8cf47aa8b9668a (table default.Table_08f44e189955459ab1825ed53a44b427 [id=29fdfe34ed7648feb4f21f471fd5e154]) successfully deleted
W20250625 14:02:03.181373 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 75f6dce2462e47cca6a262eb3f871f06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75f6dce2462e47cca6a262eb3f871f06 already in progress: creating tablet
I20250625 14:02:03.181499 12177 log.cc:1199] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f2576ff766494c37b316552a66a5ff31
W20250625 14:02:03.181977 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 55ede5e94e12449abbbec9146331deb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55ede5e94e12449abbbec9146331deb5 already in progress: creating tablet
I20250625 14:02:03.182093 12177 ts_tablet_manager.cc:1939] T f2576ff766494c37b316552a66a5ff31 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.184111 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet c4a906afbc504981942d57221742e822 (table default.Table_ca9d716a136b4ee7bdaf39cc91e52ceb [id=4f157d4de29f4618937525f9293e5049]) successfully deleted
W20250625 14:02:03.184293 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 3be69a38ec234025af3e9c2c54dca57e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3be69a38ec234025af3e9c2c54dca57e already in progress: creating tablet
W20250625 14:02:03.184420 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8d600a46fc1c4a6194368f3cd8681364 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d600a46fc1c4a6194368f3cd8681364 already in progress: creating tablet
W20250625 14:02:03.184536 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9b01f5c2e7314475804cdc7ea0ba0fcd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b01f5c2e7314475804cdc7ea0ba0fcd already in progress: creating tablet
W20250625 14:02:03.184666 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet e82d66db450e41faaa9e5ba2796bed2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e82d66db450e41faaa9e5ba2796bed2d already in progress: creating tablet
W20250625 14:02:03.184782 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9a67a7c7c8a4c6eb331676ea4d126a6 already in progress: creating tablet
W20250625 14:02:03.184937 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6d2adc01621f40b8bebd532ad491df2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d2adc01621f40b8bebd532ad491df2f already in progress: creating tablet
I20250625 14:02:03.185074 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 628edde0bd0840c6a11c79f8ab810977 (table default.Table_522af79c54de47dca6f8f5b92399167d [id=f71426341d4c4fe0bd0342ea293e0110]) successfully deleted
I20250625 14:02:03.185200 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 12c5e71b4a4f4efc81f822bdf95d0f99 (table default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]) successfully deleted
I20250625 14:02:03.185304 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7491e070e86346b681817fb19d4608f9 (table default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]) successfully deleted
I20250625 14:02:03.185331 12175 ts_tablet_manager.cc:1918] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
W20250625 14:02:03.185418 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 5ea3aa2ef74f467dbb4238f58028a270 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ea3aa2ef74f467dbb4238f58028a270 already in progress: creating tablet
W20250625 14:02:03.185524 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet df57043b1da2406a800aea1081600740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df57043b1da2406a800aea1081600740 already in progress: creating tablet
I20250625 14:02:03.185547 12175 log.cc:1199] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f5e271b27ac349d6bb8cf47aa8b9668a
I20250625 14:02:03.185912 12175 ts_tablet_manager.cc:1939] T f5e271b27ac349d6bb8cf47aa8b9668a P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.186158 11902 tablet_service.cc:1468] Processing CreateTablet for tablet bf448c94caf447bd8ddbad9c6ace0712 (DEFAULT_TABLE table=default.Table_533afd5e6bb14c7697c5652f2c8ee713 [id=b7922d34fc8e4ddabe12e07003b3171c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.186466 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf448c94caf447bd8ddbad9c6ace0712. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.188141 12600 consensus_queue.cc:1035] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:03.189594 12173 ts_tablet_manager.cc:1918] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:03.189738 12173 log.cc:1199] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f5e271b27ac349d6bb8cf47aa8b9668a
I20250625 14:02:03.190088 12173 ts_tablet_manager.cc:1939] T f5e271b27ac349d6bb8cf47aa8b9668a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.198474 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 2a2fd4408e4f4f06b5a1bc686402ee40
W20250625 14:02:03.199281 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32dd38cbe4634d3e97d657a8a4129039 consensus state has no leader
I20250625 14:02:03.199925 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7b3a33d8d92c4448af91b31c335ea55c
I20250625 14:02:03.201929 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f2576ff766494c37b316552a66a5ff31 (table default.Table_47a020733f644c45b54865bbd14ff779 [id=4ca78651d63b411b83d97f628dbf849d]) successfully deleted
I20250625 14:02:03.202239 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 2a2fd4408e4f4f06b5a1bc686402ee40 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.202592 13532 tablet.cc:1722] T b1af86cdb13f427ea61ee8ad56ca3f26 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:02:03.202765 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet df57043b1da2406a800aea1081600740 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df57043b1da2406a800aea1081600740 already in progress: creating tablet
I20250625 14:02:03.202880 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f0833d0e013f48f78cb6c616481b5dce (table default.Table_6d0b9ebb9ed4411394d69c7220244814 [id=f64f7d5b36ce42b39034f4439346303e]) successfully deleted
I20250625 14:02:03.202991 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7491e070e86346b681817fb19d4608f9 (table default.Table_84c115ad81fd4a09a7d228f765b67688 [id=09fde99a19ff4a54b3aec1ab1c08afd2]) successfully deleted
W20250625 14:02:03.203095 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5ea3aa2ef74f467dbb4238f58028a270 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ea3aa2ef74f467dbb4238f58028a270 already in progress: creating tablet
W20250625 14:02:03.203207 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 75f6dce2462e47cca6a262eb3f871f06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75f6dce2462e47cca6a262eb3f871f06 already in progress: creating tablet
I20250625 14:02:03.203292 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f5e271b27ac349d6bb8cf47aa8b9668a (table default.Table_08f44e189955459ab1825ed53a44b427 [id=29fdfe34ed7648feb4f21f471fd5e154]) successfully deleted
W20250625 14:02:03.203382 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet e9de91633ba3404d9002d4f27449ea48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9de91633ba3404d9002d4f27449ea48 already in progress: creating tablet
W20250625 14:02:03.203505 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 55ede5e94e12449abbbec9146331deb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55ede5e94e12449abbbec9146331deb5 already in progress: creating tablet
I20250625 14:02:03.204377 12167 tablet_bootstrap.cc:492] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.204465 12167 ts_tablet_manager.cc:1397] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.000s
I20250625 14:02:03.205030 12167 raft_consensus.cc:357] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.205150 12167 raft_consensus.cc:383] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.205188 12167 raft_consensus.cc:738] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.205329 12167 consensus_queue.cc:260] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.205693 12167 ts_tablet_manager.cc:1428] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:03.205914 12167 tablet_bootstrap.cc:492] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.206413 13535 tablet.cc:1722] T b1af86cdb13f427ea61ee8ad56ca3f26 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:03.207496 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.207662 12173 tablet_replica.cc:331] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.207813 12173 raft_consensus.cc:2241] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.207963 12173 raft_consensus.cc:2270] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.208360 12173 ts_tablet_manager.cc:1905] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.208405 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b3a33d8d92c4448af91b31c335ea55c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.211755 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f5e271b27ac349d6bb8cf47aa8b9668a (table default.Table_08f44e189955459ab1825ed53a44b427 [id=29fdfe34ed7648feb4f21f471fd5e154]) successfully deleted
W20250625 14:02:03.211958 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 75f6dce2462e47cca6a262eb3f871f06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75f6dce2462e47cca6a262eb3f871f06 already in progress: creating tablet
W20250625 14:02:03.214550 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet e9de91633ba3404d9002d4f27449ea48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9de91633ba3404d9002d4f27449ea48 already in progress: creating tablet
W20250625 14:02:03.214687 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 55ede5e94e12449abbbec9146331deb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55ede5e94e12449abbbec9146331deb5 already in progress: creating tablet
I20250625 14:02:03.215076 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.215345 12175 tablet_replica.cc:331] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.215519 12175 raft_consensus.cc:2241] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:03.215749 12175 raft_consensus.cc:2270] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.216179 12175 ts_tablet_manager.cc:1905] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.216653 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 2a2fd4408e4f4f06b5a1bc686402ee40 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.216650 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b3a33d8d92c4448af91b31c335ea55c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.216809 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 7b3a33d8d92c4448af91b31c335ea55c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.216969 12177 tablet_replica.cc:331] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.217133 12177 raft_consensus.cc:2241] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.217291 12177 raft_consensus.cc:2270] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.217386 12166 tablet_bootstrap.cc:492] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.217468 12166 ts_tablet_manager.cc:1397] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.208s user 0.002s sys 0.000s
I20250625 14:02:03.217685 12177 ts_tablet_manager.cc:1905] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.218047 12166 raft_consensus.cc:357] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.218149 12166 raft_consensus.cc:383] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.218178 12166 raft_consensus.cc:738] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.218437 12166 consensus_queue.cc:260] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.218744 12166 ts_tablet_manager.cc:1428] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.218948 12166 tablet_bootstrap.cc:492] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.220103 12166 tablet_bootstrap.cc:654] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.220346 12177 ts_tablet_manager.cc:1918] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:03.220413 12177 log.cc:1199] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/2a2fd4408e4f4f06b5a1bc686402ee40
I20250625 14:02:03.220453 12175 ts_tablet_manager.cc:1918] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:03.220520 12175 log.cc:1199] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/2a2fd4408e4f4f06b5a1bc686402ee40
I20250625 14:02:03.220674 12177 ts_tablet_manager.cc:1939] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.220777 12175 ts_tablet_manager.cc:1939] T 2a2fd4408e4f4f06b5a1bc686402ee40 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.223161 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 with delete_type TABLET_DATA_DELETED (replaced by tablet 06d9ec116e8e4206940860c88c23eed2) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.223301 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c2af74eae9244d93835e899ee54414f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.223742 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2af74eae9244d93835e899ee54414f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.224391 13531 tablet.cc:1722] T b1af86cdb13f427ea61ee8ad56ca3f26 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:03.224660 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a50011abcf4c4f82906d8c3457c480c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.225064 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a50011abcf4c4f82906d8c3457c480c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.225800 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_29b4142505484a25bd89b94f958d6c09" } new_table_name: "default.Table_b127845c183b45c0a8299a81cd541ba8" modify_external_catalogs: true
I20250625 14:02:03.228364 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]) successfully deleted
W20250625 14:02:03.228523 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7b3a33d8d92c4448af91b31c335ea55c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b3a33d8d92c4448af91b31c335ea55c already in progress: creating tablet
I20250625 14:02:03.229012 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 5df4b218df7d4e4e9e634d3cd4f17633 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.229730 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_be97292d424145e18538b8e77b13f862"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.230127 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be97292d424145e18538b8e77b13f862 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.230154 12173 ts_tablet_manager.cc:1918] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:03.230234 12173 log.cc:1199] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/2a2fd4408e4f4f06b5a1bc686402ee40
I20250625 14:02:03.230587 12173 ts_tablet_manager.cc:1939] T 2a2fd4408e4f4f06b5a1bc686402ee40 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.232286 11525 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_24234495422c4a268ac8113d692ae092 [id=f61687f702554b25b0d74b90450e9947] alter complete (version 1)
I20250625 14:02:03.236886 12032 tablet_service.cc:1468] Processing CreateTablet for tablet b10c8864137f4083a2952deadd9b3ad1 (DEFAULT_TABLE table=default.Table_e616a8e959f54cbdad84ecef02057829 [id=fb4fe1c710824cac891288b87c3191aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.237792 12167 tablet_bootstrap.cc:654] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.238425 11969 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:03.240923 13352 raft_consensus.cc:491] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.241075 13352 raft_consensus.cc:513] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.241618 13352 leader_election.cc:290] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:03.242290 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4f651f79ee034dd28e44092b7de29bf3" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.242499 11915 raft_consensus.cc:2466] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:03.242808 11990 leader_election.cc:304] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:03.243168 13352 raft_consensus.cc:2802] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:03.243247 13352 raft_consensus.cc:491] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:03.243299 13352 raft_consensus.cc:3058] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.244740 13352 raft_consensus.cc:513] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.245306 13352 leader_election.cc:290] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:03.245684 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4f651f79ee034dd28e44092b7de29bf3" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:03.245867 11915 raft_consensus.cc:3058] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.247346 11915 raft_consensus.cc:2466] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:03.248662 11990 leader_election.cc:304] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:03.248857 13232 raft_consensus.cc:2802] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:03.248983 13232 raft_consensus.cc:695] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:03.249116 13232 consensus_queue.cc:237] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.250324 12167 tablet_bootstrap.cc:492] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.250418 12167 ts_tablet_manager.cc:1397] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.001s
I20250625 14:02:03.250833 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 8e806fb1961b4672a1fa3a114ade1d7f (DEFAULT_TABLE table=default.Table_4f53ff9a13b84b4c997fd1123d48f383 [id=242685ab56ce4854ab4f4ec722f2502f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.250890 12167 raft_consensus.cc:357] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.250977 12167 raft_consensus.cc:383] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.251003 12167 raft_consensus.cc:738] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.251094 12167 consensus_queue.cc:260] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.251147 13121 consensus_queue.cc:1035] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:03.251394 12167 ts_tablet_manager.cc:1428] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:03.259351 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c8864137f4083a2952deadd9b3ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.261273 11890 tablet_service.cc:1468] Processing CreateTablet for tablet b10c8864137f4083a2952deadd9b3ad1 (DEFAULT_TABLE table=default.Table_e616a8e959f54cbdad84ecef02057829 [id=fb4fe1c710824cac891288b87c3191aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.261338 12167 tablet_bootstrap.cc:492] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.261562 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c8864137f4083a2952deadd9b3ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.262405 12167 tablet_bootstrap.cc:654] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.263121 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e806fb1961b4672a1fa3a114ade1d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.268484 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]) successfully deleted
W20250625 14:02:03.268739 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7b3a33d8d92c4448af91b31c335ea55c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b3a33d8d92c4448af91b31c335ea55c already in progress: creating tablet
I20250625 14:02:03.268731 12028 tablet_service.cc:1468] Processing CreateTablet for tablet b6f01de09e8c4d96988523db0f28cbff (DEFAULT_TABLE table=default.Table_75938816cd3645378c59436086614ed8 [id=f42e0c1633fd4a65a1653f9788f2c126]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.269112 11901 tablet_service.cc:1468] Processing CreateTablet for tablet b6f01de09e8c4d96988523db0f28cbff (DEFAULT_TABLE table=default.Table_75938816cd3645378c59436086614ed8 [id=f42e0c1633fd4a65a1653f9788f2c126]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.269392 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f01de09e8c4d96988523db0f28cbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.269522 12037 tablet_service.cc:1468] Processing CreateTablet for tablet d7d225545467475d9d656f5354585aa0 (DEFAULT_TABLE table=default.Table_0edcafdd98474f9591d5f2c451b3775a [id=15e82c5d77e24a25b764d1f8757faa8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.269737 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d225545467475d9d656f5354585aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.270016 11902 tablet_service.cc:1468] Processing CreateTablet for tablet d66fe36f250c45a3bc7df9c3dc05be12 (DEFAULT_TABLE table=default.Table_08f44e189955459ab1825ed53a44b427 [id=29fdfe34ed7648feb4f21f471fd5e154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.270228 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66fe36f250c45a3bc7df9c3dc05be12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.272065 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f01de09e8c4d96988523db0f28cbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.272716 12173 tablet_replica.cc:331] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.273126 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 8e806fb1961b4672a1fa3a114ade1d7f (DEFAULT_TABLE table=default.Table_4f53ff9a13b84b4c997fd1123d48f383 [id=242685ab56ce4854ab4f4ec722f2502f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.273362 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e806fb1961b4672a1fa3a114ade1d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.273524 12166 tablet_bootstrap.cc:492] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.273604 12166 ts_tablet_manager.cc:1397] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.000s
I20250625 14:02:03.274168 12166 raft_consensus.cc:357] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.274286 12166 raft_consensus.cc:383] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.274350 12166 raft_consensus.cc:738] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.274516 12166 consensus_queue.cc:260] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.274652 12032 tablet_service.cc:1468] Processing CreateTablet for tablet d66fe36f250c45a3bc7df9c3dc05be12 (DEFAULT_TABLE table=default.Table_08f44e189955459ab1825ed53a44b427 [id=29fdfe34ed7648feb4f21f471fd5e154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.275032 12166 ts_tablet_manager.cc:1428] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.275146 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66fe36f250c45a3bc7df9c3dc05be12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.275243 12166 tablet_bootstrap.cc:492] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.276548 12166 tablet_bootstrap.cc:654] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.276685 13352 raft_consensus.cc:491] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.276779 13352 raft_consensus.cc:513] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.277194 13352 leader_election.cc:290] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:03.279081 11916 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5df4b218df7d4e4e9e634d3cd4f17633" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:03.279485 11990 leader_election.cc:343] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.287292 11750 tablet_service.cc:1468] Processing CreateTablet for tablet b10c8864137f4083a2952deadd9b3ad1 (DEFAULT_TABLE table=default.Table_e616a8e959f54cbdad84ecef02057829 [id=fb4fe1c710824cac891288b87c3191aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.287436 11745 tablet_service.cc:1468] Processing CreateTablet for tablet d7d225545467475d9d656f5354585aa0 (DEFAULT_TABLE table=default.Table_0edcafdd98474f9591d5f2c451b3775a [id=15e82c5d77e24a25b764d1f8757faa8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.287632 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10c8864137f4083a2952deadd9b3ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.287882 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d225545467475d9d656f5354585aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.288045 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 8e806fb1961b4672a1fa3a114ade1d7f (DEFAULT_TABLE table=default.Table_4f53ff9a13b84b4c997fd1123d48f383 [id=242685ab56ce4854ab4f4ec722f2502f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.288282 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e806fb1961b4672a1fa3a114ade1d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.290241 11763 tablet_service.cc:1468] Processing CreateTablet for tablet d66fe36f250c45a3bc7df9c3dc05be12 (DEFAULT_TABLE table=default.Table_08f44e189955459ab1825ed53a44b427 [id=29fdfe34ed7648feb4f21f471fd5e154]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.290514 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66fe36f250c45a3bc7df9c3dc05be12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.291057 12600 consensus_queue.cc:1035] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:03.291464 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 3e6886013ef647d2b2bad683c31ec816 (DEFAULT_TABLE table=default.Table_de402d9ab83f4c2abf49ddacfaf6bfa2 [id=bf4a533c69784b4da4bc0bacf6f4ded5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.291775 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6886013ef647d2b2bad683c31ec816. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.291802 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 3e6886013ef647d2b2bad683c31ec816 (DEFAULT_TABLE table=default.Table_de402d9ab83f4c2abf49ddacfaf6bfa2 [id=bf4a533c69784b4da4bc0bacf6f4ded5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.292034 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6886013ef647d2b2bad683c31ec816. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.292680 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 73f64982ad194dfe9dcbf6b77e047db2 (DEFAULT_TABLE table=default.Table_85edeb4b51284604b988da8b6dbd6a34 [id=0954c7104a6243169519805ca7369806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.292884 11754 tablet_service.cc:1468] Processing CreateTablet for tablet b6f01de09e8c4d96988523db0f28cbff (DEFAULT_TABLE table=default.Table_75938816cd3645378c59436086614ed8 [id=f42e0c1633fd4a65a1653f9788f2c126]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.292925 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f64982ad194dfe9dcbf6b77e047db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.293107 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6f01de09e8c4d96988523db0f28cbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.294210 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 73f64982ad194dfe9dcbf6b77e047db2 (DEFAULT_TABLE table=default.Table_85edeb4b51284604b988da8b6dbd6a34 [id=0954c7104a6243169519805ca7369806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.294500 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f64982ad194dfe9dcbf6b77e047db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.294801 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet 4f651f79ee034dd28e44092b7de29bf3 with delete_type TABLET_DATA_DELETED (replaced by tablet 06d9ec116e8e4206940860c88c23eed2) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.295089 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 6a2969a3b9574196b4a8b962cbd09b11 (DEFAULT_TABLE table=default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.295311 12175 tablet_replica.cc:331] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.295339 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2969a3b9574196b4a8b962cbd09b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.295449 12175 raft_consensus.cc:2241] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.295557 12175 raft_consensus.cc:2270] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.295763 12173 raft_consensus.cc:2241] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:03.296124 12173 pending_rounds.cc:70] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:03.296159 12173 pending_rounds.cc:77] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523064829853696 op_type: NO_OP noop_request { }
I20250625 14:02:03.296223 12173 raft_consensus.cc:2887] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:03.296275 12173 raft_consensus.cc:2270] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.296988 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 1fa9aeec4f564a8b83f055e2e53810ec (DEFAULT_TABLE table=default.Table_5d55b3b2d4744021bd002b13b919aad9 [id=e2f16feebe44452688a8509ec544424a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.297212 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa9aeec4f564a8b83f055e2e53810ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.297401 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 1fa9aeec4f564a8b83f055e2e53810ec (DEFAULT_TABLE table=default.Table_5d55b3b2d4744021bd002b13b919aad9 [id=e2f16feebe44452688a8509ec544424a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.297650 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa9aeec4f564a8b83f055e2e53810ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.298161 12167 tablet_bootstrap.cc:492] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.298264 12167 ts_tablet_manager.cc:1397] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.002s
I20250625 14:02:03.298825 12167 raft_consensus.cc:357] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.298954 12167 raft_consensus.cc:383] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.298988 12167 raft_consensus.cc:738] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.299103 12167 consensus_queue.cc:260] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.299414 12167 ts_tablet_manager.cc:1428] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:03.299630 12167 tablet_bootstrap.cc:492] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.300732 12167 tablet_bootstrap.cc:654] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:03.302749 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5b5564d64d645c88a0e2c624b989944 consensus state has no leader
I20250625 14:02:03.297616 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 6a2969a3b9574196b4a8b962cbd09b11 (DEFAULT_TABLE table=default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.305794 13121 raft_consensus.cc:491] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.305908 13121 raft_consensus.cc:513] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.306375 13121 leader_election.cc:290] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:03.306676 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e4cdf8f78d14c7d8ba3bda009d33719" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.306813 11918 raft_consensus.cc:2466] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:03.307150 11990 leader_election.cc:304] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:03.307317 13121 raft_consensus.cc:2802] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:03.307377 13121 raft_consensus.cc:491] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:03.307416 13121 raft_consensus.cc:3058] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.307437 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet f0833d0e013f48f78cb6c616481b5dce with delete_type TABLET_DATA_DELETED (replaced by tablet 6980c62d63b34c67ad095ad9ea18a3f1) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.308094 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 990d03f434044571aa2b61577495ab77 (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.308545 13121 raft_consensus.cc:513] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.308900 13121 leader_election.cc:290] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:03.309100 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 990d03f434044571aa2b61577495ab77 (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.309213 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e4cdf8f78d14c7d8ba3bda009d33719" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:03.309340 11918 raft_consensus.cc:3058] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.309383 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990d03f434044571aa2b61577495ab77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.310371 11918 raft_consensus.cc:2466] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:03.310928 11990 leader_election.cc:304] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:03.312242 13121 raft_consensus.cc:2802] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:03.312335 13121 raft_consensus.cc:695] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:03.312466 13121 consensus_queue.cc:237] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.313253 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 2a2fd4408e4f4f06b5a1bc686402ee40 (table default.Table_67a78b6cc247483798a3ca2332498af2 [id=1d4a1c31c04f4945a30ae7cf98f65c97]) successfully deleted
I20250625 14:02:03.316134 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2969a3b9574196b4a8b962cbd09b11. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:03.314527 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7b3a33d8d92c4448af91b31c335ea55c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b3a33d8d92c4448af91b31c335ea55c already in progress: creating tablet
I20250625 14:02:03.317587 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 6a2969a3b9574196b4a8b962cbd09b11 (DEFAULT_TABLE table=default.Table_918b236a1aca4304b96c0c6a27792324 [id=42eadc1269e249168e58ec0f122956bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.317874 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2969a3b9574196b4a8b962cbd09b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.318552 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e4cdf8f78d14c7d8ba3bda009d33719" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:03.318670 11783 raft_consensus.cc:3058] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.319604 11783 raft_consensus.cc:2466] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:03.320019 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990d03f434044571aa2b61577495ab77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.320449 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 73f64982ad194dfe9dcbf6b77e047db2 (DEFAULT_TABLE table=default.Table_85edeb4b51284604b988da8b6dbd6a34 [id=0954c7104a6243169519805ca7369806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.320717 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f64982ad194dfe9dcbf6b77e047db2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:03.320998 11993 leader_election.cc:343] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 4f651f79ee034dd28e44092b7de29bf3
I20250625 14:02:03.323048 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 990d03f434044571aa2b61577495ab77 (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.323240 12175 ts_tablet_manager.cc:1905] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.323298 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990d03f434044571aa2b61577495ab77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.325632 12175 ts_tablet_manager.cc:1918] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.325711 12175 log.cc:1199] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/4f651f79ee034dd28e44092b7de29bf3
I20250625 14:02:03.325740 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5e4cdf8f78d14c7d8ba3bda009d33719" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:03.325875 11778 raft_consensus.cc:2374] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1. Re-sending same reply.
I20250625 14:02:03.325944 12175 ts_tablet_manager.cc:1939] T 4f651f79ee034dd28e44092b7de29bf3 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.317637 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 1fa9aeec4f564a8b83f055e2e53810ec (DEFAULT_TABLE table=default.Table_5d55b3b2d4744021bd002b13b919aad9 [id=e2f16feebe44452688a8509ec544424a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.326275 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa9aeec4f564a8b83f055e2e53810ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.326748 12175 tablet_replica.cc:331] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.327025 12175 raft_consensus.cc:2241] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.327154 12175 raft_consensus.cc:2270] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.327368 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 268638793ff44216aa0663b0a3568940 with delete_type TABLET_DATA_DELETED (replaced by tablet 11d75509046746fe8016c9182923d83c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.329169 12175 ts_tablet_manager.cc:1905] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.333671 12175 ts_tablet_manager.cc:1918] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.333772 12175 log.cc:1199] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f0833d0e013f48f78cb6c616481b5dce
I20250625 14:02:03.334059 12175 ts_tablet_manager.cc:1939] T f0833d0e013f48f78cb6c616481b5dce P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.337343 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 4f651f79ee034dd28e44092b7de29bf3 (table default.Table_c055b1e8e56d4bd595e2312996eb6b5e [id=45522461146c457ebfe600569a8c8524]) successfully deleted
I20250625 14:02:03.338455 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f0833d0e013f48f78cb6c616481b5dce (table default.Table_6d0b9ebb9ed4411394d69c7220244814 [id=f64f7d5b36ce42b39034f4439346303e]) successfully deleted
I20250625 14:02:03.341704 12028 tablet_service.cc:1468] Processing CreateTablet for tablet de243f2e459f46409df7452c6b54e1a1 (DEFAULT_TABLE table=default.Table_a50011abcf4c4f82906d8c3457c480c5 [id=72eb8d38bd9d41d990c457093ce1de4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.342082 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de243f2e459f46409df7452c6b54e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.342790 11898 tablet_service.cc:1468] Processing CreateTablet for tablet de243f2e459f46409df7452c6b54e1a1 (DEFAULT_TABLE table=default.Table_a50011abcf4c4f82906d8c3457c480c5 [id=72eb8d38bd9d41d990c457093ce1de4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.343091 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de243f2e459f46409df7452c6b54e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.344707 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 9cbe55597c0742c99750322cdca22289 (DEFAULT_TABLE table=default.Table_545ed70704b9480980d400c1c14a4edf [id=abf5000d16354a18b51ff81056605c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.344978 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cbe55597c0742c99750322cdca22289. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.345420 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 49f4fd5199164f35ac574b6996074341 (DEFAULT_TABLE table=default.Table_14086cdd295d418ca5f7e209ed33ede6 [id=dac157da6bf148578318ccc20832d981]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.345634 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f4fd5199164f35ac574b6996074341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.345764 11902 tablet_service.cc:1468] Processing CreateTablet for tablet d7d225545467475d9d656f5354585aa0 (DEFAULT_TABLE table=default.Table_0edcafdd98474f9591d5f2c451b3775a [id=15e82c5d77e24a25b764d1f8757faa8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.346076 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 49f4fd5199164f35ac574b6996074341 (DEFAULT_TABLE table=default.Table_14086cdd295d418ca5f7e209ed33ede6 [id=dac157da6bf148578318ccc20832d981]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.346354 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f4fd5199164f35ac574b6996074341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.346518 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 47b59e62144d4005b0bd92025012cc1b (DEFAULT_TABLE table=default.Table_c2af74eae9244d93835e899ee54414f7 [id=92170217aa364670a13183d82217f0da]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.346750 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b59e62144d4005b0bd92025012cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.347481 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 9cbe55597c0742c99750322cdca22289 (DEFAULT_TABLE table=default.Table_545ed70704b9480980d400c1c14a4edf [id=abf5000d16354a18b51ff81056605c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.347703 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cbe55597c0742c99750322cdca22289. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.348901 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7d225545467475d9d656f5354585aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.349702 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 3f3ae39bd26d439bac3df5ad144b9ee7 (DEFAULT_TABLE table=default.Table_c82fd0cae3c6425fab9bc4911fd81d51 [id=e9eeac6dec6741d78a730d0d9b02b74d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.349936 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3ae39bd26d439bac3df5ad144b9ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.349897 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 913e9dfe34404656b3d87bb65222b75b (DEFAULT_TABLE table=default.Table_b70d39bc77e04f20837ca83f42058db5 [id=c4ce755829fa45fc91710cca96f2fba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.350418 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 3f3ae39bd26d439bac3df5ad144b9ee7 (DEFAULT_TABLE table=default.Table_c82fd0cae3c6425fab9bc4911fd81d51 [id=e9eeac6dec6741d78a730d0d9b02b74d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.350493 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913e9dfe34404656b3d87bb65222b75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.350625 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3ae39bd26d439bac3df5ad144b9ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.351496 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 776bee36380d4881b63b86621017bdfe (DEFAULT_TABLE table=default.Table_74d4c613af8640fdbbc68a8c323375a8 [id=f1ca66b3156d48caa837f133b29cea59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.351711 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 3e6886013ef647d2b2bad683c31ec816 (DEFAULT_TABLE table=default.Table_de402d9ab83f4c2abf49ddacfaf6bfa2 [id=bf4a533c69784b4da4bc0bacf6f4ded5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.351740 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 776bee36380d4881b63b86621017bdfe (DEFAULT_TABLE table=default.Table_74d4c613af8640fdbbc68a8c323375a8 [id=f1ca66b3156d48caa837f133b29cea59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.351929 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6886013ef647d2b2bad683c31ec816. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.352202 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 913e9dfe34404656b3d87bb65222b75b (DEFAULT_TABLE table=default.Table_b70d39bc77e04f20837ca83f42058db5 [id=c4ce755829fa45fc91710cca96f2fba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.354398 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776bee36380d4881b63b86621017bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.356637 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776bee36380d4881b63b86621017bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.357973 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b67c4059a8a6481d9f5d4457639fd851" } modify_external_catalogs: true
I20250625 14:02:03.358120 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b67c4059a8a6481d9f5d4457639fd851" } modify_external_catalogs: true
I20250625 14:02:03.358919 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_375b905217c342d7ae85bc905acc07c9" } new_table_name: "default.Table_6bf78a72e96a4e5691dfeac8c8e81204" modify_external_catalogs: true
I20250625 14:02:03.360249 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e55bc479ac274666945b9ec35a88dae6" } modify_external_catalogs: true
I20250625 14:02:03.360348 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e55bc479ac274666945b9ec35a88dae6" } modify_external_catalogs: true
I20250625 14:02:03.360935 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_53632d85cfb044be94de114375c5277e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.361289 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53632d85cfb044be94de114375c5277e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.361953 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_195a649075684f668a243215a37a93e0" } modify_external_catalogs: true
I20250625 14:02:03.362037 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_195a649075684f668a243215a37a93e0" } modify_external_catalogs: true
I20250625 14:02:03.362681 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_23ec95f4e53c487fa735d0e9c7a5b3f0" } new_table_name: "default.Table_d086d0ed39c54f178caeeb272d18536d" modify_external_catalogs: true
I20250625 14:02:03.363588 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5c0d1c43f3014a00b19cb9ab5403039b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.363955 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c0d1c43f3014a00b19cb9ab5403039b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.367661 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913e9dfe34404656b3d87bb65222b75b. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:03.372289 11717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.39.131:34921, user_credentials={real_user=slave}} blocked reactor thread for 50061.3us
W20250625 14:02:03.372905 11993 leader_election.cc:343] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 4f651f79ee034dd28e44092b7de29bf3
I20250625 14:02:03.373373 13352 consensus_queue.cc:1035] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:03.377926 11993 leader_election.cc:343] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 5df4b218df7d4e4e9e634d3cd4f17633
I20250625 14:02:03.378026 11993 leader_election.cc:304] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:03.378176 13352 raft_consensus.cc:2747] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:03.379412 11745 tablet_service.cc:1468] Processing CreateTablet for tablet 47b59e62144d4005b0bd92025012cc1b (DEFAULT_TABLE table=default.Table_c2af74eae9244d93835e899ee54414f7 [id=92170217aa364670a13183d82217f0da]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:03.379709 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f7ca3dce9494136ac625a6979a8da03 consensus state has no leader
I20250625 14:02:03.379725 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b59e62144d4005b0bd92025012cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.379786 11749 tablet_service.cc:1468] Processing CreateTablet for tablet de243f2e459f46409df7452c6b54e1a1 (DEFAULT_TABLE table=default.Table_a50011abcf4c4f82906d8c3457c480c5 [id=72eb8d38bd9d41d990c457093ce1de4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.379976 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de243f2e459f46409df7452c6b54e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.382186 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 9cbe55597c0742c99750322cdca22289 (DEFAULT_TABLE table=default.Table_545ed70704b9480980d400c1c14a4edf [id=abf5000d16354a18b51ff81056605c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.382483 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cbe55597c0742c99750322cdca22289. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.382745 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 3f3ae39bd26d439bac3df5ad144b9ee7 (DEFAULT_TABLE table=default.Table_c82fd0cae3c6425fab9bc4911fd81d51 [id=e9eeac6dec6741d78a730d0d9b02b74d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.382808 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 913e9dfe34404656b3d87bb65222b75b (DEFAULT_TABLE table=default.Table_b70d39bc77e04f20837ca83f42058db5 [id=c4ce755829fa45fc91710cca96f2fba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.382968 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3ae39bd26d439bac3df5ad144b9ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.383147 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 49f4fd5199164f35ac574b6996074341 (DEFAULT_TABLE table=default.Table_14086cdd295d418ca5f7e209ed33ede6 [id=dac157da6bf148578318ccc20832d981]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.383355 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f4fd5199164f35ac574b6996074341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.385432 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3e8c6789c3b14bc88c2538c34d72a3a4
I20250625 14:02:03.385429 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 776bee36380d4881b63b86621017bdfe (DEFAULT_TABLE table=default.Table_74d4c613af8640fdbbc68a8c323375a8 [id=f1ca66b3156d48caa837f133b29cea59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.385646 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776bee36380d4881b63b86621017bdfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.386744 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 913e9dfe34404656b3d87bb65222b75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.390184 11528 catalog_manager.cc:5582] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:03.390460 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_47b438711bb4412895672499cd53a2d0 [id=416264ede8644650b07f6c60ffb3cc52]). Expected version 2 got 0
I20250625 14:02:03.390592 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]). Expected version 1 got 0
I20250625 14:02:03.392957 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e8c6789c3b14bc88c2538c34d72a3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.392940 11894 tablet_service.cc:1468] Processing CreateTablet for tablet c4ac61620d0e40dca0a9039c9477619c (DEFAULT_TABLE table=default.Table_be97292d424145e18538b8e77b13f862 [id=590bffdf534946a983fa9196fce3468e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.393085 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e8c6789c3b14bc88c2538c34d72a3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.393224 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ac61620d0e40dca0a9039c9477619c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.393273 12175 tablet_replica.cc:331] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.393414 12175 raft_consensus.cc:2241] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.393394 12028 tablet_service.cc:1468] Processing CreateTablet for tablet c4ac61620d0e40dca0a9039c9477619c (DEFAULT_TABLE table=default.Table_be97292d424145e18538b8e77b13f862 [id=590bffdf534946a983fa9196fce3468e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.393524 12175 raft_consensus.cc:2270] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.393651 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ac61620d0e40dca0a9039c9477619c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.393965 12175 ts_tablet_manager.cc:1905] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.396365 12175 ts_tablet_manager.cc:1918] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.396441 12175 log.cc:1199] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/3e8c6789c3b14bc88c2538c34d72a3a4
I20250625 14:02:03.397449 12175 ts_tablet_manager.cc:1939] T 3e8c6789c3b14bc88c2538c34d72a3a4 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.399518 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 47b59e62144d4005b0bd92025012cc1b (DEFAULT_TABLE table=default.Table_c2af74eae9244d93835e899ee54414f7 [id=92170217aa364670a13183d82217f0da]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:03.399771 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee8757ca1f064d259b1dca36c431a0c2 consensus state has no leader
I20250625 14:02:03.399911 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3809e6ad12ac474ca625910be01de97a
I20250625 14:02:03.400209 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 305009f335144f40b8a2dae61edb3801
I20250625 14:02:03.401147 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 3e8c6789c3b14bc88c2538c34d72a3a4 (table default.Table_b67c4059a8a6481d9f5d4457639fd851 [id=0124ee9b76f248ca8689a835beead152]) successfully deleted
I20250625 14:02:03.401517 12032 tablet_service.cc:1515] Processing DeleteTablet for tablet 3809e6ad12ac474ca625910be01de97a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.401731 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 305009f335144f40b8a2dae61edb3801 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.402103 12175 tablet_replica.cc:331] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.402248 12175 raft_consensus.cc:2241] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.402395 12175 raft_consensus.cc:2270] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.403007 12175 ts_tablet_manager.cc:1905] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.402563 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 305009f335144f40b8a2dae61edb3801 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.404414 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6be64b6da6844a919eb59c752c3d6f1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.404672 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6913356853b04dcdbb871b449e350ffb" } new_table_name: "default.Table_8b6663de9f0f48ea92b610c69d981c0f" modify_external_catalogs: true
I20250625 14:02:03.404699 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_54730abfeae842ec8ed188adc4a65e74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.404837 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6be64b6da6844a919eb59c752c3d6f1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:03.405047 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54730abfeae842ec8ed188adc4a65e74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.405532 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a2dfbabfeab54b618fc02d53b577e01e" } modify_external_catalogs: true
I20250625 14:02:03.405624 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a2dfbabfeab54b618fc02d53b577e01e" } modify_external_catalogs: true
I20250625 14:02:03.405715 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3aff8c0599c741d28f55f371ae6082d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.405807 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a4c6779d45c34135941dc676f26908e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.406029 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3aff8c0599c741d28f55f371ae6082d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:03.406131 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4c6779d45c34135941dc676f26908e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.406229 12175 ts_tablet_manager.cc:1918] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.406330 12175 log.cc:1199] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/305009f335144f40b8a2dae61edb3801
I20250625 14:02:03.406618 12175 ts_tablet_manager.cc:1939] T 305009f335144f40b8a2dae61edb3801 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.407352 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_77bef9b021894ec9bb0a928e93c9d2fa" } new_table_name: "default.Table_9bcd678046a8462080c5bd667aadff15" modify_external_catalogs: true
I20250625 14:02:03.407708 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 305009f335144f40b8a2dae61edb3801 (table default.Table_195a649075684f668a243215a37a93e0 [id=73eeb2af70b44421bffcf46be789f6e7]) successfully deleted
I20250625 14:02:03.408341 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_817ebd8b0122471f833e049491b8d994"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.408648 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_817ebd8b0122471f833e049491b8d994 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.409292 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b59e62144d4005b0bd92025012cc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.409438 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ac5d44672af04e189c94e99f0c66515e" } modify_external_catalogs: true
I20250625 14:02:03.409533 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ac5d44672af04e189c94e99f0c66515e" } modify_external_catalogs: true
W20250625 14:02:03.411410 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59556a6da95144f88aa806a7febd6a58 consensus state has no leader
I20250625 14:02:03.413237 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 2ca031c3707f4b4ea3a734081ae57a70
I20250625 14:02:03.413821 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 2ca031c3707f4b4ea3a734081ae57a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:03.417218 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e2c23049bc84d968e8cfb1f38c2c57e consensus state has no leader
I20250625 14:02:03.419634 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 022a3fb45dda44cfa58273f7fdb65d6e
I20250625 14:02:03.417829 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 2ca031c3707f4b4ea3a734081ae57a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:03.422565 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 2ca031c3707f4b4ea3a734081ae57a70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ca031c3707f4b4ea3a734081ae57a70 already in progress: creating tablet
I20250625 14:02:03.422655 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 022a3fb45dda44cfa58273f7fdb65d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.428146 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 27a05814621446f0b40733de5ff51328 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.435782 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7b0f1224e6da425baf571299c5d487d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.436331 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b0f1224e6da425baf571299c5d487d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:03.436911 11520 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet d185c7be82b04fe2a30626a6fb082219 (table default.Table_dc9acbfacd2248c4afbe5de227109f68 [id=2c5856c86f724fca9b7f2f52c6614392], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d185c7be82b04fe2a30626a6fb082219 consensus state has no leader
I20250625 14:02:03.437923 12104 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:03.440330 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a993f17e7b92482bae11fbf6fb6ed707"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.440721 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a993f17e7b92482bae11fbf6fb6ed707 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.442873 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 27a05814621446f0b40733de5ff51328
I20250625 14:02:03.443183 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 27a05814621446f0b40733de5ff51328 deleted and replaced by tablet 3a81cafac2f041a9942bf8b074473d04
I20250625 14:02:03.444939 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 27a05814621446f0b40733de5ff51328 with delete_type TABLET_DATA_DELETED (replaced by tablet 3a81cafac2f041a9942bf8b074473d04) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.445271 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 27a05814621446f0b40733de5ff51328 with delete_type TABLET_DATA_DELETED (replaced by tablet 3a81cafac2f041a9942bf8b074473d04) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:03.445760 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 27a05814621446f0b40733de5ff51328 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27a05814621446f0b40733de5ff51328 already in progress: creating tablet
W20250625 14:02:03.454569 13722 consensus_queue.cc:1162] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87a003e25dbf461ebec24a29ad7016ed" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:02:03.455207 12173 ts_tablet_manager.cc:1905] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.457252 11915 raft_consensus.cc:1273] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:03.457731 13121 consensus_queue.cc:1035] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:03.457881 12173 ts_tablet_manager.cc:1918] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.457953 12173 log.cc:1199] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/4f651f79ee034dd28e44092b7de29bf3
I20250625 14:02:03.458220 12173 ts_tablet_manager.cc:1939] T 4f651f79ee034dd28e44092b7de29bf3 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.459043 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 4f651f79ee034dd28e44092b7de29bf3 (table default.Table_c055b1e8e56d4bd595e2312996eb6b5e [id=45522461146c457ebfe600569a8c8524]) successfully deleted
I20250625 14:02:03.459299 12173 tablet_replica.cc:331] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.459467 12173 raft_consensus.cc:2241] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.459578 12173 raft_consensus.cc:2270] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.460105 12173 ts_tablet_manager.cc:1905] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.461540 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_47b438711bb4412895672499cd53a2d0 [id=416264ede8644650b07f6c60ffb3cc52]). Expected version 2 got 0
I20250625 14:02:03.462450 12173 ts_tablet_manager.cc:1918] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.462536 12173 log.cc:1199] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/5df4b218df7d4e4e9e634d3cd4f17633
I20250625 14:02:03.462766 12173 ts_tablet_manager.cc:1939] T 5df4b218df7d4e4e9e634d3cd4f17633 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.463532 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 5df4b218df7d4e4e9e634d3cd4f17633 (table default.Table_2142455242ee42d5820deea5646c9bc2 [id=6adcb3bc8e144f59bfe4d4f185b13a85]) successfully deleted
I20250625 14:02:03.463773 12173 tablet_replica.cc:331] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.463928 12173 raft_consensus.cc:2241] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.464035 12173 raft_consensus.cc:2270] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.465225 12173 ts_tablet_manager.cc:1905] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.465940 12167 tablet_bootstrap.cc:492] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.466039 12167 ts_tablet_manager.cc:1397] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.166s user 0.000s sys 0.002s
I20250625 14:02:03.466688 12167 raft_consensus.cc:357] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.466810 12167 raft_consensus.cc:383] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.466848 12167 raft_consensus.cc:738] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.466984 12167 consensus_queue.cc:260] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.467288 12167 ts_tablet_manager.cc:1428] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.467494 12167 tablet_bootstrap.cc:492] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.468595 12167 tablet_bootstrap.cc:654] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.481734 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d8501126146425baa26ba7741963085) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.482260 12166 tablet_bootstrap.cc:492] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.482420 12166 ts_tablet_manager.cc:1397] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.207s user 0.002s sys 0.001s
I20250625 14:02:03.483021 12166 raft_consensus.cc:357] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.483153 12166 raft_consensus.cc:383] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.483197 12166 raft_consensus.cc:738] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.483335 12166 consensus_queue.cc:260] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.483646 12166 ts_tablet_manager.cc:1428] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:03.483846 12166 tablet_bootstrap.cc:492] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.484897 12166 tablet_bootstrap.cc:654] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.493655 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 5df4b218df7d4e4e9e634d3cd4f17633 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.494036 12175 tablet_replica.cc:331] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.494184 12175 raft_consensus.cc:2241] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.494325 12175 raft_consensus.cc:2270] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.500058 12175 ts_tablet_manager.cc:1905] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.500931 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 3809e6ad12ac474ca625910be01de97a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.501154 12172 tablet_bootstrap.cc:492] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.501248 12172 ts_tablet_manager.cc:1397] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.329s user 0.002s sys 0.000s
I20250625 14:02:03.503391 12173 ts_tablet_manager.cc:1918] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.503777 12173 log.cc:1199] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/268638793ff44216aa0663b0a3568940
I20250625 14:02:03.504087 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6b666076abf941a583399f3a072c302d" } new_table_name: "default.Table_19338075980641618ce45cd8579b4e39" modify_external_catalogs: true
I20250625 14:02:03.505847 12173 ts_tablet_manager.cc:1939] T 268638793ff44216aa0663b0a3568940 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.506063 12175 ts_tablet_manager.cc:1918] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.506129 12175 log.cc:1199] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/5df4b218df7d4e4e9e634d3cd4f17633
I20250625 14:02:03.506356 12175 ts_tablet_manager.cc:1939] T 5df4b218df7d4e4e9e634d3cd4f17633 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.509732 12173 tablet_replica.cc:331] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.510188 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 5df4b218df7d4e4e9e634d3cd4f17633 (table default.Table_2142455242ee42d5820deea5646c9bc2 [id=6adcb3bc8e144f59bfe4d4f185b13a85]) successfully deleted
I20250625 14:02:03.510344 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 0627b4ff4173405eba5bd0686bab8e55 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:03.510442 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 3809e6ad12ac474ca625910be01de97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3809e6ad12ac474ca625910be01de97a already in progress: creating tablet
I20250625 14:02:03.510586 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 268638793ff44216aa0663b0a3568940 (table default.Table_5d6003fae2534a169754d1e128e3f7fe [id=f9b0946f56e547b4852dc5e30985f6fc]) successfully deleted
I20250625 14:02:03.510673 12173 raft_consensus.cc:2241] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.511292 12173 raft_consensus.cc:2270] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:03.513391 11530 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc01d6d227254da4907eefe5e229e3a9 consensus state has no leader
I20250625 14:02:03.514617 12173 ts_tablet_manager.cc:1905] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.514986 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0627b4ff4173405eba5bd0686bab8e55
I20250625 14:02:03.515287 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 0627b4ff4173405eba5bd0686bab8e55 deleted and replaced by tablet 6729b7aa8fdf4bf481eccf39af87d8b9
I20250625 14:02:03.516172 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 0627b4ff4173405eba5bd0686bab8e55 with delete_type TABLET_DATA_DELETED (replaced by tablet 6729b7aa8fdf4bf481eccf39af87d8b9) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.522156 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet e83f77c487d948ceabb6c43366cc7154 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.523037 12173 ts_tablet_manager.cc:1918] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.523406 12173 log.cc:1199] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/3e8c6789c3b14bc88c2538c34d72a3a4
I20250625 14:02:03.524339 12173 ts_tablet_manager.cc:1939] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.526172 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e83f77c487d948ceabb6c43366cc7154
I20250625 14:02:03.527088 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 3e8c6789c3b14bc88c2538c34d72a3a4 (table default.Table_b67c4059a8a6481d9f5d4457639fd851 [id=0124ee9b76f248ca8689a835beead152]) successfully deleted
I20250625 14:02:03.527452 11533 catalog_manager.cc:6652] ReplaceTablet: tablet e83f77c487d948ceabb6c43366cc7154 deleted and replaced by tablet d80e577509b54b97b6c55eef90a44cce
I20250625 14:02:03.527731 12173 tablet_replica.cc:331] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:02:03.528110 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 3809e6ad12ac474ca625910be01de97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3809e6ad12ac474ca625910be01de97a already in progress: creating tablet
I20250625 14:02:03.528370 12173 raft_consensus.cc:2241] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:03.528693 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet e83f77c487d948ceabb6c43366cc7154 with delete_type TABLET_DATA_DELETED (replaced by tablet d80e577509b54b97b6c55eef90a44cce) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.528426 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet e83f77c487d948ceabb6c43366cc7154 with delete_type TABLET_DATA_DELETED (replaced by tablet d80e577509b54b97b6c55eef90a44cce) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.529177 12173 raft_consensus.cc:2270] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:03.529366 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet e83f77c487d948ceabb6c43366cc7154 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e83f77c487d948ceabb6c43366cc7154 already in progress: creating tablet
I20250625 14:02:03.530345 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet afdd722b50584e65a098028c71ee2f9d from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.531076 12173 ts_tablet_manager.cc:1905] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.531517 11780 raft_consensus.cc:1273] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer 87a003e25dbf461ebec24a29ad7016ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:03.531821 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4949c14896924b1db93ba6df52fddae1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.532238 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4949c14896924b1db93ba6df52fddae1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.536012 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 0627b4ff4173405eba5bd0686bab8e55 with delete_type TABLET_DATA_DELETED (replaced by tablet 6729b7aa8fdf4bf481eccf39af87d8b9) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.536459 12172 raft_consensus.cc:357] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.536579 13535 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:03.536967 12175 tablet_replica.cc:331] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.536588 12172 raft_consensus.cc:383] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.537128 12175 raft_consensus.cc:2241] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.537182 12172 raft_consensus.cc:738] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.537243 12175 raft_consensus.cc:2270] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.537302 12172 consensus_queue.cc:260] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.537607 12172 ts_tablet_manager.cc:1428] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:02:03.537616 12175 ts_tablet_manager.cc:1905] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.537778 12172 tablet_bootstrap.cc:492] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:03.538676 12172 tablet_bootstrap.cc:654] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.547818 13531 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:03.549566 12173 ts_tablet_manager.cc:1918] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.550155 12173 log.cc:1199] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/305009f335144f40b8a2dae61edb3801
I20250625 14:02:03.551277 13532 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:03.553771 12173 ts_tablet_manager.cc:1939] T 305009f335144f40b8a2dae61edb3801 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.555493 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_71ef7f1a37884d13b6e66e0635ecdf6b [id=62132df62b3a42fb9886592b9b885d31] alter complete (version 4)
I20250625 14:02:03.558779 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 305009f335144f40b8a2dae61edb3801 (table default.Table_195a649075684f668a243215a37a93e0 [id=73eeb2af70b44421bffcf46be789f6e7]) successfully deleted
I20250625 14:02:03.560039 12175 ts_tablet_manager.cc:1918] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20250625 14:02:03.560046 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 2ca031c3707f4b4ea3a734081ae57a70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ca031c3707f4b4ea3a734081ae57a70 already in progress: creating tablet
I20250625 14:02:03.560546 12175 log.cc:1199] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0627b4ff4173405eba5bd0686bab8e55
I20250625 14:02:03.560904 12175 ts_tablet_manager.cc:1939] T 0627b4ff4173405eba5bd0686bab8e55 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:02:03.561735 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 022a3fb45dda44cfa58273f7fdb65d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 022a3fb45dda44cfa58273f7fdb65d6e already in progress: creating tablet
I20250625 14:02:03.561918 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0627b4ff4173405eba5bd0686bab8e55 (table default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]) successfully deleted
W20250625 14:02:03.562543 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 27a05814621446f0b40733de5ff51328 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27a05814621446f0b40733de5ff51328 already in progress: creating tablet
I20250625 14:02:03.562932 12173 tablet_replica.cc:331] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.563900 12173 raft_consensus.cc:2241] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.564508 12173 raft_consensus.cc:2270] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.565045 11524 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_47b438711bb4412895672499cd53a2d0 [id=416264ede8644650b07f6c60ffb3cc52] alter complete (version 2)
I20250625 14:02:03.565752 12167 tablet_bootstrap.cc:492] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.565852 12167 ts_tablet_manager.cc:1397] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.001s
I20250625 14:02:03.566473 12167 raft_consensus.cc:357] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.566604 12167 raft_consensus.cc:383] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.566645 12167 raft_consensus.cc:738] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.566772 12167 consensus_queue.cc:260] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.567067 12167 ts_tablet_manager.cc:1428] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.567284 12167 tablet_bootstrap.cc:492] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.567476 12173 ts_tablet_manager.cc:1905] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.568360 12167 tablet_bootstrap.cc:654] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.576517 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d99e27063554845bea98bbe70eba3b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e4822e4ed7a405e8940abf314052185) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.582204 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 3e8c6789c3b14bc88c2538c34d72a3a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.582589 11745 tablet_service.cc:1468] Processing CreateTablet for tablet c4ac61620d0e40dca0a9039c9477619c (DEFAULT_TABLE table=default.Table_be97292d424145e18538b8e77b13f862 [id=590bffdf534946a983fa9196fce3468e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.582926 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ac61620d0e40dca0a9039c9477619c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.583125 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c57cd636ba1c49508359b58785d42202" } new_table_name: "default.Table_cdfd8561a4094060b384a27b86b5db6d" modify_external_catalogs: true
I20250625 14:02:03.583541 12166 tablet_bootstrap.cc:492] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.583634 12166 ts_tablet_manager.cc:1397] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.100s user 0.000s sys 0.001s
I20250625 14:02:03.583411 12173 ts_tablet_manager.cc:1918] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.583932 12173 log.cc:1199] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d4eb86621bba4f3a897d4331ef30dc7f
I20250625 14:02:03.584187 12166 raft_consensus.cc:357] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.584301 12166 raft_consensus.cc:383] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.584342 12166 raft_consensus.cc:738] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.584487 12166 consensus_queue.cc:260] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.584762 12166 ts_tablet_manager.cc:1428] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.585335 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 3809e6ad12ac474ca625910be01de97a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.585475 12177 tablet_replica.cc:331] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.585594 12177 raft_consensus.cc:2241] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:03.585529 12173 ts_tablet_manager.cc:1939] T d4eb86621bba4f3a897d4331ef30dc7f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.585816 12177 raft_consensus.cc:2270] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.586237 12177 ts_tablet_manager.cc:1905] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.587178 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_322ff18a53304b238122781629c6a514" } modify_external_catalogs: true
I20250625 14:02:03.587296 12166 tablet_bootstrap.cc:492] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.587302 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_322ff18a53304b238122781629c6a514" } modify_external_catalogs: true
I20250625 14:02:03.588424 12166 tablet_bootstrap.cc:654] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.588721 12177 ts_tablet_manager.cc:1918] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.588800 12177 log.cc:1199] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/3e8c6789c3b14bc88c2538c34d72a3a4
I20250625 14:02:03.589064 12177 ts_tablet_manager.cc:1939] T 3e8c6789c3b14bc88c2538c34d72a3a4 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.590991 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c359a7a3792d45e49f813d0a82ff0c48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.591463 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c359a7a3792d45e49f813d0a82ff0c48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:03.593619 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 288a1cfb3c474a5a878824fc21937895 consensus state has no leader
I20250625 14:02:03.595606 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d4eb86621bba4f3a897d4331ef30dc7f (table default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]) successfully deleted
I20250625 14:02:03.596033 12173 tablet_replica.cc:331] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.596611 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 022a3fb45dda44cfa58273f7fdb65d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.597018 12173 raft_consensus.cc:2241] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:02:03.597637 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 022a3fb45dda44cfa58273f7fdb65d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 022a3fb45dda44cfa58273f7fdb65d6e already in progress: creating tablet
I20250625 14:02:03.598407 12173 raft_consensus.cc:2270] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.601045 12173 ts_tablet_manager.cc:1905] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.601614 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_27e4643611f149f5b8ce6162364e8467" } modify_external_catalogs: true
I20250625 14:02:03.601738 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_27e4643611f149f5b8ce6162364e8467" } modify_external_catalogs: true
I20250625 14:02:03.602106 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_141ea3329eb44d8c8324c18ba7f94190" } modify_external_catalogs: true
I20250625 14:02:03.602205 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_141ea3329eb44d8c8324c18ba7f94190" } modify_external_catalogs: true
I20250625 14:02:03.605731 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d2bbefbdbd3541e183f3c3412e226554" } new_table_name: "default.Table_ba804838cfbe40f1a000c4769352cad0" modify_external_catalogs: true
I20250625 14:02:03.605829 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_33b3ef9b15a44a80bafb79f5fcda8e16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.606236 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33b3ef9b15a44a80bafb79f5fcda8e16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.608793 11969 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:03.612325 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet cba459a70a404cdead8d487e6b9f2eb7
I20250625 14:02:03.613176 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet cba459a70a404cdead8d487e6b9f2eb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.613334 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet cba459a70a404cdead8d487e6b9f2eb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.613946 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d086d0ed39c54f178caeeb272d18536d" } new_table_name: "default.Table_f130f865e7e14d0188c06791bcc2071c" modify_external_catalogs: true
W20250625 14:02:03.615492 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d687605912a544fc945eb45e30ce0f1d consensus state has no leader
W20250625 14:02:03.613982 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet cba459a70a404cdead8d487e6b9f2eb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cba459a70a404cdead8d487e6b9f2eb7 already in progress: creating tablet
I20250625 14:02:03.616209 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 305009f335144f40b8a2dae61edb3801 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.616438 12177 tablet_replica.cc:331] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.616600 12177 raft_consensus.cc:2241] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.616724 12177 raft_consensus.cc:2270] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.616899 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 2ca031c3707f4b4ea3a734081ae57a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.617444 13232 raft_consensus.cc:491] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.617489 12177 ts_tablet_manager.cc:1905] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.617544 13232 raft_consensus.cc:513] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.617935 13232 leader_election.cc:290] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.618208 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 022a3fb45dda44cfa58273f7fdb65d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.618415 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8d99e27063554845bea98bbe70eba3b9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.618561 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 27a05814621446f0b40733de5ff51328 with delete_type TABLET_DATA_DELETED (replaced by tablet 3a81cafac2f041a9942bf8b074473d04) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:03.618804 11990 leader_election.cc:343] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.618990 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 0627b4ff4173405eba5bd0686bab8e55 with delete_type TABLET_DATA_DELETED (replaced by tablet 6729b7aa8fdf4bf481eccf39af87d8b9) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.619320 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet e83f77c487d948ceabb6c43366cc7154 with delete_type TABLET_DATA_DELETED (replaced by tablet d80e577509b54b97b6c55eef90a44cce) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.619614 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ff70668bede407c816db9779ce5221d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.620033 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet cba459a70a404cdead8d487e6b9f2eb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.620486 12177 ts_tablet_manager.cc:1918] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.620572 12177 log.cc:1199] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/305009f335144f40b8a2dae61edb3801
I20250625 14:02:03.621110 12177 ts_tablet_manager.cc:1939] T 305009f335144f40b8a2dae61edb3801 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.621605 12173 ts_tablet_manager.cc:1918] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.621874 12173 log.cc:1199] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0627b4ff4173405eba5bd0686bab8e55
I20250625 14:02:03.622094 12177 tablet_replica.cc:331] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.621970 13232 consensus_queue.cc:1035] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:03.622241 12177 raft_consensus.cc:2241] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.622385 12177 raft_consensus.cc:2270] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.622818 12177 ts_tablet_manager.cc:1905] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.623215 12166 tablet_bootstrap.cc:492] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.623304 12166 ts_tablet_manager.cc:1397] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:02:03.623431 13531 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:03.623683 12173 ts_tablet_manager.cc:1939] T 0627b4ff4173405eba5bd0686bab8e55 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.623814 12166 raft_consensus.cc:357] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.623926 12166 raft_consensus.cc:383] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.623960 12166 raft_consensus.cc:738] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.624667 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_58de87c7a0fe4c939540c86674a6d9b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.624935 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a06b507986ee4e899c0e55971e0f26e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.625147 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58de87c7a0fe4c939540c86674a6d9b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:03.625293 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a06b507986ee4e899c0e55971e0f26e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.625473 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9a1a2ddc789440a29fa5ef8c5b8df1a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.625813 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a1a2ddc789440a29fa5ef8c5b8df1a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.626077 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_47b438711bb4412895672499cd53a2d0" } new_table_name: "default.Table_8363d1ac13c64d2595ac6da9f3b0d38d" modify_external_catalogs: true
I20250625 14:02:03.624694 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ca9436b968804954b6f7d64045962db5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.627149 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca9436b968804954b6f7d64045962db5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.627331 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2baa220e01444322a4a589f1757b7ed7" } modify_external_catalogs: true
I20250625 14:02:03.627411 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2baa220e01444322a4a589f1757b7ed7" } modify_external_catalogs: true
I20250625 14:02:03.627405 12166 consensus_queue.cc:260] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.627735 12177 ts_tablet_manager.cc:1918] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:03.627803 12177 log.cc:1199] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0627b4ff4173405eba5bd0686bab8e55
I20250625 14:02:03.628073 12177 ts_tablet_manager.cc:1939] T 0627b4ff4173405eba5bd0686bab8e55 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.629793 12166 ts_tablet_manager.cc:1428] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250625 14:02:03.630640 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0627b4ff4173405eba5bd0686bab8e55 (table default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]) successfully deleted
I20250625 14:02:03.631167 12166 tablet_bootstrap.cc:492] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:02:03.631922 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet e83f77c487d948ceabb6c43366cc7154 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e83f77c487d948ceabb6c43366cc7154 already in progress: creating tablet
I20250625 14:02:03.632568 12173 tablet_replica.cc:331] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.633527 12173 raft_consensus.cc:2241] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.634168 12173 raft_consensus.cc:2270] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:03.636098 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee8757ca1f064d259b1dca36c431a0c2 consensus state has no leader
I20250625 14:02:03.637373 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ee3d8927b7f94271bacd0a22d5855829" } modify_external_catalogs: true
I20250625 14:02:03.637476 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ee3d8927b7f94271bacd0a22d5855829" } modify_external_catalogs: true
I20250625 14:02:03.640138 12166 tablet_bootstrap.cc:654] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.641419 12173 ts_tablet_manager.cc:1905] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.641762 12167 tablet_bootstrap.cc:492] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.641846 12167 ts_tablet_manager.cc:1397] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.000s
I20250625 14:02:03.642400 12167 raft_consensus.cc:357] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.642486 12177 tablet_replica.cc:331] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.642517 12167 raft_consensus.cc:383] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.642550 12167 raft_consensus.cc:738] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.642642 12177 raft_consensus.cc:2241] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.642671 12167 consensus_queue.cc:260] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.642731 12177 raft_consensus.cc:2270] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.642949 12167 ts_tablet_manager.cc:1428] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.643151 12167 tablet_bootstrap.cc:492] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.644215 12167 tablet_bootstrap.cc:654] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.646495 12177 ts_tablet_manager.cc:1905] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.650696 12177 ts_tablet_manager.cc:1918] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.650894 12177 log.cc:1199] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7ff70668bede407c816db9779ce5221d
I20250625 14:02:03.651221 12177 ts_tablet_manager.cc:1939] T 7ff70668bede407c816db9779ce5221d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.651273 12173 ts_tablet_manager.cc:1918] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.651786 12173 log.cc:1199] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8d99e27063554845bea98bbe70eba3b9
I20250625 14:02:03.653012 12172 tablet_bootstrap.cc:492] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.653107 12172 ts_tablet_manager.cc:1397] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.115s user 0.002s sys 0.000s
I20250625 14:02:03.653594 12172 raft_consensus.cc:357] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.653709 12172 raft_consensus.cc:383] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.653745 12172 raft_consensus.cc:738] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.653736 13532 tablet.cc:1722] T 96ec205b0f31484a91054fedf619b9ab P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:03.653870 12172 consensus_queue.cc:260] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.654156 12172 ts_tablet_manager.cc:1428] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.654840 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_839a1d001b0c40179c755c38f253efcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.655222 12172 tablet_bootstrap.cc:492] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:03.655622 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ca2784febf474360b12bb7a8329d312c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.655997 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca2784febf474360b12bb7a8329d312c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.656304 12172 tablet_bootstrap.cc:654] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.658872 12172 tablet_bootstrap.cc:492] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.658972 12172 ts_tablet_manager.cc:1397] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:03.659431 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e1cebf342db24cbfb93cba3cfb73036c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.659464 12172 raft_consensus.cc:357] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.659565 12172 raft_consensus.cc:383] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.659593 12172 raft_consensus.cc:738] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.659703 12172 consensus_queue.cc:260] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:03.659842 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1cebf342db24cbfb93cba3cfb73036c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.660008 12172 ts_tablet_manager.cc:1428] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.660190 12172 tablet_bootstrap.cc:492] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:03.660699 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_839a1d001b0c40179c755c38f253efcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.661206 12172 tablet_bootstrap.cc:654] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.662005 13232 raft_consensus.cc:491] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.662114 13232 raft_consensus.cc:513] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.662542 13232 leader_election.cc:290] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.662914 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "288e0c1644a34b8dabc06ccdda9f0fa9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:03.663406 11990 leader_election.cc:343] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.664283 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9db1f7bf20fa47ccb4e937f21ea0d020
I20250625 14:02:03.664875 11831 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:03.665343 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.665675 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.666384 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 3e8c6789c3b14bc88c2538c34d72a3a4 (table default.Table_b67c4059a8a6481d9f5d4457639fd851 [id=0124ee9b76f248ca8689a835beead152]) successfully deleted
W20250625 14:02:03.666693 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 3809e6ad12ac474ca625910be01de97a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3809e6ad12ac474ca625910be01de97a already in progress: creating tablet
I20250625 14:02:03.667323 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 305009f335144f40b8a2dae61edb3801 (table default.Table_195a649075684f668a243215a37a93e0 [id=73eeb2af70b44421bffcf46be789f6e7]) successfully deleted
I20250625 14:02:03.667656 12173 ts_tablet_manager.cc:1939] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:03.668252 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 2ca031c3707f4b4ea3a734081ae57a70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ca031c3707f4b4ea3a734081ae57a70 already in progress: creating tablet
I20250625 14:02:03.668298 13535 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:03.668332 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "288e0c1644a34b8dabc06ccdda9f0fa9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:03.668807 11784 raft_consensus.cc:2466] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:03.669435 12172 tablet_bootstrap.cc:492] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.669523 12172 ts_tablet_manager.cc:1397] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
W20250625 14:02:03.670010 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 022a3fb45dda44cfa58273f7fdb65d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 022a3fb45dda44cfa58273f7fdb65d6e already in progress: creating tablet
I20250625 14:02:03.670064 12172 raft_consensus.cc:357] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.670162 12172 raft_consensus.cc:383] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.670203 12172 raft_consensus.cc:738] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
W20250625 14:02:03.670198 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9db1f7bf20fa47ccb4e937f21ea0d020 already in progress: creating tablet
W20250625 14:02:03.670265 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 27a05814621446f0b40733de5ff51328 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 27a05814621446f0b40733de5ff51328 already in progress: creating tablet
I20250625 14:02:03.670341 12172 consensus_queue.cc:260] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.670645 12172 ts_tablet_manager.cc:1428] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.670639 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0627b4ff4173405eba5bd0686bab8e55 (table default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]) successfully deleted
I20250625 14:02:03.671845 12172 tablet_bootstrap.cc:492] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:03.672400 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet e83f77c487d948ceabb6c43366cc7154 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e83f77c487d948ceabb6c43366cc7154 already in progress: creating tablet
I20250625 14:02:03.672892 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7ff70668bede407c816db9779ce5221d (table default.Table_dab2b89c092c432f989c600f2f724b87 [id=f35c972d51bd4a3b9ea74dd70cad5913]) successfully deleted
W20250625 14:02:03.673131 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet cba459a70a404cdead8d487e6b9f2eb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cba459a70a404cdead8d487e6b9f2eb7 already in progress: creating tablet
I20250625 14:02:03.673651 12172 tablet_bootstrap.cc:654] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.674163 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.676630 12166 tablet_bootstrap.cc:492] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.676798 12166 ts_tablet_manager.cc:1397] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.000s
I20250625 14:02:03.677021 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8d99e27063554845bea98bbe70eba3b9 (table default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]) successfully deleted
I20250625 14:02:03.677490 12166 raft_consensus.cc:357] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.677774 12166 raft_consensus.cc:383] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.677868 12166 raft_consensus.cc:738] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.678076 12166 consensus_queue.cc:260] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.678885 12166 ts_tablet_manager.cc:1428] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:03.678871 13531 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:03.679509 12167 tablet_bootstrap.cc:492] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.679677 12167 ts_tablet_manager.cc:1397] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
W20250625 14:02:03.680130 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet cba459a70a404cdead8d487e6b9f2eb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cba459a70a404cdead8d487e6b9f2eb7 already in progress: creating tablet
I20250625 14:02:03.680341 12167 raft_consensus.cc:357] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.680505 12167 raft_consensus.cc:383] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.680593 12167 raft_consensus.cc:738] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.680809 12167 consensus_queue.cc:260] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.681272 12167 ts_tablet_manager.cc:1428] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:03.681918 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9db1f7bf20fa47ccb4e937f21ea0d020 already in progress: creating tablet
I20250625 14:02:03.683188 13532 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:03.684788 12167 tablet_bootstrap.cc:492] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.686030 12167 tablet_bootstrap.cc:654] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.689776 12166 tablet_bootstrap.cc:492] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.692133 12166 tablet_bootstrap.cc:654] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.695029 12172 tablet_bootstrap.cc:492] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.695150 12172 ts_tablet_manager.cc:1397] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20250625 14:02:03.697531 12172 raft_consensus.cc:357] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.697670 12172 raft_consensus.cc:383] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.697714 12172 raft_consensus.cc:738] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.697840 12172 consensus_queue.cc:260] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.698137 12172 ts_tablet_manager.cc:1428] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:03.700243 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 91669e7574f54b41a13c6f80583cd12b from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.700917 12172 tablet_bootstrap.cc:492] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:03.701678 13699 raft_consensus.cc:491] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.701761 13699 raft_consensus.cc:513] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.702010 12172 tablet_bootstrap.cc:654] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.702217 13699 leader_election.cc:290] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:03.704090 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9db1f7bf20fa47ccb4e937f21ea0d020 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9db1f7bf20fa47ccb4e937f21ea0d020 already in progress: creating tablet
I20250625 14:02:03.704645 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8578d07c9b4a44f887b5a30e92c1ede9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:03.705539 11717 leader_election.cc:343] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:03.707033 11993 leader_election.cc:343] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 8d99e27063554845bea98bbe70eba3b9
I20250625 14:02:03.707156 11993 leader_election.cc:304] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:02:03.707275 11993 raft_consensus.cc:2684] T 8d99e27063554845bea98bbe70eba3b9 P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:03.707791 11993 leader_election.cc:304] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:03.708333 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8578d07c9b4a44f887b5a30e92c1ede9" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:03.708828 13232 raft_consensus.cc:2802] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:03.708904 13232 raft_consensus.cc:491] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:03.708943 13232 raft_consensus.cc:3058] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.710103 13232 raft_consensus.cc:513] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.710533 13232 leader_election.cc:290] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.710974 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "288e0c1644a34b8dabc06ccdda9f0fa9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:03.711381 11990 leader_election.cc:343] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:03.711639 11717 leader_election.cc:343] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.711726 11717 leader_election.cc:304] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:03.711874 13335 raft_consensus.cc:2747] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:03.712301 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "288e0c1644a34b8dabc06ccdda9f0fa9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:03.712430 11778 raft_consensus.cc:3058] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.712921 12166 tablet_bootstrap.cc:492] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.712973 12167 tablet_bootstrap.cc:492] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.713017 12166 ts_tablet_manager.cc:1397] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:02:03.713063 12167 ts_tablet_manager.cc:1397] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.001s
I20250625 14:02:03.713550 11778 raft_consensus.cc:2466] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:03.713549 12167 raft_consensus.cc:357] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.713651 12167 raft_consensus.cc:383] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.713599 12166 raft_consensus.cc:357] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.713686 12167 raft_consensus.cc:738] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.713703 12166 raft_consensus.cc:383] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.713744 12166 raft_consensus.cc:738] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.713816 12167 consensus_queue.cc:260] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.713944 12166 consensus_queue.cc:260] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.714136 12167 ts_tablet_manager.cc:1428] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:03.714948 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_56a5f91af59040738b1802382d68ed19" } new_table_name: "default.Table_e4b712a772804189bf6493f4bc7b0980" modify_external_catalogs: true
I20250625 14:02:03.716285 12167 tablet_bootstrap.cc:492] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.720032 12166 ts_tablet_manager.cc:1428] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:02:03.720429 12166 tablet_bootstrap.cc:492] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.721266 12167 tablet_bootstrap.cc:654] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.722671 12166 tablet_bootstrap.cc:654] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.731220 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 21f88f43067643dd80ec8a2f5fb370c1 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.732041 12172 tablet_bootstrap.cc:492] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.732152 12172 ts_tablet_manager.cc:1397] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:02:03.732189 12167 tablet_bootstrap.cc:492] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.732295 12167 ts_tablet_manager.cc:1397] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20250625 14:02:03.732690 12172 raft_consensus.cc:357] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.732820 12172 raft_consensus.cc:383] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.732772 12167 raft_consensus.cc:357] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.732861 12172 raft_consensus.cc:738] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.732878 12167 raft_consensus.cc:383] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.732914 12167 raft_consensus.cc:738] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.732995 12172 consensus_queue.cc:260] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.733088 12167 consensus_queue.cc:260] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.733318 12172 ts_tablet_manager.cc:1428] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:03.733531 12172 tablet_bootstrap.cc:492] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:03.734069 11993 leader_election.cc:304] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:03.734444 13352 raft_consensus.cc:2802] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:03.734527 13352 raft_consensus.cc:695] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:03.734548 12167 ts_tablet_manager.cc:1428] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:03.734649 13352 consensus_queue.cc:237] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.734737 12167 tablet_bootstrap.cc:492] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.735862 12167 tablet_bootstrap.cc:654] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.736898 12172 tablet_bootstrap.cc:654] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.740252 13535 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:03.743872 12167 tablet_bootstrap.cc:492] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.744102 12167 ts_tablet_manager.cc:1397] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s
I20250625 14:02:03.744534 12166 tablet_bootstrap.cc:492] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.744696 12166 ts_tablet_manager.cc:1397] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20250625 14:02:03.745074 12167 raft_consensus.cc:357] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.745199 12167 raft_consensus.cc:383] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.745244 12167 raft_consensus.cc:738] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.745379 12167 consensus_queue.cc:260] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.745364 12166 raft_consensus.cc:357] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.745610 12166 raft_consensus.cc:383] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.745695 12166 raft_consensus.cc:738] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.745885 12166 consensus_queue.cc:260] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.747296 12167 ts_tablet_manager.cc:1428] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:03.747562 12167 tablet_bootstrap.cc:492] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.748741 12167 tablet_bootstrap.cc:654] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:03.749400 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 841e9b31a488404ebaf8626b759702f5 consensus state has no leader
I20250625 14:02:03.749718 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 21f88f43067643dd80ec8a2f5fb370c1
I20250625 14:02:03.749919 12166 ts_tablet_manager.cc:1428] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:02:03.750030 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 21f88f43067643dd80ec8a2f5fb370c1 deleted and replaced by tablet e37f8492550946d19eca63e6e7faa336
I20250625 14:02:03.750159 12166 tablet_bootstrap.cc:492] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.750588 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 21f88f43067643dd80ec8a2f5fb370c1 with delete_type TABLET_DATA_DELETED (replaced by tablet e37f8492550946d19eca63e6e7faa336) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.750906 12175 tablet_replica.cc:331] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.751055 12175 raft_consensus.cc:2241] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:03.751263 12175 raft_consensus.cc:2270] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.751287 12166 tablet_bootstrap.cc:654] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.751621 12175 ts_tablet_manager.cc:1905] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.754034 12175 ts_tablet_manager.cc:1918] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:03.754102 12175 log.cc:1199] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/21f88f43067643dd80ec8a2f5fb370c1
I20250625 14:02:03.754429 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 21f88f43067643dd80ec8a2f5fb370c1 with delete_type TABLET_DATA_DELETED (replaced by tablet e37f8492550946d19eca63e6e7faa336) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.754612 12173 tablet_replica.cc:331] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.754750 12173 raft_consensus.cc:2241] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.754868 12173 raft_consensus.cc:2270] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.755347 12173 ts_tablet_manager.cc:1905] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.755797 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]). Expected version 1 got 0
I20250625 14:02:03.757939 12173 ts_tablet_manager.cc:1918] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:03.758011 12173 log.cc:1199] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/21f88f43067643dd80ec8a2f5fb370c1
I20250625 14:02:03.758267 12173 ts_tablet_manager.cc:1939] T 21f88f43067643dd80ec8a2f5fb370c1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.758486 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:03.758527 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 59c24659c11049bfb13a6492e48dbb8a (DEFAULT_TABLE table=default.Table_53632d85cfb044be94de114375c5277e [id=da34fa986e2f49a6a9fc246d0e896a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.758793 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c24659c11049bfb13a6492e48dbb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.762254 11531 catalog_manager.cc:5582] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:03.762490 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 59c24659c11049bfb13a6492e48dbb8a (DEFAULT_TABLE table=default.Table_53632d85cfb044be94de114375c5277e [id=da34fa986e2f49a6a9fc246d0e896a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.762554 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 8578d07c9b4a44f887b5a30e92c1ede9 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]). Expected version 1 got 0
I20250625 14:02:03.762763 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c24659c11049bfb13a6492e48dbb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.764868 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 21f88f43067643dd80ec8a2f5fb370c1 with delete_type TABLET_DATA_DELETED (replaced by tablet e37f8492550946d19eca63e6e7faa336) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.764945 13335 raft_consensus.cc:491] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.765075 12177 tablet_replica.cc:331] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.765038 13335 raft_consensus.cc:513] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.765089 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b32ae37200da4a7ca5cdbc4d7c6ce26a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.765221 12177 raft_consensus.cc:2241] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.765339 12177 raft_consensus.cc:2270] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.765411 13335 leader_election.cc:290] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:03.765447 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b32ae37200da4a7ca5cdbc4d7c6ce26a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.765436 11745 tablet_service.cc:1468] Processing CreateTablet for tablet 59c24659c11049bfb13a6492e48dbb8a (DEFAULT_TABLE table=default.Table_53632d85cfb044be94de114375c5277e [id=da34fa986e2f49a6a9fc246d0e896a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.765668 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c24659c11049bfb13a6492e48dbb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.765726 12177 ts_tablet_manager.cc:1905] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.766608 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]) successfully deleted
I20250625 14:02:03.767639 12175 ts_tablet_manager.cc:1939] T 21f88f43067643dd80ec8a2f5fb370c1 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.768049 12177 ts_tablet_manager.cc:1918] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:03.768131 12177 log.cc:1199] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/21f88f43067643dd80ec8a2f5fb370c1
I20250625 14:02:03.768400 12177 ts_tablet_manager.cc:1939] T 21f88f43067643dd80ec8a2f5fb370c1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.768622 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]) successfully deleted
I20250625 14:02:03.769428 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cfcb08ddbdd43dd92472dcbdc772a2d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:03.770462 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cfcb08ddbdd43dd92472dcbdc772a2d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.771382 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 21f88f43067643dd80ec8a2f5fb370c1 (table default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]) successfully deleted
W20250625 14:02:03.773176 11717 leader_election.cc:343] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:03.773447 11717 leader_election.cc:343] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.773540 11717 leader_election.cc:304] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:03.773775 13335 raft_consensus.cc:2747] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:03.773842 12166 tablet_bootstrap.cc:492] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.773939 12166 ts_tablet_manager.cc:1397] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20250625 14:02:03.774561 12166 raft_consensus.cc:357] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.774683 12166 raft_consensus.cc:383] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.774713 12166 raft_consensus.cc:738] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.774840 12166 consensus_queue.cc:260] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.775123 12166 ts_tablet_manager.cc:1428] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:03.775336 12166 tablet_bootstrap.cc:492] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.776571 12166 tablet_bootstrap.cc:654] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.776587 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 91669e7574f54b41a13c6f80583cd12b
I20250625 14:02:03.776690 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1
I20250625 14:02:03.776917 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 91669e7574f54b41a13c6f80583cd12b deleted and replaced by tablet 023aee30da724f879aeb71e807d94a10
I20250625 14:02:03.777652 12167 tablet_bootstrap.cc:492] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.777681 13121 raft_consensus.cc:491] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.777750 12167 ts_tablet_manager.cc:1397] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.001s
I20250625 14:02:03.777956 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 91669e7574f54b41a13c6f80583cd12b with delete_type TABLET_DATA_DELETED (replaced by tablet 023aee30da724f879aeb71e807d94a10) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.778167 11525 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 8578d07c9b4a44f887b5a30e92c1ede9 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]). Expected version 1 got 0
I20250625 14:02:03.778295 12167 raft_consensus.cc:357] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.778403 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 91669e7574f54b41a13c6f80583cd12b with delete_type TABLET_DATA_DELETED (replaced by tablet 023aee30da724f879aeb71e807d94a10) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.778447 12167 raft_consensus.cc:383] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.778478 12167 raft_consensus.cc:738] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.778573 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.778620 12167 consensus_queue.cc:260] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.778848 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1a26eb678ade4b44993806e57644ec85
I20250625 14:02:03.778926 12167 ts_tablet_manager.cc:1428] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:03.778890 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 91669e7574f54b41a13c6f80583cd12b with delete_type TABLET_DATA_DELETED (replaced by tablet 023aee30da724f879aeb71e807d94a10) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.779116 12167 tablet_bootstrap.cc:492] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.779320 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.779572 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 4cab07f1176143ba8da576817132876d
W20250625 14:02:03.780115 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 91669e7574f54b41a13c6f80583cd12b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91669e7574f54b41a13c6f80583cd12b already in progress: creating tablet
I20250625 14:02:03.780261 12167 tablet_bootstrap.cc:654] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:03.780261 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 already in progress: creating tablet
I20250625 14:02:03.780454 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.780715 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a26eb678ade4b44993806e57644ec85 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.780809 11530 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 8578d07c9b4a44f887b5a30e92c1ede9 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]). Expected version 1 got 0
I20250625 14:02:03.780869 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 4cab07f1176143ba8da576817132876d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.781340 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a26eb678ade4b44993806e57644ec85 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.777757 13121 raft_consensus.cc:513] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.782047 13121 leader_election.cc:290] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:03.782485 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 91669e7574f54b41a13c6f80583cd12b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91669e7574f54b41a13c6f80583cd12b already in progress: creating tablet
I20250625 14:02:03.782611 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3a5c9b1852a847188bb7e2f08a37fded" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.782743 11915 raft_consensus.cc:2466] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:03.782763 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 already in progress: creating tablet
I20250625 14:02:03.783234 11990 leader_election.cc:304] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:03.783555 11763 tablet_service.cc:1515] Processing DeleteTablet for tablet 4cab07f1176143ba8da576817132876d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.783922 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3a5c9b1852a847188bb7e2f08a37fded" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:03.784055 11778 raft_consensus.cc:2466] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:03.784303 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1a26eb678ade4b44993806e57644ec85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a26eb678ade4b44993806e57644ec85 already in progress: creating tablet
I20250625 14:02:03.784319 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 1a26eb678ade4b44993806e57644ec85 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.785113 13232 raft_consensus.cc:2802] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:03.785192 13232 raft_consensus.cc:491] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:03.785249 13232 raft_consensus.cc:3058] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.786515 13232 raft_consensus.cc:513] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
I20250625 14:02:03.787134 13232 leader_election.cc:290] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:03.787497 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3a5c9b1852a847188bb7e2f08a37fded" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:03.787612 11915 raft_consensus.cc:3058] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.782059 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 4cab07f1176143ba8da576817132876d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.788731 11915 raft_consensus.cc:2466] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:03.788969 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_8363d1ac13c64d2595ac6da9f3b0d38d [id=416264ede8644650b07f6c60ffb3cc52] alter complete (version 3)
I20250625 14:02:03.789038 11990 leader_election.cc:304] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:03.789208 13232 raft_consensus.cc:2802] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:03.789302 13232 raft_consensus.cc:695] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:03.789484 13232 consensus_queue.cc:237] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } }
W20250625 14:02:03.789737 11531 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 8578d07c9b4a44f887b5a30e92c1ede9 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8578d07c9b4a44f887b5a30e92c1ede9 consensus state has no leader
W20250625 14:02:03.790518 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 4cab07f1176143ba8da576817132876d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cab07f1176143ba8da576817132876d already in progress: creating tablet
W20250625 14:02:03.791070 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1a26eb678ade4b44993806e57644ec85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a26eb678ade4b44993806e57644ec85 already in progress: creating tablet
I20250625 14:02:03.791544 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3a5c9b1852a847188bb7e2f08a37fded" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:03.791713 11778 raft_consensus.cc:3058] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.793218 11778 raft_consensus.cc:2466] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:03.794884 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cb56a7e714d45038feaf1132a5e06af with delete_type TABLET_DATA_DELETED (replaced by tablet 725a0db4c6374805903657f755ca1783) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:03.794917 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 4cab07f1176143ba8da576817132876d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cab07f1176143ba8da576817132876d already in progress: creating tablet
I20250625 14:02:03.795173 12173 tablet_replica.cc:331] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.795328 12173 raft_consensus.cc:2241] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.795441 12173 raft_consensus.cc:2270] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.796216 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 806e5502a95e4a0396c008267e16f2d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:03.796172 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8363d1ac13c64d2595ac6da9f3b0d38d" } new_table_name: "default.Table_fbb28c12dc3e450187de7576fc8fba72" modify_external_catalogs: true
I20250625 14:02:03.796351 12173 ts_tablet_manager.cc:1905] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.796435 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet d4eb86621bba4f3a897d4331ef30dc7f with delete_type TABLET_DATA_DELETED (replaced by tablet 9d8501126146425baa26ba7741963085) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.796577 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 8d99e27063554845bea98bbe70eba3b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e4822e4ed7a405e8940abf314052185) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.796633 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cb56a7e714d45038feaf1132a5e06af with delete_type TABLET_DATA_DELETED (replaced by tablet 725a0db4c6374805903657f755ca1783) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.797166 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 806e5502a95e4a0396c008267e16f2d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.797382 12177 tablet_replica.cc:331] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.797470 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:03.797536 12177 raft_consensus.cc:2241] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.797672 12177 raft_consensus.cc:2270] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.798225 12177 ts_tablet_manager.cc:1905] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.798884 12173 ts_tablet_manager.cc:1918] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.798949 12173 log.cc:1199] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/9cb56a7e714d45038feaf1132a5e06af
I20250625 14:02:03.799157 12173 ts_tablet_manager.cc:1939] T 9cb56a7e714d45038feaf1132a5e06af P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.800945 12177 ts_tablet_manager.cc:1918] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.801055 12177 log.cc:1199] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/806e5502a95e4a0396c008267e16f2d5
I20250625 14:02:03.801301 12177 ts_tablet_manager.cc:1939] T 806e5502a95e4a0396c008267e16f2d5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.802038 12177 tablet_replica.cc:331] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:03.802125 12175 tablet_replica.cc:331] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.802096 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 806e5502a95e4a0396c008267e16f2d5 (table default.Table_2c2b195f74a64e3990919d0efcb9e1ac [id=2b820ab8a4944bdd9b3e272975715817]) successfully deleted
I20250625 14:02:03.802209 12177 raft_consensus.cc:2241] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.802265 12175 raft_consensus.cc:2241] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.802575 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_f46ef5ce088042ee89cb48170a0011f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.802990 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f46ef5ce088042ee89cb48170a0011f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.803483 12177 raft_consensus.cc:2270] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.803973 12175 raft_consensus.cc:2270] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.804597 12175 ts_tablet_manager.cc:1905] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.804821 12173 tablet_replica.cc:331] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:03.804982 12173 raft_consensus.cc:2241] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.805081 12173 raft_consensus.cc:2270] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.805366 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 9cb56a7e714d45038feaf1132a5e06af (table default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]) successfully deleted
W20250625 14:02:03.805526 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 91669e7574f54b41a13c6f80583cd12b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91669e7574f54b41a13c6f80583cd12b already in progress: creating tablet
W20250625 14:02:03.805648 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03ae63c5b8bb4ee68f30eb45d9c4afe1 already in progress: creating tablet
I20250625 14:02:03.805383 12177 ts_tablet_manager.cc:1905] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:03.805750 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1a26eb678ade4b44993806e57644ec85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a26eb678ade4b44993806e57644ec85 already in progress: creating tablet
W20250625 14:02:03.806123 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 4cab07f1176143ba8da576817132876d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cab07f1176143ba8da576817132876d already in progress: creating tablet
I20250625 14:02:03.806881 12173 ts_tablet_manager.cc:1905] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.808049 12175 ts_tablet_manager.cc:1918] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.808188 12175 log.cc:1199] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d4eb86621bba4f3a897d4331ef30dc7f
I20250625 14:02:03.808495 12175 ts_tablet_manager.cc:1939] T d4eb86621bba4f3a897d4331ef30dc7f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.809226 12175 tablet_replica.cc:331] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.812644 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d4eb86621bba4f3a897d4331ef30dc7f (table default.Table_32b14f38ef524c96a29e322dea10e327 [id=161de6b813034b2686e7598b3d3f6b3f]) successfully deleted
I20250625 14:02:03.814467 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a6b202cb3027445c92b5154b484b96ab" } modify_external_catalogs: true
I20250625 14:02:03.814714 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a6b202cb3027445c92b5154b484b96ab" } modify_external_catalogs: true
I20250625 14:02:03.813149 12175 raft_consensus.cc:2241] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.816443 12175 raft_consensus.cc:2270] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.817035 12167 tablet_bootstrap.cc:492] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.817134 12167 ts_tablet_manager.cc:1397] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.002s
I20250625 14:02:03.817304 13531 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:03.817667 12167 raft_consensus.cc:357] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.817790 12167 raft_consensus.cc:383] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.817824 12167 raft_consensus.cc:738] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.817930 12167 consensus_queue.cc:260] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.818192 12167 ts_tablet_manager.cc:1428] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.818429 12167 tablet_bootstrap.cc:492] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.819525 12167 tablet_bootstrap.cc:654] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.821136 13532 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:03.821857 13535 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:03.826581 11530 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_fbb28c12dc3e450187de7576fc8fba72 [id=416264ede8644650b07f6c60ffb3cc52]). Expected version 4 got 3
I20250625 14:02:03.827248 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_54730abfeae842ec8ed188adc4a65e74" } new_table_name: "default.Table_499c2598c4404fada73927fa9f8b52cf" modify_external_catalogs: true
I20250625 14:02:03.828547 12175 ts_tablet_manager.cc:1905] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.831243 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5743a02af69a4e8190790ca031655075"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.831616 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5743a02af69a4e8190790ca031655075 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.834542 12177 ts_tablet_manager.cc:1918] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.834815 12177 log.cc:1199] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/ce6e907d627f4f3e8219eaabe4373c6e
I20250625 14:02:03.835191 12173 ts_tablet_manager.cc:1918] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.835543 12173 log.cc:1199] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/806e5502a95e4a0396c008267e16f2d5
I20250625 14:02:03.835638 12175 ts_tablet_manager.cc:1918] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.835711 12175 log.cc:1199] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8d99e27063554845bea98bbe70eba3b9
I20250625 14:02:03.836230 12177 ts_tablet_manager.cc:1939] T ce6e907d627f4f3e8219eaabe4373c6e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:03.836887 12173 ts_tablet_manager.cc:1939] T 806e5502a95e4a0396c008267e16f2d5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:03.840096 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c3df90d585fc468fb479f6c7fb76d6c3" } new_table_name: "default.Table_8694fa46d7aa48b68241f1478a522dee" modify_external_catalogs: true
I20250625 14:02:03.840202 12167 tablet_bootstrap.cc:492] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.840307 12167 ts_tablet_manager.cc:1397] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:02:03.841007 12167 raft_consensus.cc:357] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.841128 12167 raft_consensus.cc:383] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.841158 12167 raft_consensus.cc:738] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.841292 12167 consensus_queue.cc:260] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.841603 12167 ts_tablet_manager.cc:1428] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:03.841813 12167 tablet_bootstrap.cc:492] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.843338 12167 tablet_bootstrap.cc:654] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.843704 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet ce6e907d627f4f3e8219eaabe4373c6e (table default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]) successfully deleted
I20250625 14:02:03.843804 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 806e5502a95e4a0396c008267e16f2d5 (table default.Table_2c2b195f74a64e3990919d0efcb9e1ac [id=2b820ab8a4944bdd9b3e272975715817]) successfully deleted
I20250625 14:02:03.846024 13699 raft_consensus.cc:491] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.846153 12175 ts_tablet_manager.cc:1939] T 8d99e27063554845bea98bbe70eba3b9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.846129 13699 raft_consensus.cc:513] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.846537 13699 leader_election.cc:290] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.847146 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2f30f99bdda41dba6960ffdeb69226b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:03.847141 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2f30f99bdda41dba6960ffdeb69226b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.847275 12047 raft_consensus.cc:2466] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:03.847555 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8d99e27063554845bea98bbe70eba3b9 (table default.Table_b28f9c1348994d7da3bacbb75fa2fffa [id=8ea0c55c7cb44d7aa0390ae3f27746e3]) successfully deleted
W20250625 14:02:03.847576 11717 leader_election.cc:343] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.847932 11717 leader_election.cc:304] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:03.848237 13699 raft_consensus.cc:2802] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:03.848289 13699 raft_consensus.cc:491] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:03.848325 13699 raft_consensus.cc:3058] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.848667 12175 tablet_replica.cc:331] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.848835 12175 raft_consensus.cc:2241] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.848953 12175 raft_consensus.cc:2270] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:03.849416 13699 raft_consensus.cc:513] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.849752 13699 leader_election.cc:290] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.850510 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2f30f99bdda41dba6960ffdeb69226b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:03.850510 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2f30f99bdda41dba6960ffdeb69226b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:03.850646 12047 raft_consensus.cc:3058] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.851815 12047 raft_consensus.cc:2466] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:03.852293 11717 leader_election.cc:304] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
W20250625 14:02:03.852504 11717 leader_election.cc:343] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.852965 13699 raft_consensus.cc:2802] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:03.853060 13699 raft_consensus.cc:695] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:03.853204 13699 consensus_queue.cc:237] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.855033 12175 ts_tablet_manager.cc:1905] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.857961 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b31fb502c0004e95875019216e579ded"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.858918 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b31fb502c0004e95875019216e579ded in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.857961 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e77c45db17e9427d944508b684cc31ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.859337 12167 tablet_bootstrap.cc:492] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.859441 12167 ts_tablet_manager.cc:1397] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
W20250625 14:02:03.859548 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e77c45db17e9427d944508b684cc31ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.860107 12167 raft_consensus.cc:357] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.860306 12167 raft_consensus.cc:383] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.860392 12167 raft_consensus.cc:738] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.860482 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_61cd97c7a2044d468ce5381949b33cb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.860806 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61cd97c7a2044d468ce5381949b33cb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.861193 12167 consensus_queue.cc:260] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.862771 12167 ts_tablet_manager.cc:1428] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:03.863698 12167 tablet_bootstrap.cc:492] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.864832 12167 tablet_bootstrap.cc:654] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.868162 12104 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:03.870136 12175 ts_tablet_manager.cc:1918] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.871116 13352 raft_consensus.cc:491] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.871234 13352 raft_consensus.cc:513] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.871603 13352 leader_election.cc:290] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:03.871613 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43e338d945ab46959c9fbd974d8c9eae has no consensus state
I20250625 14:02:03.871914 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_072df55a5df0479fb592845c15dff01c" } new_table_name: "default.Table_7cc28adaccf84f3ca20a49374e249516" modify_external_catalogs: true
I20250625 14:02:03.872864 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_fbb28c12dc3e450187de7576fc8fba72 [id=416264ede8644650b07f6c60ffb3cc52] alter complete (version 4)
I20250625 14:02:03.873346 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2882122b54e4457a9612d282e97ba23f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:03.873562 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_70428e9afd4743d6be12e15dc759b401" } modify_external_catalogs: true
I20250625 14:02:03.873663 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_70428e9afd4743d6be12e15dc759b401" } modify_external_catalogs: true
W20250625 14:02:03.873739 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2882122b54e4457a9612d282e97ba23f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:03.874053 11993 leader_election.cc:343] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: ce6e907d627f4f3e8219eaabe4373c6e
I20250625 14:02:03.874634 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 75562ea1650c4bdcbf38574465f62ce2 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.875033 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8c1122208d994348afca916054248c4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.875422 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c1122208d994348afca916054248c4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.874270 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ce6e907d627f4f3e8219eaabe4373c6e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.875782 12166 tablet_bootstrap.cc:492] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.876384 12166 ts_tablet_manager.cc:1397] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.000s
I20250625 14:02:03.876453 12172 tablet_bootstrap.cc:492] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.876554 12172 ts_tablet_manager.cc:1397] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.143s user 0.002s sys 0.000s
I20250625 14:02:03.876962 12166 raft_consensus.cc:357] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.876997 12172 raft_consensus.cc:357] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.877075 12166 raft_consensus.cc:383] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.877107 12172 raft_consensus.cc:383] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.877115 12166 raft_consensus.cc:738] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.877135 12172 raft_consensus.cc:738] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.877238 12166 consensus_queue.cc:260] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.877259 12172 consensus_queue.cc:260] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.877530 12166 ts_tablet_manager.cc:1428] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.877539 12172 ts_tablet_manager.cc:1428] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.877740 12166 tablet_bootstrap.cc:492] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.877748 12172 tablet_bootstrap.cc:492] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:03.878703 12172 tablet_bootstrap.cc:654] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.880224 12175 log.cc:1199] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/9cb56a7e714d45038feaf1132a5e06af
I20250625 14:02:03.880504 12175 ts_tablet_manager.cc:1939] T 9cb56a7e714d45038feaf1132a5e06af P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:02:03.880584 11990 leader_election.cc:343] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.880671 11990 leader_election.cc:304] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:03.880834 13352 raft_consensus.cc:2747] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:03.881628 11969 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:03.884815 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 9cb56a7e714d45038feaf1132a5e06af (table default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]) successfully deleted
I20250625 14:02:03.892539 12172 tablet_bootstrap.cc:492] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.892638 12172 ts_tablet_manager.cc:1397] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:02:03.893064 12172 raft_consensus.cc:357] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.893164 12172 raft_consensus.cc:383] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.893201 12172 raft_consensus.cc:738] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.893312 12172 consensus_queue.cc:260] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.893612 12172 ts_tablet_manager.cc:1428] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.893770 12172 tablet_bootstrap.cc:492] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:03.895444 11831 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:03.896236 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_99098914758c439e9c7092afb6b931db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.896651 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99098914758c439e9c7092afb6b931db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.897632 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a1f522ca2d6a413788c593d412818d44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:03.897970 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1f522ca2d6a413788c593d412818d44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:03.898217 12172 tablet_bootstrap.cc:654] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.899127 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ff70668bede407c816db9779ce5221d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:03.899466 12175 tablet_replica.cc:331] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:03.899627 12175 raft_consensus.cc:2241] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:03.899737 12175 raft_consensus.cc:2270] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:03.900885 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c0c788abff9449797dd272d45e5fa7b consensus state has no leader
I20250625 14:02:03.903627 13699 raft_consensus.cc:491] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.903733 13699 raft_consensus.cc:513] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.904145 13699 leader_election.cc:290] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.904518 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b08135db764c4eb286d5f67ccba94ed5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.904547 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b08135db764c4eb286d5f67ccba94ed5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:03.904671 12047 raft_consensus.cc:2466] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:03.904933 11717 leader_election.cc:304] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:03.905092 13699 raft_consensus.cc:2802] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 14:02:03.905126 11717 leader_election.cc:343] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.905144 13699 raft_consensus.cc:491] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:03.905274 13699 raft_consensus.cc:3058] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.906504 13699 raft_consensus.cc:513] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.906858 13699 leader_election.cc:290] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.907529 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b08135db764c4eb286d5f67ccba94ed5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:03.907657 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b08135db764c4eb286d5f67ccba94ed5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:03.907789 12047 raft_consensus.cc:3058] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.908903 12047 raft_consensus.cc:2466] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:03.909265 11717 leader_election.cc:304] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:03.909430 13699 raft_consensus.cc:2802] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 14:02:03.909466 11717 leader_election.cc:343] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.909512 13699 raft_consensus.cc:695] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:03.909646 13699 consensus_queue.cc:237] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.915313 12166 tablet_bootstrap.cc:654] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.916280 12167 tablet_bootstrap.cc:492] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.916405 12167 ts_tablet_manager.cc:1397] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.001s
I20250625 14:02:03.916935 12167 raft_consensus.cc:357] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.917065 12167 raft_consensus.cc:383] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.917101 12167 raft_consensus.cc:738] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.917235 12167 consensus_queue.cc:260] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.917552 12167 ts_tablet_manager.cc:1428] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.917763 12167 tablet_bootstrap.cc:492] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:02:03.917987 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df4b51d1f71b4711a57c9aaf43758d66 consensus state has no leader
I20250625 14:02:03.920665 12175 ts_tablet_manager.cc:1905] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:03.923254 12175 ts_tablet_manager.cc:1918] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:03.923169 11531 catalog_manager.cc:5582] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:03.923332 12175 log.cc:1199] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7ff70668bede407c816db9779ce5221d
I20250625 14:02:03.923382 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]). Expected version 1 got 0
I20250625 14:02:03.923489 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet b08135db764c4eb286d5f67ccba94ed5 (table default.Table_c769119bc7a3472d91c5e524724929e9 [id=44f2f74bfee54c72b3dee93db46b35e5]). Expected version 3 got 0
I20250625 14:02:03.923547 12175 ts_tablet_manager.cc:1939] T 7ff70668bede407c816db9779ce5221d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:03.924582 11527 catalog_manager.cc:5582] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:03.924873 12167 tablet_bootstrap.cc:654] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.927525 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 1a0f1ff588d741c59633ca693573a32f (DEFAULT_TABLE table=default.Table_a06b507986ee4e899c0e55971e0f26e0 [id=9dddd7175ba84a0789d67cabcc3f2665]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.927760 11745 tablet_service.cc:1468] Processing CreateTablet for tablet cfadca64663b4219a52d6a0c1c2d1065 (DEFAULT_TABLE table=default.Table_e1cebf342db24cbfb93cba3cfb73036c [id=6842e2c1f14c4d4389caf0811688eda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.927837 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0f1ff588d741c59633ca693573a32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.927992 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfadca64663b4219a52d6a0c1c2d1065. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.930202 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 32b6e047a46c47e683ed1d54312d2064 (DEFAULT_TABLE table=default.Table_9a1a2ddc789440a29fa5ef8c5b8df1a7 [id=ece5ae70819c4408b9b05c25c321a0e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.930461 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b6e047a46c47e683ed1d54312d2064. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.932628 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 149cdeaf3d1749deab6d8356da77da68 (DEFAULT_TABLE table=default.Table_ca9436b968804954b6f7d64045962db5 [id=0542d890141149c7af5f00cd83e13e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.932973 12167 tablet_bootstrap.cc:492] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.933065 12167 ts_tablet_manager.cc:1397] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:02:03.933138 11747 tablet_service.cc:1468] Processing CreateTablet for tablet 2362b545ecd04efd802e37cecc970831 (DEFAULT_TABLE table=default.Table_a993f17e7b92482bae11fbf6fb6ed707 [id=4c3e5ed1d80549d0b4231a3c7a9ba315]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.933497 11748 tablet_service.cc:1468] Processing CreateTablet for tablet 34638360c97a471fafd57f23421030a4 (DEFAULT_TABLE table=default.Table_7b0f1224e6da425baf571299c5d487d1 [id=c29814a419cb4691bed92403e7f6b84b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.933626 12167 raft_consensus.cc:357] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.933729 12167 raft_consensus.cc:383] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.933758 12167 raft_consensus.cc:738] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.933842 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 96ed000d46ca470a8953e1df18767bd8 (DEFAULT_TABLE table=default.Table_3aff8c0599c741d28f55f371ae6082d1 [id=18031af3b0d74cc3881d81fb9008ebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.933914 12167 consensus_queue.cc:260] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.934134 11750 tablet_service.cc:1468] Processing CreateTablet for tablet bd46e1586f7b40d195797b1db8889171 (DEFAULT_TABLE table=default.Table_33b3ef9b15a44a80bafb79f5fcda8e16 [id=7f9f541ce06f4512be285c6199027fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.934517 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149cdeaf3d1749deab6d8356da77da68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.934798 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ed000d46ca470a8953e1df18767bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.936785 12167 ts_tablet_manager.cc:1428] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:03.937398 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34638360c97a471fafd57f23421030a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.939337 12167 tablet_bootstrap.cc:492] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.939508 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2362b545ecd04efd802e37cecc970831. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.942723 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd46e1586f7b40d195797b1db8889171. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.943984 12172 tablet_bootstrap.cc:492] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:03.944077 12172 ts_tablet_manager.cc:1397] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.000s
I20250625 14:02:03.944597 12172 raft_consensus.cc:357] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.944710 12172 raft_consensus.cc:383] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.944741 12172 raft_consensus.cc:738] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.944864 12172 consensus_queue.cc:260] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.945151 12172 ts_tablet_manager.cc:1428] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:03.945351 12172 tablet_bootstrap.cc:492] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:03.946218 12265 raft_consensus.cc:491] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.946413 12172 tablet_bootstrap.cc:654] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.946374 12265 raft_consensus.cc:513] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:03.946794 12265 leader_election.cc:290] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:03.947244 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "288e0c1644a34b8dabc06ccdda9f0fa9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:03.947376 11780 raft_consensus.cc:2391] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:03.947597 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "288e0c1644a34b8dabc06ccdda9f0fa9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:03.948777 11858 leader_election.cc:304] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:03.949281 12265 raft_consensus.cc:3058] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.950446 12265 raft_consensus.cc:2747] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:03.950745 12166 tablet_bootstrap.cc:492] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:03.950839 12166 ts_tablet_manager.cc:1397] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.000s
I20250625 14:02:03.950824 13352 raft_consensus.cc:491] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.950937 13352 raft_consensus.cc:513] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.951383 13352 leader_election.cc:290] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.951334 12166 raft_consensus.cc:357] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.951442 12166 raft_consensus.cc:383] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.951479 12166 raft_consensus.cc:738] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.951587 12166 consensus_queue.cc:260] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.951886 12166 ts_tablet_manager.cc:1428] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:03.952834 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f2576ff766494c37b316552a66a5ff31" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:03.953544 11990 leader_election.cc:343] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.955107 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 66e71a05333f425aa3c82a817269eb48 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.955183 12166 tablet_bootstrap.cc:492] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:03.956238 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet bf421457ab6c481f9fd6e18a9572ba5f from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:03.956769 12167 tablet_bootstrap.cc:654] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.957131 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_16cb68f67e81452ab5be9b16c3e6f0ca" } new_table_name: "default.Table_240eff761a9d4c4c8d44f3e36ffe1d7d" modify_external_catalogs: true
I20250625 14:02:03.956213 12166 tablet_bootstrap.cc:654] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.967020 13699 raft_consensus.cc:491] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:03.967146 13699 raft_consensus.cc:513] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.967519 13699 leader_election.cc:290] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:03.968940 11993 leader_election.cc:343] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: f2576ff766494c37b316552a66a5ff31
I20250625 14:02:03.969061 11993 leader_election.cc:304] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:03.969252 13352 raft_consensus.cc:2747] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:03.969700 12167 tablet_bootstrap.cc:492] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:03.969792 12167 ts_tablet_manager.cc:1397] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.001s
I20250625 14:02:03.969769 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6318e27fb194a209c1c80ffcaf24a64" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:03.970052 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6318e27fb194a209c1c80ffcaf24a64" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:03.970163 12047 raft_consensus.cc:2466] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:03.970834 12167 raft_consensus.cc:357] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.970963 12167 raft_consensus.cc:383] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:03.971001 12167 raft_consensus.cc:738] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:03.971134 12167 consensus_queue.cc:260] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.971436 12167 ts_tablet_manager.cc:1428] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:03.972781 12167 tablet_bootstrap.cc:492] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:03.973729 12167 tablet_bootstrap.cc:654] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:03.974351 11717 leader_election.cc:304] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:03.974398 11763 tablet_service.cc:1468] Processing CreateTablet for tablet 3a81cafac2f041a9942bf8b074473d04 (DEFAULT_TABLE table=default.Table_5c451f1ba2f246549b649bf689a73ec1 [id=b0b734e1e1d04d9c8f633d5ecfbdc13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.974551 13699 raft_consensus.cc:2802] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:03.974619 13699 raft_consensus.cc:491] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:03.974658 13699 raft_consensus.cc:3058] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.974742 11745 tablet_service.cc:1468] Processing CreateTablet for tablet f5b28966c4ae41eb948ea34682716ddb (DEFAULT_TABLE table=default.Table_839a1d001b0c40179c755c38f253efcd [id=fa92e7adcec946dbb9792fdfa79ab4a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.974771 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 6729b7aa8fdf4bf481eccf39af87d8b9 (DEFAULT_TABLE table=default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.974658 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a81cafac2f041a9942bf8b074473d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.975260 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 38ed475ff22e49d6b6962c7c0cd621de (DEFAULT_TABLE table=default.Table_c359a7a3792d45e49f813d0a82ff0c48 [id=924bc897165a4a84990c6206b5136755]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.975472 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ed475ff22e49d6b6962c7c0cd621de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.975792 13699 raft_consensus.cc:513] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:03.976140 13699 leader_election.cc:290] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:03.977465 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6729b7aa8fdf4bf481eccf39af87d8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.983134 11748 tablet_service.cc:1468] Processing CreateTablet for tablet a5b4e3ea49ad4935b3f95254adaada8d (DEFAULT_TABLE table=default.Table_817ebd8b0122471f833e049491b8d994 [id=4ee3bb3f73be4e66b473e914496cd36f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.983422 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b4e3ea49ad4935b3f95254adaada8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.985608 11761 tablet_service.cc:1468] Processing CreateTablet for tablet bb93358ba0104c5bad3e7eba35962030 (DEFAULT_TABLE table=default.Table_ca2784febf474360b12bb7a8329d312c [id=4533576362e340c4a57a8cb3082219c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.985864 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb93358ba0104c5bad3e7eba35962030. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.986521 11747 tablet_service.cc:1468] Processing CreateTablet for tablet cf2cac105f124ff281a3cd6cb71dd1f1 (DEFAULT_TABLE table=default.Table_6be64b6da6844a919eb59c752c3d6f1a [id=14b073a153404b3f9c06078a0be7dfaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.986819 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2cac105f124ff281a3cd6cb71dd1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.987511 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 43e338d945ab46959c9fbd974d8c9eae (DEFAULT_TABLE table=default.Table_499c2598c4404fada73927fa9f8b52cf [id=691656a595e94558b191607155de8473]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.987721 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e338d945ab46959c9fbd974d8c9eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.989816 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 40624157a77a4649b34a1d281f9fc8ca (DEFAULT_TABLE table=default.Table_5c0d1c43f3014a00b19cb9ab5403039b [id=c1fed85594ee4324a4e22fb50487dea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.990059 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40624157a77a4649b34a1d281f9fc8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.990429 11900 tablet_service.cc:1468] Processing CreateTablet for tablet cfadca64663b4219a52d6a0c1c2d1065 (DEFAULT_TABLE table=default.Table_e1cebf342db24cbfb93cba3cfb73036c [id=6842e2c1f14c4d4389caf0811688eda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.990703 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfadca64663b4219a52d6a0c1c2d1065. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.990742 12027 tablet_service.cc:1468] Processing CreateTablet for tablet cfadca64663b4219a52d6a0c1c2d1065 (DEFAULT_TABLE table=default.Table_e1cebf342db24cbfb93cba3cfb73036c [id=6842e2c1f14c4d4389caf0811688eda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.991014 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfadca64663b4219a52d6a0c1c2d1065. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.992475 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_32b14f38ef524c96a29e322dea10e327" } modify_external_catalogs: true
I20250625 14:02:03.992599 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_32b14f38ef524c96a29e322dea10e327" } modify_external_catalogs: true
I20250625 14:02:03.993407 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b28966c4ae41eb948ea34682716ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.994717 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 1a0f1ff588d741c59633ca693573a32f (DEFAULT_TABLE table=default.Table_a06b507986ee4e899c0e55971e0f26e0 [id=9dddd7175ba84a0789d67cabcc3f2665]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.994956 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0f1ff588d741c59633ca693573a32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.994920 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 1a0f1ff588d741c59633ca693573a32f (DEFAULT_TABLE table=default.Table_a06b507986ee4e899c0e55971e0f26e0 [id=9dddd7175ba84a0789d67cabcc3f2665]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.995141 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0f1ff588d741c59633ca693573a32f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:03.974565 11717 leader_election.cc:343] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.997608 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6318e27fb194a209c1c80ffcaf24a64" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:03.997735 12047 raft_consensus.cc:3058] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:03.997822 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b6318e27fb194a209c1c80ffcaf24a64" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:03.997874 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 32b6e047a46c47e683ed1d54312d2064 (DEFAULT_TABLE table=default.Table_9a1a2ddc789440a29fa5ef8c5b8df1a7 [id=ece5ae70819c4408b9b05c25c321a0e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.998250 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b6e047a46c47e683ed1d54312d2064. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.998471 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 32b6e047a46c47e683ed1d54312d2064 (DEFAULT_TABLE table=default.Table_9a1a2ddc789440a29fa5ef8c5b8df1a7 [id=ece5ae70819c4408b9b05c25c321a0e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:03.998699 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b6e047a46c47e683ed1d54312d2064. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:03.998826 12047 raft_consensus.cc:2466] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
W20250625 14:02:03.998857 11717 leader_election.cc:343] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:03.999742 11717 leader_election.cc:304] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:03.999924 13334 raft_consensus.cc:2802] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.000029 13334 raft_consensus.cc:695] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:04.000162 13334 consensus_queue.cc:237] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.001230 11761 tablet_service.cc:1468] Processing CreateTablet for tablet d80e577509b54b97b6c55eef90a44cce (DEFAULT_TABLE table=default.Table_9dc0f8c5c2384df382588ecd2cce8840 [id=8ffdfb72d3624bec8d7f5d3e3dfb3c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.001489 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 149cdeaf3d1749deab6d8356da77da68 (DEFAULT_TABLE table=default.Table_ca9436b968804954b6f7d64045962db5 [id=0542d890141149c7af5f00cd83e13e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.001715 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149cdeaf3d1749deab6d8356da77da68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.003872 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80e577509b54b97b6c55eef90a44cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.003994 12265 raft_consensus.cc:491] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.004078 12265 raft_consensus.cc:513] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.004446 12265 leader_election.cc:290] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:04.004894 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8578d07c9b4a44f887b5a30e92c1ede9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.005019 11780 raft_consensus.cc:2466] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:04.005136 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8578d07c9b4a44f887b5a30e92c1ede9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.005249 12047 raft_consensus.cc:2466] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:04.005291 11858 leader_election.cc:304] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:04.005451 12265 raft_consensus.cc:2802] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.005498 12265 raft_consensus.cc:491] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.005534 12265 raft_consensus.cc:3058] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.006422 12265 raft_consensus.cc:513] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.007050 12265 leader_election.cc:290] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:04.007072 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8578d07c9b4a44f887b5a30e92c1ede9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:04.007190 12047 raft_consensus.cc:3058] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.007475 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8578d07c9b4a44f887b5a30e92c1ede9" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:04.007568 11780 raft_consensus.cc:3058] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.007750 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 149cdeaf3d1749deab6d8356da77da68 (DEFAULT_TABLE table=default.Table_ca9436b968804954b6f7d64045962db5 [id=0542d890141149c7af5f00cd83e13e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.007961 11890 tablet_service.cc:1468] Processing CreateTablet for tablet bd46e1586f7b40d195797b1db8889171 (DEFAULT_TABLE table=default.Table_33b3ef9b15a44a80bafb79f5fcda8e16 [id=7f9f541ce06f4512be285c6199027fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.008033 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 149cdeaf3d1749deab6d8356da77da68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.008174 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd46e1586f7b40d195797b1db8889171. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.008248 12047 raft_consensus.cc:2466] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:04.008505 11780 raft_consensus.cc:2466] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:04.008778 11855 leader_election.cc:304] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:04.009018 12265 raft_consensus.cc:2802] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.009140 12265 raft_consensus.cc:695] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:04.009330 12265 consensus_queue.cc:237] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.010833 12028 tablet_service.cc:1468] Processing CreateTablet for tablet bd46e1586f7b40d195797b1db8889171 (DEFAULT_TABLE table=default.Table_33b3ef9b15a44a80bafb79f5fcda8e16 [id=7f9f541ce06f4512be285c6199027fa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.011076 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd46e1586f7b40d195797b1db8889171. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.015703 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 34638360c97a471fafd57f23421030a4 (DEFAULT_TABLE table=default.Table_7b0f1224e6da425baf571299c5d487d1 [id=c29814a419cb4691bed92403e7f6b84b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.015790 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 34638360c97a471fafd57f23421030a4 (DEFAULT_TABLE table=default.Table_7b0f1224e6da425baf571299c5d487d1 [id=c29814a419cb4691bed92403e7f6b84b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.015918 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 96ed000d46ca470a8953e1df18767bd8 (DEFAULT_TABLE table=default.Table_3aff8c0599c741d28f55f371ae6082d1 [id=18031af3b0d74cc3881d81fb9008ebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.016057 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34638360c97a471fafd57f23421030a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.016103 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34638360c97a471fafd57f23421030a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.016314 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ed000d46ca470a8953e1df18767bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.016765 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 2362b545ecd04efd802e37cecc970831 (DEFAULT_TABLE table=default.Table_a993f17e7b92482bae11fbf6fb6ed707 [id=4c3e5ed1d80549d0b4231a3c7a9ba315]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.017002 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2362b545ecd04efd802e37cecc970831. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.017042 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet dff6358de0e4446e8dfc9465180ba395 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.017544 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 96ed000d46ca470a8953e1df18767bd8 (DEFAULT_TABLE table=default.Table_3aff8c0599c741d28f55f371ae6082d1 [id=18031af3b0d74cc3881d81fb9008ebd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.017753 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ed000d46ca470a8953e1df18767bd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.017732 11894 tablet_service.cc:1468] Processing CreateTablet for tablet cf2cac105f124ff281a3cd6cb71dd1f1 (DEFAULT_TABLE table=default.Table_6be64b6da6844a919eb59c752c3d6f1a [id=14b073a153404b3f9c06078a0be7dfaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.017972 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2cac105f124ff281a3cd6cb71dd1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.018484 12175 tablet_replica.cc:331] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:04.018628 12175 raft_consensus.cc:2241] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.018744 12175 raft_consensus.cc:2270] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.019268 12175 ts_tablet_manager.cc:1905] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.020335 12037 tablet_service.cc:1468] Processing CreateTablet for tablet cf2cac105f124ff281a3cd6cb71dd1f1 (DEFAULT_TABLE table=default.Table_6be64b6da6844a919eb59c752c3d6f1a [id=14b073a153404b3f9c06078a0be7dfaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.020335 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 2362b545ecd04efd802e37cecc970831 (DEFAULT_TABLE table=default.Table_a993f17e7b92482bae11fbf6fb6ed707 [id=4c3e5ed1d80549d0b4231a3c7a9ba315]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.020561 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2cac105f124ff281a3cd6cb71dd1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.020561 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2362b545ecd04efd802e37cecc970831. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.021495 12175 ts_tablet_manager.cc:1918] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.021556 12175 log.cc:1199] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/dff6358de0e4446e8dfc9465180ba395
I20250625 14:02:04.021749 12175 ts_tablet_manager.cc:1939] T dff6358de0e4446e8dfc9465180ba395 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:04.023694 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 40624157a77a4649b34a1d281f9fc8ca (DEFAULT_TABLE table=default.Table_5c0d1c43f3014a00b19cb9ab5403039b [id=c1fed85594ee4324a4e22fb50487dea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.024065 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40624157a77a4649b34a1d281f9fc8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.026083 11749 tablet_service.cc:1468] Processing CreateTablet for tablet a258fc32255a46e8bdcb18f68a3134e4 (DEFAULT_TABLE table=default.Table_58de87c7a0fe4c939540c86674a6d9b7 [id=2932e9bac8c44b41a1697d5812fb47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.026674 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 43e338d945ab46959c9fbd974d8c9eae (DEFAULT_TABLE table=default.Table_499c2598c4404fada73927fa9f8b52cf [id=691656a595e94558b191607155de8473]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.026973 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a258fc32255a46e8bdcb18f68a3134e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.027017 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e338d945ab46959c9fbd974d8c9eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.028034 11894 tablet_service.cc:1468] Processing CreateTablet for tablet a5b4e3ea49ad4935b3f95254adaada8d (DEFAULT_TABLE table=default.Table_817ebd8b0122471f833e049491b8d994 [id=4ee3bb3f73be4e66b473e914496cd36f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.028262 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b4e3ea49ad4935b3f95254adaada8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.029166 12032 tablet_service.cc:1468] Processing CreateTablet for tablet bb93358ba0104c5bad3e7eba35962030 (DEFAULT_TABLE table=default.Table_ca2784febf474360b12bb7a8329d312c [id=4533576362e340c4a57a8cb3082219c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.029273 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 38ed475ff22e49d6b6962c7c0cd621de (DEFAULT_TABLE table=default.Table_c359a7a3792d45e49f813d0a82ff0c48 [id=924bc897165a4a84990c6206b5136755]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.029412 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb93358ba0104c5bad3e7eba35962030. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.029470 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ed475ff22e49d6b6962c7c0cd621de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.029677 12037 tablet_service.cc:1468] Processing CreateTablet for tablet a5b4e3ea49ad4935b3f95254adaada8d (DEFAULT_TABLE table=default.Table_817ebd8b0122471f833e049491b8d994 [id=4ee3bb3f73be4e66b473e914496cd36f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.029978 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b4e3ea49ad4935b3f95254adaada8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.030117 11898 tablet_service.cc:1468] Processing CreateTablet for tablet bb93358ba0104c5bad3e7eba35962030 (DEFAULT_TABLE table=default.Table_ca2784febf474360b12bb7a8329d312c [id=4533576362e340c4a57a8cb3082219c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.030391 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb93358ba0104c5bad3e7eba35962030. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.031455 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 38ed475ff22e49d6b6962c7c0cd621de (DEFAULT_TABLE table=default.Table_c359a7a3792d45e49f813d0a82ff0c48 [id=924bc897165a4a84990c6206b5136755]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.031672 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ed475ff22e49d6b6962c7c0cd621de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.031635 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 3a81cafac2f041a9942bf8b074473d04 (DEFAULT_TABLE table=default.Table_5c451f1ba2f246549b649bf689a73ec1 [id=b0b734e1e1d04d9c8f633d5ecfbdc13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.031855 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a81cafac2f041a9942bf8b074473d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.031863 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 3a81cafac2f041a9942bf8b074473d04 (DEFAULT_TABLE table=default.Table_5c451f1ba2f246549b649bf689a73ec1 [id=b0b734e1e1d04d9c8f633d5ecfbdc13b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.032068 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a81cafac2f041a9942bf8b074473d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.033180 11899 tablet_service.cc:1468] Processing CreateTablet for tablet f5b28966c4ae41eb948ea34682716ddb (DEFAULT_TABLE table=default.Table_839a1d001b0c40179c755c38f253efcd [id=fa92e7adcec946dbb9792fdfa79ab4a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.033385 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b28966c4ae41eb948ea34682716ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.033902 12033 tablet_service.cc:1468] Processing CreateTablet for tablet f5b28966c4ae41eb948ea34682716ddb (DEFAULT_TABLE table=default.Table_839a1d001b0c40179c755c38f253efcd [id=fa92e7adcec946dbb9792fdfa79ab4a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.034116 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b28966c4ae41eb948ea34682716ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.034960 11529 catalog_manager.cc:5582] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:04.035187 11529 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 8578d07c9b4a44f887b5a30e92c1ede9 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]). Expected version 1 got 0
I20250625 14:02:04.035861 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4b8ec3648e404bb1912ff6fb5556c97a" } modify_external_catalogs: true
I20250625 14:02:04.035964 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4b8ec3648e404bb1912ff6fb5556c97a" } modify_external_catalogs: true
I20250625 14:02:04.036471 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 40624157a77a4649b34a1d281f9fc8ca (DEFAULT_TABLE table=default.Table_5c0d1c43f3014a00b19cb9ab5403039b [id=c1fed85594ee4324a4e22fb50487dea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.036677 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40624157a77a4649b34a1d281f9fc8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.038497 11761 tablet_service.cc:1468] Processing CreateTablet for tablet b9cb737bc8f34795ad5c20e02552bfe3 (DEFAULT_TABLE table=default.Table_a4c6779d45c34135941dc676f26908e7 [id=dc6580b444a6474f9b6896ece6d04d30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.039703 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cb737bc8f34795ad5c20e02552bfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.039441 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 1c88a1da38f54117ae2d77cb304b097a (DEFAULT_TABLE table=default.Table_4949c14896924b1db93ba6df52fddae1 [id=ee4f4439a4bb4e8b85bd2b9bb955d2d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.040308 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7ff70668bede407c816db9779ce5221d (table default.Table_dab2b89c092c432f989c600f2f724b87 [id=f35c972d51bd4a3b9ea74dd70cad5913]) successfully deleted
I20250625 14:02:04.040774 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet dff6358de0e4446e8dfc9465180ba395 (table default.Table_26cf2e4d1ba540b29a77b71d12a03688 [id=fd3941c6a70a48ac98571ef67bd9c5d7]) successfully deleted
I20250625 14:02:04.040987 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c88a1da38f54117ae2d77cb304b097a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.041368 11889 tablet_service.cc:1468] Processing CreateTablet for tablet 6729b7aa8fdf4bf481eccf39af87d8b9 (DEFAULT_TABLE table=default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.041603 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6729b7aa8fdf4bf481eccf39af87d8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.044588 11897 tablet_service.cc:1468] Processing CreateTablet for tablet d80e577509b54b97b6c55eef90a44cce (DEFAULT_TABLE table=default.Table_9dc0f8c5c2384df382588ecd2cce8840 [id=8ffdfb72d3624bec8d7f5d3e3dfb3c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.044842 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80e577509b54b97b6c55eef90a44cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.044968 11891 tablet_service.cc:1468] Processing CreateTablet for tablet a258fc32255a46e8bdcb18f68a3134e4 (DEFAULT_TABLE table=default.Table_58de87c7a0fe4c939540c86674a6d9b7 [id=2932e9bac8c44b41a1697d5812fb47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.045187 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a258fc32255a46e8bdcb18f68a3134e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.045146 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 43e338d945ab46959c9fbd974d8c9eae (DEFAULT_TABLE table=default.Table_499c2598c4404fada73927fa9f8b52cf [id=691656a595e94558b191607155de8473]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.045378 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e338d945ab46959c9fbd974d8c9eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.046484 12033 tablet_service.cc:1468] Processing CreateTablet for tablet d80e577509b54b97b6c55eef90a44cce (DEFAULT_TABLE table=default.Table_9dc0f8c5c2384df382588ecd2cce8840 [id=8ffdfb72d3624bec8d7f5d3e3dfb3c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.046721 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80e577509b54b97b6c55eef90a44cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.046918 11745 tablet_service.cc:1468] Processing CreateTablet for tablet e37f8492550946d19eca63e6e7faa336 (DEFAULT_TABLE table=default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.047233 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f8492550946d19eca63e6e7faa336. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.049052 12167 tablet_bootstrap.cc:492] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.049135 12167 ts_tablet_manager.cc:1397] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.000s
I20250625 14:02:04.049571 12167 raft_consensus.cc:357] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.049666 12167 raft_consensus.cc:383] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.049634 12037 tablet_service.cc:1468] Processing CreateTablet for tablet a258fc32255a46e8bdcb18f68a3134e4 (DEFAULT_TABLE table=default.Table_58de87c7a0fe4c939540c86674a6d9b7 [id=2932e9bac8c44b41a1697d5812fb47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.049695 12167 raft_consensus.cc:738] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.049852 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a258fc32255a46e8bdcb18f68a3134e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.049820 12167 consensus_queue.cc:260] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.050244 12167 ts_tablet_manager.cc:1428] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.050599 12167 tablet_bootstrap.cc:492] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.051533 12167 tablet_bootstrap.cc:654] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.054935 11900 tablet_service.cc:1468] Processing CreateTablet for tablet b9cb737bc8f34795ad5c20e02552bfe3 (DEFAULT_TABLE table=default.Table_a4c6779d45c34135941dc676f26908e7 [id=dc6580b444a6474f9b6896ece6d04d30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.058518 12033 tablet_service.cc:1468] Processing CreateTablet for tablet b9cb737bc8f34795ad5c20e02552bfe3 (DEFAULT_TABLE table=default.Table_a4c6779d45c34135941dc676f26908e7 [id=dc6580b444a6474f9b6896ece6d04d30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.058935 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cb737bc8f34795ad5c20e02552bfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.059464 12167 tablet_bootstrap.cc:492] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.059540 12167 ts_tablet_manager.cc:1397] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:02:04.060079 12167 raft_consensus.cc:357] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.060202 12167 raft_consensus.cc:383] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.060236 12167 raft_consensus.cc:738] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.060359 12167 consensus_queue.cc:260] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.061002 12167 ts_tablet_manager.cc:1428] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.062536 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cb737bc8f34795ad5c20e02552bfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.065279 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 6729b7aa8fdf4bf481eccf39af87d8b9 (DEFAULT_TABLE table=default.Table_2ff002b6b65e448d8abb729088ca4ac2 [id=c320ed6c6c10445ba67d603432af466d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.066877 12167 tablet_bootstrap.cc:492] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.069265 12167 tablet_bootstrap.cc:654] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.078445 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6729b7aa8fdf4bf481eccf39af87d8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.081079 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 1c88a1da38f54117ae2d77cb304b097a (DEFAULT_TABLE table=default.Table_4949c14896924b1db93ba6df52fddae1 [id=ee4f4439a4bb4e8b85bd2b9bb955d2d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.081540 12166 tablet_bootstrap.cc:492] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.081656 12166 ts_tablet_manager.cc:1397] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.127s user 0.002s sys 0.000s
I20250625 14:02:04.081669 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c88a1da38f54117ae2d77cb304b097a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.081884 11898 tablet_service.cc:1468] Processing CreateTablet for tablet e37f8492550946d19eca63e6e7faa336 (DEFAULT_TABLE table=default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.082132 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f8492550946d19eca63e6e7faa336. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.082237 12166 raft_consensus.cc:357] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.082383 12166 raft_consensus.cc:383] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.082428 12166 raft_consensus.cc:738] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.082587 12166 consensus_queue.cc:260] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.084086 12166 ts_tablet_manager.cc:1428] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:02:04.087527 12166 tablet_bootstrap.cc:492] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.088740 12166 tablet_bootstrap.cc:654] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.092574 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 1c88a1da38f54117ae2d77cb304b097a (DEFAULT_TABLE table=default.Table_4949c14896924b1db93ba6df52fddae1 [id=ee4f4439a4bb4e8b85bd2b9bb955d2d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.092893 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c88a1da38f54117ae2d77cb304b097a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.093712 12166 tablet_bootstrap.cc:492] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.093906 12166 ts_tablet_manager.cc:1397] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20250625 14:02:04.095593 12166 raft_consensus.cc:357] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.095831 12166 raft_consensus.cc:383] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.095913 12166 raft_consensus.cc:738] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.096189 12166 consensus_queue.cc:260] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.098384 13352 raft_consensus.cc:491] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.098433 12166 ts_tablet_manager.cc:1428] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:04.098516 13352 raft_consensus.cc:513] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.098623 12166 tablet_bootstrap.cc:492] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.098975 13352 leader_election.cc:290] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.099360 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cfcb08ddbdd43dd92472dcbdc772a2d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.099376 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cfcb08ddbdd43dd92472dcbdc772a2d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.099519 11780 raft_consensus.cc:2466] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:04.099749 11990 leader_election.cc:343] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.099864 11993 leader_election.cc:304] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.100329 12166 tablet_bootstrap.cc:654] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.101478 13352 raft_consensus.cc:2802] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.101505 12166 tablet_bootstrap.cc:492] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.101542 13352 raft_consensus.cc:491] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.101580 13352 raft_consensus.cc:3058] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.101579 12166 ts_tablet_manager.cc:1397] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:04.102142 12166 raft_consensus.cc:357] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.102241 12166 raft_consensus.cc:383] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.102272 12166 raft_consensus.cc:738] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.102427 12166 consensus_queue.cc:260] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.102660 13352 raft_consensus.cc:513] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.102852 12166 ts_tablet_manager.cc:1428] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:04.103058 12166 tablet_bootstrap.cc:492] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.103055 13352 leader_election.cc:290] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.103423 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cfcb08ddbdd43dd92472dcbdc772a2d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:04.103856 11990 leader_election.cc:343] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.104110 12166 tablet_bootstrap.cc:654] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.104120 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1cfcb08ddbdd43dd92472dcbdc772a2d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:04.104254 11780 raft_consensus.cc:3058] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.105166 11780 raft_consensus.cc:2466] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:04.105497 11993 leader_election.cc:304] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.105732 13352 raft_consensus.cc:2802] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.105823 13352 raft_consensus.cc:695] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:04.105986 13352 consensus_queue.cc:237] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.115377 12037 tablet_service.cc:1468] Processing CreateTablet for tablet e37f8492550946d19eca63e6e7faa336 (DEFAULT_TABLE table=default.Table_5e16a14357604387a772903ca4fa36de [id=7a03467928f647719aed9c0b99c21714]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.115753 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f8492550946d19eca63e6e7faa336. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.117532 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet daa6fd92afb34a70a671b8801173b5f4
I20250625 14:02:04.118077 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b25bc5f5f50c447982a32d8b89898f9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.118570 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b25bc5f5f50c447982a32d8b89898f9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.119174 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e0a12379205a43b5be2ab7462a0db148" } new_table_name: "default.Table_1687998ceff247818ad75e1a5fbee5ea" modify_external_catalogs: true
I20250625 14:02:04.119474 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 66e71a05333f425aa3c82a817269eb48
I20250625 14:02:04.119702 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 66e71a05333f425aa3c82a817269eb48 deleted and replaced by tablet 929ed01b654b4aabb97c5db690a5f1f3
I20250625 14:02:04.119899 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_70ef26dd935f494d9b67e97499efd65c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.120214 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bf421457ab6c481f9fd6e18a9572ba5f
W20250625 14:02:04.120242 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70ef26dd935f494d9b67e97499efd65c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.120505 11530 catalog_manager.cc:6652] ReplaceTablet: tablet bf421457ab6c481f9fd6e18a9572ba5f deleted and replaced by tablet 1c7f541371be494ba77156c251c148b7
I20250625 14:02:04.120638 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 60414f22c3bd4938b11c678197e0b34c from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:04.120893 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b7f27723e424ae9900b11ef0781533b consensus state has no leader
I20250625 14:02:04.120918 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9d8501126146425baa26ba7741963085
I20250625 14:02:04.121095 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c82fd0cae3c6425fab9bc4911fd81d51" } new_table_name: "default.Table_b2d1d399cc944c21a45a0bd336fbf536" modify_external_catalogs: true
I20250625 14:02:04.121275 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_437396c20b3840f5baa9da089b395a38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.121613 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_437396c20b3840f5baa9da089b395a38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.122108 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet a0f052a379904917abdd5a5e488e6812 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.122287 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet daa6fd92afb34a70a671b8801173b5f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.122509 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 with delete_type TABLET_DATA_DELETED (replaced by tablet 73a40d0ee5034aaea24684739c3f5154) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.122624 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 66e71a05333f425aa3c82a817269eb48 with delete_type TABLET_DATA_DELETED (replaced by tablet 929ed01b654b4aabb97c5db690a5f1f3) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.122700 12177 tablet_replica.cc:331] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.122728 11754 tablet_service.cc:1515] Processing DeleteTablet for tablet bf421457ab6c481f9fd6e18a9572ba5f with delete_type TABLET_DATA_DELETED (replaced by tablet 1c7f541371be494ba77156c251c148b7) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.122823 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8501126146425baa26ba7741963085 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.122859 12177 raft_consensus.cc:2241] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.122882 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a946bcadbab746a69df1a7b35682331e
I20250625 14:02:04.123030 12177 pending_rounds.cc:70] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:04.123064 12177 pending_rounds.cc:77] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523067906236416 op_type: NO_OP noop_request { }
W20250625 14:02:04.123070 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet daa6fd92afb34a70a671b8801173b5f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daa6fd92afb34a70a671b8801173b5f4 already in progress: creating tablet
I20250625 14:02:04.123122 12177 raft_consensus.cc:2887] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:04.123175 12177 raft_consensus.cc:2270] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.123261 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9fea52e2385c43a9859657e70497d530"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.123445 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet a946bcadbab746a69df1a7b35682331e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:04.123581 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fea52e2385c43a9859657e70497d530 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.124471 12265 raft_consensus.cc:491] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.124583 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 382a495348be45fc872f1602ee0c6165
I20250625 14:02:04.124572 12265 raft_consensus.cc:513] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.125015 12265 leader_election.cc:290] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:04.125062 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4befcf9542e44983bb76073252702495"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.125407 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4befcf9542e44983bb76073252702495 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.125712 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b08135db764c4eb286d5f67ccba94ed5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.125790 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 382a495348be45fc872f1602ee0c6165 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.127532 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b08135db764c4eb286d5f67ccba94ed5" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.127712 12047 raft_consensus.cc:2391] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:04.118562 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5743a02af69a4e8190790ca031655075" } modify_external_catalogs: true
I20250625 14:02:04.127952 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5743a02af69a4e8190790ca031655075" } modify_external_catalogs: true
I20250625 14:02:04.128835 11855 leader_election.cc:304] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:04.129005 12265 raft_consensus.cc:3058] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.129408 12177 ts_tablet_manager.cc:1905] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.130118 12265 raft_consensus.cc:2747] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.131933 12177 ts_tablet_manager.cc:1918] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:04.132015 12177 log.cc:1199] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b6318e27fb194a209c1c80ffcaf24a64
I20250625 14:02:04.132256 12177 ts_tablet_manager.cc:1939] T b6318e27fb194a209c1c80ffcaf24a64 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.133096 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b6318e27fb194a209c1c80ffcaf24a64 (table default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]) successfully deleted
W20250625 14:02:04.133643 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 66e71a05333f425aa3c82a817269eb48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66e71a05333f425aa3c82a817269eb48 already in progress: creating tablet
W20250625 14:02:04.134052 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet bf421457ab6c481f9fd6e18a9572ba5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf421457ab6c481f9fd6e18a9572ba5f already in progress: creating tablet
W20250625 14:02:04.134166 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9d8501126146425baa26ba7741963085 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8501126146425baa26ba7741963085 already in progress: creating tablet
W20250625 14:02:04.134285 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a946bcadbab746a69df1a7b35682331e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a946bcadbab746a69df1a7b35682331e already in progress: creating tablet
W20250625 14:02:04.134402 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 382a495348be45fc872f1602ee0c6165 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 382a495348be45fc872f1602ee0c6165 already in progress: creating tablet
I20250625 14:02:04.135535 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet daa6fd92afb34a70a671b8801173b5f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.136454 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet bf421457ab6c481f9fd6e18a9572ba5f with delete_type TABLET_DATA_DELETED (replaced by tablet 1c7f541371be494ba77156c251c148b7) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.137054 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 382a495348be45fc872f1602ee0c6165 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.137598 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 66e71a05333f425aa3c82a817269eb48 with delete_type TABLET_DATA_DELETED (replaced by tablet 929ed01b654b4aabb97c5db690a5f1f3) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.137740 11889 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8501126146425baa26ba7741963085 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.137842 11901 tablet_service.cc:1515] Processing DeleteTablet for tablet a946bcadbab746a69df1a7b35682331e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:04.138079 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet bf421457ab6c481f9fd6e18a9572ba5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf421457ab6c481f9fd6e18a9572ba5f already in progress: creating tablet
W20250625 14:02:04.138218 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 382a495348be45fc872f1602ee0c6165 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 382a495348be45fc872f1602ee0c6165 already in progress: creating tablet
I20250625 14:02:04.139616 13334 raft_consensus.cc:491] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.139703 13334 raft_consensus.cc:513] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.140108 13334 leader_election.cc:290] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.140252 11780 raft_consensus.cc:1273] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:04.140503 12047 raft_consensus.cc:1273] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer bfff52620fea460d850827814b790c35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:04.141089 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dff6358de0e4446e8dfc9465180ba395" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.141229 12047 raft_consensus.cc:2466] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:04.142055 13352 raft_consensus.cc:491] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.142144 13352 raft_consensus.cc:513] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.142169 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet 66e71a05333f425aa3c82a817269eb48 with delete_type TABLET_DATA_DELETED (replaced by tablet 929ed01b654b4aabb97c5db690a5f1f3) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.142347 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet bf421457ab6c481f9fd6e18a9572ba5f with delete_type TABLET_DATA_DELETED (replaced by tablet 1c7f541371be494ba77156c251c148b7) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.142390 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 9d8501126146425baa26ba7741963085 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.142459 12037 tablet_service.cc:1515] Processing DeleteTablet for tablet a946bcadbab746a69df1a7b35682331e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.142575 11717 leader_election.cc:304] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.142623 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 382a495348be45fc872f1602ee0c6165 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.142711 13352 leader_election.cc:290] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:04.142753 11717 leader_election.cc:343] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: dff6358de0e4446e8dfc9465180ba395
I20250625 14:02:04.142969 13334 raft_consensus.cc:2802] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.143028 13334 raft_consensus.cc:491] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.143061 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4317c3460f664f32aeb9b25ffb57d5bd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.143067 13334 raft_consensus.cc:3058] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.143254 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4317c3460f664f32aeb9b25ffb57d5bd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.143388 11915 raft_consensus.cc:2466] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:04.143429 11993 leader_election.cc:343] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.143777 11990 leader_election.cc:304] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5
I20250625 14:02:04.143947 13352 raft_consensus.cc:2802] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.144006 13352 raft_consensus.cc:491] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.144058 13352 raft_consensus.cc:3058] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.144420 13334 raft_consensus.cc:513] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.144760 13334 leader_election.cc:290] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.144901 12265 consensus_queue.cc:1035] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.145092 13352 raft_consensus.cc:513] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.145221 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dff6358de0e4446e8dfc9465180ba395" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
W20250625 14:02:04.145287 11717 leader_election.cc:343] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: dff6358de0e4446e8dfc9465180ba395
I20250625 14:02:04.145273 12265 consensus_queue.cc:1035] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.145325 12047 raft_consensus.cc:3058] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.145442 13352 leader_election.cc:290] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.146332 12047 raft_consensus.cc:2466] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:04.146538 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4317c3460f664f32aeb9b25ffb57d5bd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:04.146790 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4317c3460f664f32aeb9b25ffb57d5bd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.146898 11915 raft_consensus.cc:3058] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:04.146889 11993 leader_election.cc:343] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.147894 11915 raft_consensus.cc:2466] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:04.148280 11990 leader_election.cc:304] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5
I20250625 14:02:04.149814 11717 leader_election.cc:304] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.149875 13352 raft_consensus.cc:2802] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.150228 13352 raft_consensus.cc:695] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:04.150478 13352 consensus_queue.cc:237] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.151060 13334 raft_consensus.cc:2802] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.151211 13334 raft_consensus.cc:695] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:04.151381 13334 consensus_queue.cc:237] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.155928 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet daa6fd92afb34a70a671b8801173b5f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:03 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.156317 12167 tablet_bootstrap.cc:492] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.156423 12167 ts_tablet_manager.cc:1397] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.001s
I20250625 14:02:04.156935 12167 raft_consensus.cc:357] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.157059 12167 raft_consensus.cc:383] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.157090 12167 raft_consensus.cc:738] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
W20250625 14:02:04.145990 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 66e71a05333f425aa3c82a817269eb48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66e71a05333f425aa3c82a817269eb48 already in progress: creating tablet
I20250625 14:02:04.157196 12167 consensus_queue.cc:260] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.157472 12167 ts_tablet_manager.cc:1428] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:04.158290 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet daa6fd92afb34a70a671b8801173b5f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daa6fd92afb34a70a671b8801173b5f4 already in progress: creating tablet
I20250625 14:02:04.160702 12167 tablet_bootstrap.cc:492] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.161129 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet d7d225545467475d9d656f5354585aa0 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:04.161234 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 66e71a05333f425aa3c82a817269eb48 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66e71a05333f425aa3c82a817269eb48 already in progress: creating tablet
W20250625 14:02:04.161370 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet bf421457ab6c481f9fd6e18a9572ba5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf421457ab6c481f9fd6e18a9572ba5f already in progress: creating tablet
W20250625 14:02:04.161463 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9d8501126146425baa26ba7741963085 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8501126146425baa26ba7741963085 already in progress: creating tablet
W20250625 14:02:04.161546 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a946bcadbab746a69df1a7b35682331e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a946bcadbab746a69df1a7b35682331e already in progress: creating tablet
W20250625 14:02:04.161646 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 382a495348be45fc872f1602ee0c6165 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 382a495348be45fc872f1602ee0c6165 already in progress: creating tablet
I20250625 14:02:04.161888 12167 tablet_bootstrap.cc:654] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:04.159138 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd256d017f8448dcae20baacebbdcf09 consensus state has no leader
I20250625 14:02:04.160043 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a0f052a379904917abdd5a5e488e6812
I20250625 14:02:04.163722 11529 catalog_manager.cc:6652] ReplaceTablet: tablet a0f052a379904917abdd5a5e488e6812 deleted and replaced by tablet 8f515ef1e644499da3f2b197bcc8aba5
I20250625 14:02:04.163898 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_813f6ae0f07545babbab5dc4769bc1d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.164304 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_813f6ae0f07545babbab5dc4769bc1d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.160351 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8a0bff77cd224946a1389d74120cba18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.164691 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a0bff77cd224946a1389d74120cba18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:04.160432 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f3ae39bd26d439bac3df5ad144b9ee7 consensus state has no leader
I20250625 14:02:04.160749 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fbb28c12dc3e450187de7576fc8fba72" } new_table_name: "default.Table_5171599cd58f4906897a3e7da2c30d6e" modify_external_catalogs: true
I20250625 14:02:04.165343 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet a0f052a379904917abdd5a5e488e6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f515ef1e644499da3f2b197bcc8aba5) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:04.166152 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a0f052a379904917abdd5a5e488e6812 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0f052a379904917abdd5a5e488e6812 already in progress: creating tablet
I20250625 14:02:04.166277 12172 tablet_bootstrap.cc:492] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.166399 12172 ts_tablet_manager.cc:1397] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.221s user 0.001s sys 0.002s
I20250625 14:02:04.166872 12172 raft_consensus.cc:357] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.166991 12172 raft_consensus.cc:383] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.167026 12172 raft_consensus.cc:738] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.167037 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8beee31d79394da795ce06738a98e812"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.167166 12172 consensus_queue.cc:260] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:04.167389 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8beee31d79394da795ce06738a98e812 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.167449 12172 ts_tablet_manager.cc:1428] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.167654 12172 tablet_bootstrap.cc:492] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.168664 12172 tablet_bootstrap.cc:654] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.173710 12167 tablet_bootstrap.cc:492] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.173831 12167 ts_tablet_manager.cc:1397] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:04.174377 12167 raft_consensus.cc:357] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.174499 12167 raft_consensus.cc:383] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.174537 12167 raft_consensus.cc:738] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.174657 12167 consensus_queue.cc:260] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.174983 12167 ts_tablet_manager.cc:1428] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.175230 12167 tablet_bootstrap.cc:492] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.175246 13532 tablet.cc:1722] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:04.176299 12167 tablet_bootstrap.cc:654] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.178632 12104 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:04.179260 13535 tablet.cc:1722] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:02:04.188609 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9d8501126146425baa26ba7741963085 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d8501126146425baa26ba7741963085 already in progress: creating tablet
W20250625 14:02:04.188855 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a946bcadbab746a69df1a7b35682331e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a946bcadbab746a69df1a7b35682331e already in progress: creating tablet
W20250625 14:02:04.188998 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet daa6fd92afb34a70a671b8801173b5f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daa6fd92afb34a70a671b8801173b5f4 already in progress: creating tablet
I20250625 14:02:04.191308 13531 tablet.cc:1722] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:04.194505 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet a0f052a379904917abdd5a5e488e6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f515ef1e644499da3f2b197bcc8aba5) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.195032 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet a0f052a379904917abdd5a5e488e6812 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f515ef1e644499da3f2b197bcc8aba5) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:04.195215 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a0f052a379904917abdd5a5e488e6812 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0f052a379904917abdd5a5e488e6812 already in progress: creating tablet
W20250625 14:02:04.202630 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a0f052a379904917abdd5a5e488e6812 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0f052a379904917abdd5a5e488e6812 already in progress: creating tablet
I20250625 14:02:04.203105 12172 tablet_bootstrap.cc:492] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.203217 12172 ts_tablet_manager.cc:1397] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:02:04.203699 12172 raft_consensus.cc:357] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.203805 12172 raft_consensus.cc:383] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.203831 12172 raft_consensus.cc:738] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.203943 12172 consensus_queue.cc:260] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.204216 12172 ts_tablet_manager.cc:1428] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.204713 12167 tablet_bootstrap.cc:492] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.204794 12167 ts_tablet_manager.cc:1397] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250625 14:02:04.205541 12167 raft_consensus.cc:357] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.205662 12167 raft_consensus.cc:383] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.205693 12167 raft_consensus.cc:738] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.205822 12167 consensus_queue.cc:260] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.206147 12167 ts_tablet_manager.cc:1428] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:04.206385 12167 tablet_bootstrap.cc:492] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.206277 12166 tablet_bootstrap.cc:492] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.206493 12166 ts_tablet_manager.cc:1397] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.000s
I20250625 14:02:04.207018 12166 raft_consensus.cc:357] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.207124 12166 raft_consensus.cc:383] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.207154 12166 raft_consensus.cc:738] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.207273 12166 consensus_queue.cc:260] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.207475 12167 tablet_bootstrap.cc:654] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.207579 12166 ts_tablet_manager.cc:1428] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.207787 12166 tablet_bootstrap.cc:492] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.208855 12166 tablet_bootstrap.cc:654] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.210062 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d7d225545467475d9d656f5354585aa0
I20250625 14:02:04.210397 11533 catalog_manager.cc:6652] ReplaceTablet: tablet d7d225545467475d9d656f5354585aa0 deleted and replaced by tablet 5947ad4bff51429f8071075c8cdd8f34
I20250625 14:02:04.210614 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6d0b9ebb9ed4411394d69c7220244814" } new_table_name: "default.Table_9b41aea39b8742708a9383406513993b" modify_external_catalogs: true
I20250625 14:02:04.211982 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet d7d225545467475d9d656f5354585aa0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5947ad4bff51429f8071075c8cdd8f34) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:04.212882 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d7d225545467475d9d656f5354585aa0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7d225545467475d9d656f5354585aa0 already in progress: creating tablet
I20250625 14:02:04.214813 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet d7d225545467475d9d656f5354585aa0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5947ad4bff51429f8071075c8cdd8f34) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.215890 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet d7d225545467475d9d656f5354585aa0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5947ad4bff51429f8071075c8cdd8f34) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:04.217490 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d7d225545467475d9d656f5354585aa0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7d225545467475d9d656f5354585aa0 already in progress: creating tablet
I20250625 14:02:04.223819 12172 tablet_bootstrap.cc:492] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:04.224486 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60414f22c3bd4938b11c678197e0b34c consensus state has no leader
I20250625 14:02:04.224958 12172 tablet_bootstrap.cc:654] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.226984 12172 tablet_bootstrap.cc:492] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.227247 12172 ts_tablet_manager.cc:1397] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20250625 14:02:04.227779 12172 raft_consensus.cc:357] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.227975 12172 raft_consensus.cc:383] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.228051 12172 raft_consensus.cc:738] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.228260 12172 consensus_queue.cc:260] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.230386 12172 ts_tablet_manager.cc:1428] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:04.230754 12172 tablet_bootstrap.cc:492] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.230890 11831 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:04.232226 12172 tablet_bootstrap.cc:654] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.232265 11532 catalog_manager.cc:5582] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:04.232498 11532 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet b08135db764c4eb286d5f67ccba94ed5 (table default.Table_c769119bc7a3472d91c5e524724929e9 [id=44f2f74bfee54c72b3dee93db46b35e5]). Expected version 3 got 0
I20250625 14:02:04.233705 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 6ef2230a4b7e4234b4e5e9d034ae52aa (DEFAULT_TABLE table=default.Table_a1f522ca2d6a413788c593d412818d44 [id=f11727195c3f41ef974b1c6f9e1266ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.233984 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 289eaa893df4471dbdcd99fbb7b730c3 (DEFAULT_TABLE table=default.Table_8c1122208d994348afca916054248c4c [id=0d41ef14a6ea4b1e9f2a0b8085a641c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.234191 11745 tablet_service.cc:1468] Processing CreateTablet for tablet 1ef31074caf14b8da07254245e5d1b2b (DEFAULT_TABLE table=default.Table_2882122b54e4457a9612d282e97ba23f [id=2c05a2c2541c494e82adc33e73d6e6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.234448 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 88d4ccb6c5da4eddb90f590f70d5d2ba (DEFAULT_TABLE table=default.Table_e77c45db17e9427d944508b684cc31ee [id=8f567d4545aa4d2c9db51c1cd9d54783]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.234570 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 25dd555e539f4278b9a04c4959a740f3 (DEFAULT_TABLE table=default.Table_61cd97c7a2044d468ce5381949b33cb4 [id=d57724126b3f4e9288062311617ccafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.234449 11747 tablet_service.cc:1468] Processing CreateTablet for tablet 94ea749705da4d639d8f73da70426a99 (DEFAULT_TABLE table=default.Table_b32ae37200da4a7ca5cdbc4d7c6ce26a [id=dc7ff3de16844e2fa740cdc198114806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.234673 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 157d615d6e3a4cf1a45850eeb2d297f6 (DEFAULT_TABLE table=default.Table_5743a02af69a4e8190790ca031655075 [id=8d584ab57a444963b96343f45fca299a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.234901 11748 tablet_service.cc:1468] Processing CreateTablet for tablet e85f6b7b1f6a4966ad3c102dd8addea7 (DEFAULT_TABLE table=default.Table_f46ef5ce088042ee89cb48170a0011f0 [id=d860afeec6494817a9605d42152ac452]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.235457 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef2230a4b7e4234b4e5e9d034ae52aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.238363 12167 tablet_bootstrap.cc:492] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.238473 12167 ts_tablet_manager.cc:1397] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:02:04.238961 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289eaa893df4471dbdcd99fbb7b730c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.239059 12167 raft_consensus.cc:357] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.239157 12167 raft_consensus.cc:383] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.239187 12167 raft_consensus.cc:738] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.239338 12167 consensus_queue.cc:260] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.239621 12167 ts_tablet_manager.cc:1428] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.239873 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a3bf731b414c40fea1cafe7176c74b02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.240231 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 6ef2230a4b7e4234b4e5e9d034ae52aa (DEFAULT_TABLE table=default.Table_a1f522ca2d6a413788c593d412818d44 [id=f11727195c3f41ef974b1c6f9e1266ce]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:04.240312 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3bf731b414c40fea1cafe7176c74b02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.240516 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef2230a4b7e4234b4e5e9d034ae52aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.241025 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 157d615d6e3a4cf1a45850eeb2d297f6 (DEFAULT_TABLE table=default.Table_5743a02af69a4e8190790ca031655075 [id=8d584ab57a444963b96343f45fca299a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.241282 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a6560277272a410bb47de244e2adc6c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.241322 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 6ef2230a4b7e4234b4e5e9d034ae52aa (DEFAULT_TABLE table=default.Table_a1f522ca2d6a413788c593d412818d44 [id=f11727195c3f41ef974b1c6f9e1266ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.241530 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 1ef31074caf14b8da07254245e5d1b2b (DEFAULT_TABLE table=default.Table_2882122b54e4457a9612d282e97ba23f [id=2c05a2c2541c494e82adc33e73d6e6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.241559 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 289eaa893df4471dbdcd99fbb7b730c3 (DEFAULT_TABLE table=default.Table_8c1122208d994348afca916054248c4c [id=0d41ef14a6ea4b1e9f2a0b8085a641c8]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:04.241628 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6560277272a410bb47de244e2adc6c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.241765 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef31074caf14b8da07254245e5d1b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.241796 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 88d4ccb6c5da4eddb90f590f70d5d2ba (DEFAULT_TABLE table=default.Table_e77c45db17e9427d944508b684cc31ee [id=8f567d4545aa4d2c9db51c1cd9d54783]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.242049 12019 tablet_service.cc:1468] Processing CreateTablet for tablet e85f6b7b1f6a4966ad3c102dd8addea7 (DEFAULT_TABLE table=default.Table_f46ef5ce088042ee89cb48170a0011f0 [id=d860afeec6494817a9605d42152ac452]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.242295 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef31074caf14b8da07254245e5d1b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.242506 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 289eaa893df4471dbdcd99fbb7b730c3 (DEFAULT_TABLE table=default.Table_8c1122208d994348afca916054248c4c [id=0d41ef14a6ea4b1e9f2a0b8085a641c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.242743 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289eaa893df4471dbdcd99fbb7b730c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.244055 11889 tablet_service.cc:1468] Processing CreateTablet for tablet 88d4ccb6c5da4eddb90f590f70d5d2ba (DEFAULT_TABLE table=default.Table_e77c45db17e9427d944508b684cc31ee [id=8f567d4545aa4d2c9db51c1cd9d54783]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.244285 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d4ccb6c5da4eddb90f590f70d5d2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.244607 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 25dd555e539f4278b9a04c4959a740f3 (DEFAULT_TABLE table=default.Table_61cd97c7a2044d468ce5381949b33cb4 [id=d57724126b3f4e9288062311617ccafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.244859 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 25dd555e539f4278b9a04c4959a740f3 (DEFAULT_TABLE table=default.Table_61cd97c7a2044d468ce5381949b33cb4 [id=d57724126b3f4e9288062311617ccafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.244972 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 1ef31074caf14b8da07254245e5d1b2b (DEFAULT_TABLE table=default.Table_2882122b54e4457a9612d282e97ba23f [id=2c05a2c2541c494e82adc33e73d6e6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.245064 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25dd555e539f4278b9a04c4959a740f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.245236 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 94ea749705da4d639d8f73da70426a99 (DEFAULT_TABLE table=default.Table_b32ae37200da4a7ca5cdbc4d7c6ce26a [id=dc7ff3de16844e2fa740cdc198114806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.246227 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 157d615d6e3a4cf1a45850eeb2d297f6 (DEFAULT_TABLE table=default.Table_5743a02af69a4e8190790ca031655075 [id=8d584ab57a444963b96343f45fca299a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.246456 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157d615d6e3a4cf1a45850eeb2d297f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.247135 11894 tablet_service.cc:1468] Processing CreateTablet for tablet b0139210d22c4a3c8245f8a0ffb2384e (DEFAULT_TABLE table=default.Table_99098914758c439e9c7092afb6b931db [id=04c47c6752784de9880eecff35a48b3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.247339 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0139210d22c4a3c8245f8a0ffb2384e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.247758 12024 tablet_service.cc:1468] Processing CreateTablet for tablet 30d9ae02b4804d638d831ddf40f4205d (DEFAULT_TABLE table=default.Table_b31fb502c0004e95875019216e579ded [id=38d8778302d44f8b8d1ecdcde9516677]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.248558 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 94ea749705da4d639d8f73da70426a99 (DEFAULT_TABLE table=default.Table_b32ae37200da4a7ca5cdbc4d7c6ce26a [id=dc7ff3de16844e2fa740cdc198114806]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.248746 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ea749705da4d639d8f73da70426a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.249583 12021 tablet_service.cc:1468] Processing CreateTablet for tablet b0139210d22c4a3c8245f8a0ffb2384e (DEFAULT_TABLE table=default.Table_99098914758c439e9c7092afb6b931db [id=04c47c6752784de9880eecff35a48b3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.249923 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d4ccb6c5da4eddb90f590f70d5d2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.250844 11899 tablet_service.cc:1468] Processing CreateTablet for tablet e85f6b7b1f6a4966ad3c102dd8addea7 (DEFAULT_TABLE table=default.Table_f46ef5ce088042ee89cb48170a0011f0 [id=d860afeec6494817a9605d42152ac452]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.251082 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f6b7b1f6a4966ad3c102dd8addea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.251314 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 023aee30da724f879aeb71e807d94a10 (DEFAULT_TABLE table=default.Table_3e08079d38cf40059efef8250ccd265a [id=0d992c33ce0b423c929715138cdb2237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.252291 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25dd555e539f4278b9a04c4959a740f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.253012 11969 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:04.255452 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ea749705da4d639d8f73da70426a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.256367 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157d615d6e3a4cf1a45850eeb2d297f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.258001 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f6b7b1f6a4966ad3c102dd8addea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.259626 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 023aee30da724f879aeb71e807d94a10 (DEFAULT_TABLE table=default.Table_3e08079d38cf40059efef8250ccd265a [id=0d992c33ce0b423c929715138cdb2237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.259910 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023aee30da724f879aeb71e807d94a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.261458 13352 raft_consensus.cc:491] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.261555 13352 raft_consensus.cc:513] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.261955 13352 leader_election.cc:290] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.262437 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86d1b58fd1a9483b9ead08a55e3b1e63" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.262751 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86d1b58fd1a9483b9ead08a55e3b1e63" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.263473 12167 tablet_bootstrap.cc:492] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.264015 11762 tablet_service.cc:1468] Processing CreateTablet for tablet b0139210d22c4a3c8245f8a0ffb2384e (DEFAULT_TABLE table=default.Table_99098914758c439e9c7092afb6b931db [id=04c47c6752784de9880eecff35a48b3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.264298 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0139210d22c4a3c8245f8a0ffb2384e. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:04.264537 11990 leader_election.cc:343] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.264648 12167 tablet_bootstrap.cc:654] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.265375 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157d615d6e3a4cf1a45850eeb2d297f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.267762 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 30d9ae02b4804d638d831ddf40f4205d (DEFAULT_TABLE table=default.Table_b31fb502c0004e95875019216e579ded [id=38d8778302d44f8b8d1ecdcde9516677]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.267915 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef2230a4b7e4234b4e5e9d034ae52aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.268082 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9ae02b4804d638d831ddf40f4205d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.269121 12166 tablet_bootstrap.cc:492] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.269228 12166 ts_tablet_manager.cc:1397] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.000s
I20250625 14:02:04.269767 12166 raft_consensus.cc:357] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.269869 12166 raft_consensus.cc:383] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.269906 12166 raft_consensus.cc:738] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.270042 12166 consensus_queue.cc:260] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.270334 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289eaa893df4471dbdcd99fbb7b730c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.270394 12166 ts_tablet_manager.cc:1428] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.270586 12166 tablet_bootstrap.cc:492] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.270890 12167 tablet_bootstrap.cc:492] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.270968 12167 ts_tablet_manager.cc:1397] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:02:04.270956 11745 tablet_service.cc:1468] Processing CreateTablet for tablet 023aee30da724f879aeb71e807d94a10 (DEFAULT_TABLE table=default.Table_3e08079d38cf40059efef8250ccd265a [id=0d992c33ce0b423c929715138cdb2237]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.271234 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023aee30da724f879aeb71e807d94a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.271493 12167 raft_consensus.cc:357] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.271600 12166 tablet_bootstrap.cc:654] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.271613 12167 raft_consensus.cc:383] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.271647 12167 raft_consensus.cc:738] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.271747 12167 consensus_queue.cc:260] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.272007 12167 ts_tablet_manager.cc:1428] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:04.272200 12167 tablet_bootstrap.cc:492] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.272557 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d4ccb6c5da4eddb90f590f70d5d2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.273234 12167 tablet_bootstrap.cc:654] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:04.273963 11993 leader_election.cc:343] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.274042 11993 leader_election.cc:304] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:04.274760 13352 raft_consensus.cc:2747] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.274922 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85f6b7b1f6a4966ad3c102dd8addea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.274991 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 30d9ae02b4804d638d831ddf40f4205d (DEFAULT_TABLE table=default.Table_b31fb502c0004e95875019216e579ded [id=38d8778302d44f8b8d1ecdcde9516677]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.275235 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9ae02b4804d638d831ddf40f4205d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.277060 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25dd555e539f4278b9a04c4959a740f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.279417 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef31074caf14b8da07254245e5d1b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.281602 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ea749705da4d639d8f73da70426a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.281757 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9ae02b4804d638d831ddf40f4205d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.281924 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023aee30da724f879aeb71e807d94a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.283131 12172 tablet_bootstrap.cc:492] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.283623 12172 ts_tablet_manager.cc:1397] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20250625 14:02:04.284241 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0139210d22c4a3c8245f8a0ffb2384e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.284471 12172 raft_consensus.cc:357] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.284591 12172 raft_consensus.cc:383] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.284623 12172 raft_consensus.cc:738] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.284740 12172 consensus_queue.cc:260] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.285017 12172 ts_tablet_manager.cc:1428] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20250625 14:02:04.287424 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d7d225545467475d9d656f5354585aa0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7d225545467475d9d656f5354585aa0 already in progress: creating tablet
I20250625 14:02:04.287964 13121 raft_consensus.cc:491] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.288056 13121 raft_consensus.cc:513] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.288444 13121 leader_election.cc:290] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.289384 12166 tablet_bootstrap.cc:492] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.289486 12166 ts_tablet_manager.cc:1397] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:02:04.290016 12166 raft_consensus.cc:357] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.290130 12166 raft_consensus.cc:383] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.290266 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3faa8782ba0d45dbbd89437685a64aef" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:04.292369 11990 leader_election.cc:343] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.292531 12166 raft_consensus.cc:738] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.292726 12166 consensus_queue.cc:260] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.293154 12166 ts_tablet_manager.cc:1428] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:04.293399 12166 tablet_bootstrap.cc:492] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.294548 12166 tablet_bootstrap.cc:654] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.303540 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 60414f22c3bd4938b11c678197e0b34c
I20250625 14:02:04.303901 11530 catalog_manager.cc:6652] ReplaceTablet: tablet 60414f22c3bd4938b11c678197e0b34c deleted and replaced by tablet 0b6f99eebcd04986a08acc903983d98b
I20250625 14:02:04.304198 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 60414f22c3bd4938b11c678197e0b34c with delete_type TABLET_DATA_DELETED (replaced by tablet 0b6f99eebcd04986a08acc903983d98b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.304965 11528 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet b08135db764c4eb286d5f67ccba94ed5 (table default.Table_c769119bc7a3472d91c5e524724929e9 [id=44f2f74bfee54c72b3dee93db46b35e5]). Expected version 3 got 0
I20250625 14:02:04.304977 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet dff6358de0e4446e8dfc9465180ba395 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.305708 12172 tablet_bootstrap.cc:492] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.306360 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3faa8782ba0d45dbbd89437685a64aef" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.306499 11780 raft_consensus.cc:2466] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:04.307385 11527 catalog_manager.cc:5582] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:04.307592 11527 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:04.308393 11993 leader_election.cc:304] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.308959 13121 raft_consensus.cc:2802] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.309031 13121 raft_consensus.cc:491] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.309072 13121 raft_consensus.cc:3058] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.310242 13121 raft_consensus.cc:513] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.310617 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 157d615d6e3a4cf1a45850eeb2d297f6
I20250625 14:02:04.310679 13121 leader_election.cc:290] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.311239 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 157d615d6e3a4cf1a45850eeb2d297f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.311519 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3faa8782ba0d45dbbd89437685a64aef" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:04.312014 11990 leader_election.cc:343] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.312161 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3faa8782ba0d45dbbd89437685a64aef" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:04.312280 11780 raft_consensus.cc:3058] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.313025 12172 tablet_bootstrap.cc:654] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.313342 11780 raft_consensus.cc:2466] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:04.313658 11993 leader_election.cc:304] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.313843 13121 raft_consensus.cc:2802] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.313943 13121 raft_consensus.cc:695] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:04.314079 13121 consensus_queue.cc:237] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.315543 12172 tablet_bootstrap.cc:492] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.315632 12172 ts_tablet_manager.cc:1397] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:02:04.316111 12172 raft_consensus.cc:357] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.316215 12172 raft_consensus.cc:383] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.316264 12172 raft_consensus.cc:738] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.316385 12172 consensus_queue.cc:260] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.316701 12172 ts_tablet_manager.cc:1428] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.319741 11918 raft_consensus.cc:1273] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:04.320194 12056 raft_consensus.cc:1273] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 14:02:04.320953 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 60414f22c3bd4938b11c678197e0b34c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60414f22c3bd4938b11c678197e0b34c already in progress: creating tablet
I20250625 14:02:04.321169 12177 tablet_replica.cc:331] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.321297 12177 raft_consensus.cc:2241] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.321427 12177 pending_rounds.cc:70] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:04.321453 12177 pending_rounds.cc:77] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523068525715456 op_type: NO_OP noop_request { }
I20250625 14:02:04.321502 12177 raft_consensus.cc:2887] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:04.321547 12177 raft_consensus.cc:2270] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.322611 12177 ts_tablet_manager.cc:1905] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.322746 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.322928 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 157d615d6e3a4cf1a45850eeb2d297f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.323275 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 157d615d6e3a4cf1a45850eeb2d297f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.325026 12175 tablet_replica.cc:331] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:04.325233 12177 ts_tablet_manager.cc:1918] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:04.325243 12175 raft_consensus.cc:2241] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.325300 12177 log.cc:1199] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/dff6358de0e4446e8dfc9465180ba395
I20250625 14:02:04.325389 12175 raft_consensus.cc:2270] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.325588 12177 ts_tablet_manager.cc:1939] T dff6358de0e4446e8dfc9465180ba395 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.326406 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 60414f22c3bd4938b11c678197e0b34c with delete_type TABLET_DATA_DELETED (replaced by tablet 0b6f99eebcd04986a08acc903983d98b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.326879 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 60414f22c3bd4938b11c678197e0b34c with delete_type TABLET_DATA_DELETED (replaced by tablet 0b6f99eebcd04986a08acc903983d98b) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.329993 12175 ts_tablet_manager.cc:1905] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.329965 13699 consensus_queue.cc:1035] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.330109 13335 consensus_queue.cc:1035] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.330533 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet f2576ff766494c37b316552a66a5ff31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.330708 12173 tablet_replica.cc:331] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.330850 12173 raft_consensus.cc:2241] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.330961 12173 raft_consensus.cc:2270] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.331051 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet dff6358de0e4446e8dfc9465180ba395 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.331516 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.331512 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet dff6358de0e4446e8dfc9465180ba395 (table default.Table_26cf2e4d1ba540b29a77b71d12a03688 [id=fd3941c6a70a48ac98571ef67bd9c5d7]) successfully deleted
W20250625 14:02:04.331714 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 157d615d6e3a4cf1a45850eeb2d297f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 157d615d6e3a4cf1a45850eeb2d297f6 already in progress: creating tablet
I20250625 14:02:04.331838 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 7ff70668bede407c816db9779ce5221d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.332064 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3f37b24906cb4ba7bd48f8b157211686" } modify_external_catalogs: true
I20250625 14:02:04.332193 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3f37b24906cb4ba7bd48f8b157211686" } modify_external_catalogs: true
I20250625 14:02:04.332511 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c147de4a592443e78b2ef153e8783ed6" } modify_external_catalogs: true
I20250625 14:02:04.332590 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c147de4a592443e78b2ef153e8783ed6" } modify_external_catalogs: true
I20250625 14:02:04.332854 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.332979 12175 ts_tablet_manager.cc:1918] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.333057 12175 log.cc:1199] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/4317c3460f664f32aeb9b25ffb57d5bd
I20250625 14:02:04.333294 12175 ts_tablet_manager.cc:1939] T 4317c3460f664f32aeb9b25ffb57d5bd P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:04.333377 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dc9dee22497a48a2b7705efdac6aae7e" } new_table_name: "default.Table_6b9f4eac4c5c4498bdc292d173bada95" modify_external_catalogs: true
I20250625 14:02:04.333560 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.334195 11531 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0" } modify_external_catalogs: true
I20250625 14:02:04.334292 11531 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0" } modify_external_catalogs: true
I20250625 14:02:04.335094 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_463848d52fef45a891bce13d122d7ee0" } modify_external_catalogs: true
I20250625 14:02:04.335196 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_463848d52fef45a891bce13d122d7ee0" } modify_external_catalogs: true
I20250625 14:02:04.336971 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 with delete_type TABLET_DATA_DELETED (replaced by tablet 73a40d0ee5034aaea24684739c3f5154) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.339040 12173 ts_tablet_manager.cc:1905] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.341184 11532 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet dfbf6959677547a6a2582b73b2be4c03 (table default.Table_a5fc3132af7544519819617719f71e77 [id=70d3fc86e64847b9b7edd7945c195dc6]). Expected version 2 got 0
W20250625 14:02:04.342033 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 157d615d6e3a4cf1a45850eeb2d297f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 157d615d6e3a4cf1a45850eeb2d297f6 already in progress: creating tablet
W20250625 14:02:04.342351 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 60414f22c3bd4938b11c678197e0b34c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60414f22c3bd4938b11c678197e0b34c already in progress: creating tablet
I20250625 14:02:04.347544 13352 raft_consensus.cc:491] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.347667 13352 raft_consensus.cc:513] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.348114 13352 leader_election.cc:290] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.350562 13232 consensus_queue.cc:1035] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.351263 13531 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:02:04.351514 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d015e28856e849898287bf4fd19626c3
I20250625 14:02:04.351969 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 169c59b473bd425296fa5bd9bbf2b616
I20250625 14:02:04.352421 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet c68e055191704da8862b0fe6b30bfcfc
I20250625 14:02:04.354887 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet d015e28856e849898287bf4fd19626c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.355069 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet d015e28856e849898287bf4fd19626c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.355213 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 169c59b473bd425296fa5bd9bbf2b616 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.355373 12172 tablet_bootstrap.cc:492] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.356384 12172 tablet_bootstrap.cc:654] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.356999 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet c68e055191704da8862b0fe6b30bfcfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:04.357514 11993 leader_election.cc:343] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 7ff70668bede407c816db9779ce5221d
I20250625 14:02:04.358208 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 169c59b473bd425296fa5bd9bbf2b616 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.358213 13535 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:02:04.360668 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet c68e055191704da8862b0fe6b30bfcfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.361696 12166 tablet_bootstrap.cc:492] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.361789 12166 ts_tablet_manager.cc:1397] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.000s
I20250625 14:02:04.362113 12167 tablet_bootstrap.cc:492] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.362210 12167 ts_tablet_manager.cc:1397] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.000s
I20250625 14:02:04.362396 12166 raft_consensus.cc:357] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.362505 12166 raft_consensus.cc:383] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.362537 12166 raft_consensus.cc:738] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.362655 12166 consensus_queue.cc:260] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.362708 12167 raft_consensus.cc:357] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.362802 12167 raft_consensus.cc:383] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.362833 12167 raft_consensus.cc:738] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.362968 12166 ts_tablet_manager.cc:1428] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.362938 12167 consensus_queue.cc:260] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.363161 12166 tablet_bootstrap.cc:492] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.363217 12167 ts_tablet_manager.cc:1428] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.363369 12167 tablet_bootstrap.cc:492] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.364254 12166 tablet_bootstrap.cc:654] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.364284 12167 tablet_bootstrap.cc:654] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.364907 12024 tablet_service.cc:1515] Processing DeleteTablet for tablet 169c59b473bd425296fa5bd9bbf2b616 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.365048 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet d015e28856e849898287bf4fd19626c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.365159 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet c68e055191704da8862b0fe6b30bfcfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.365746 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 3d5c9b7412d148a38fd61eb4629db359 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.366196 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_803deaef2bc34cf3ae96731d810e19e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.366436 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a6544a9b408946abb14fab1114bee055"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.366628 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_803deaef2bc34cf3ae96731d810e19e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:04.366820 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6544a9b408946abb14fab1114bee055 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.367434 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_10e6a1ed964b487bbdfb6aa6815225f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.367728 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10e6a1ed964b487bbdfb6aa6815225f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.368448 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c72a257dcdec4555bf5a1e1d706936c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.368726 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c72a257dcdec4555bf5a1e1d706936c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.369386 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_39a01bfa58794952934eb2fb8b889b0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.369674 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39a01bfa58794952934eb2fb8b889b0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.370591 13352 consensus_queue.cc:1035] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:04.371440 11990 leader_election.cc:343] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Not found: Tablet not found: 7ff70668bede407c816db9779ce5221d
I20250625 14:02:04.371512 11990 leader_election.cc:304] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:04.372046 13121 raft_consensus.cc:2747] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.372169 13121 consensus_queue.cc:1035] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.374544 13532 tablet.cc:1722] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20250625 14:02:04.374951 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d015e28856e849898287bf4fd19626c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d015e28856e849898287bf4fd19626c3 already in progress: creating tablet
I20250625 14:02:04.376577 13232 consensus_queue.cc:1035] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.376888 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c035179702eb4c5f884ec0bdf2261562" } new_table_name: "default.Table_0fec92f6b237430ab40818490224d165" modify_external_catalogs: true
I20250625 14:02:04.378461 12177 tablet_replica.cc:331] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.378634 12177 raft_consensus.cc:2241] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.378875 12177 raft_consensus.cc:2270] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.379321 12177 ts_tablet_manager.cc:1905] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.380324 12175 tablet_replica.cc:331] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:04.380475 12175 raft_consensus.cc:2241] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.380599 12175 raft_consensus.cc:2270] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.380992 12175 ts_tablet_manager.cc:1905] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.342267 12173 ts_tablet_manager.cc:1918] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.390342 12173 log.cc:1199] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f2576ff766494c37b316552a66a5ff31
I20250625 14:02:04.390666 12173 ts_tablet_manager.cc:1939] T f2576ff766494c37b316552a66a5ff31 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.391494 12173 tablet_replica.cc:331] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.391587 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 4317c3460f664f32aeb9b25ffb57d5bd (table default.Table_02b107aff218434e8b66fde53ea34376 [id=db5d1d3ff141472b901e2930ccc829df]) successfully deleted
I20250625 14:02:04.391758 12173 raft_consensus.cc:2241] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.391956 12173 raft_consensus.cc:2270] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:04.391870 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 157d615d6e3a4cf1a45850eeb2d297f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 157d615d6e3a4cf1a45850eeb2d297f6 already in progress: creating tablet
W20250625 14:02:04.392422 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 60414f22c3bd4938b11c678197e0b34c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60414f22c3bd4938b11c678197e0b34c already in progress: creating tablet
W20250625 14:02:04.392617 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d015e28856e849898287bf4fd19626c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d015e28856e849898287bf4fd19626c3 already in progress: creating tablet
W20250625 14:02:04.392825 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet c68e055191704da8862b0fe6b30bfcfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c68e055191704da8862b0fe6b30bfcfc already in progress: creating tablet
I20250625 14:02:04.393023 12177 ts_tablet_manager.cc:1918] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:04.393399 12177 log.cc:1199] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/169c59b473bd425296fa5bd9bbf2b616
I20250625 14:02:04.393911 12173 ts_tablet_manager.cc:1905] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.395314 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_3a5a410c796c42c2b28e41b58263b19a" } new_table_name: "default.Table_c4c126af60ae4c13b87f04779c942a3f" modify_external_catalogs: true
I20250625 14:02:04.395450 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 990d03f434044571aa2b61577495ab77 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.396473 12265 raft_consensus.cc:491] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.396567 12265 raft_consensus.cc:513] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.396914 12265 leader_election.cc:290] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:04.397693 11858 leader_election.cc:343] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: ce6e907d627f4f3e8219eaabe4373c6e
I20250625 14:02:04.397763 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f2576ff766494c37b316552a66a5ff31 (table default.Table_47a020733f644c45b54865bbd14ff779 [id=4ca78651d63b411b83d97f628dbf849d]) successfully deleted
I20250625 14:02:04.398908 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ce6e907d627f4f3e8219eaabe4373c6e" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.399039 12056 raft_consensus.cc:2466] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:04.399493 12177 ts_tablet_manager.cc:1939] T 169c59b473bd425296fa5bd9bbf2b616 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.400039 11855 leader_election.cc:304] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5
I20250625 14:02:04.400303 13788 raft_consensus.cc:2802] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.400367 13788 raft_consensus.cc:491] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.400414 13788 raft_consensus.cc:3058] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.401595 13788 raft_consensus.cc:513] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:04.401906 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51b8945fea564468a76b4aa7feb90844 consensus state has no leader
I20250625 14:02:04.401990 13788 leader_election.cc:290] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:04.402838 11858 leader_election.cc:343] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: ce6e907d627f4f3e8219eaabe4373c6e
I20250625 14:02:04.403934 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0 [id=f8e4990b036541f1b033de99bff1accc]) successfully deleted
I20250625 14:02:04.404342 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ce6e907d627f4f3e8219eaabe4373c6e" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:04.404471 12056 raft_consensus.cc:3058] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:04.404924 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fa45ae948254d51bf545969d7587fc7 consensus state has no leader
I20250625 14:02:04.405577 12056 raft_consensus.cc:2466] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:04.406081 11855 leader_election.cc:304] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5
I20250625 14:02:04.406412 13788 raft_consensus.cc:2802] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.406495 13788 raft_consensus.cc:695] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:04.406625 13788 consensus_queue.cc:237] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.406695 13121 raft_consensus.cc:491] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.406776 13121 raft_consensus.cc:513] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.407177 13121 leader_election.cc:290] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.407578 12167 tablet_bootstrap.cc:492] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
W20250625 14:02:04.407634 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet c68e055191704da8862b0fe6b30bfcfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c68e055191704da8862b0fe6b30bfcfc already in progress: creating tablet
I20250625 14:02:04.407673 12167 ts_tablet_manager.cc:1397] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20250625 14:02:04.408190 13334 raft_consensus.cc:491] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.408221 12167 raft_consensus.cc:357] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.408317 12167 raft_consensus.cc:383] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.408279 13334 raft_consensus.cc:513] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.408347 12167 raft_consensus.cc:738] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.408445 12167 consensus_queue.cc:260] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.408617 13334 leader_election.cc:290] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.408725 12167 ts_tablet_manager.cc:1428] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.408938 12167 tablet_bootstrap.cc:492] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.408921 13232 raft_consensus.cc:491] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.409173 13232 raft_consensus.cc:513] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.409206 11916 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae093ced6ff4255b75f634701ed259b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.409523 13232 leader_election.cc:290] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.410017 12167 tablet_bootstrap.cc:654] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.410089 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae093ced6ff4255b75f634701ed259b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.410529 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "84a1eb4471544de9afbb5b35d0071dcc" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.410558 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "84a1eb4471544de9afbb5b35d0071dcc" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:04.411092 11990 leader_election.cc:343] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.411417 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54a59027aef04a12a0bf1fbece3c3161" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.411671 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54a59027aef04a12a0bf1fbece3c3161" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.411780 11778 raft_consensus.cc:2466] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:04.411953 11717 leader_election.cc:343] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:04.412070 11717 leader_election.cc:343] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.412109 11717 leader_election.cc:304] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:04.412300 13774 raft_consensus.cc:2747] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:04.412791 11993 leader_election.cc:343] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.412858 11993 leader_election.cc:304] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:04.413072 11993 leader_election.cc:304] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.413538 13232 raft_consensus.cc:2747] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.413650 13232 raft_consensus.cc:2802] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.413686 13232 raft_consensus.cc:491] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.413727 13232 raft_consensus.cc:3058] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.415055 13232 raft_consensus.cc:513] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.415571 13232 leader_election.cc:290] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.416441 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82] alter complete (version 1)
I20250625 14:02:04.417011 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4f41fddb9c5143f5ad20fe27c41a90b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.417405 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f41fddb9c5143f5ad20fe27c41a90b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:04.418239 11990 leader_election.cc:343] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.418222 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_44c950a6e31d446ea2653489dca5a188"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.418582 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44c950a6e31d446ea2653489dca5a188 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.418692 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54a59027aef04a12a0bf1fbece3c3161" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.421384 12265 raft_consensus.cc:491] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.421490 12265 raft_consensus.cc:513] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.421849 12265 leader_election.cc:290] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:04.422691 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bc0e4c79bfa64b45bb0f39f20012635e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.422993 11990 leader_election.cc:343] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.422750 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2f30f99bdda41dba6960ffdeb69226b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:04.423063 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc0e4c79bfa64b45bb0f39f20012635e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.423161 12056 raft_consensus.cc:2391] T e2f30f99bdda41dba6960ffdeb69226b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:04.423925 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "54a59027aef04a12a0bf1fbece3c3161" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:04.424053 11780 raft_consensus.cc:3058] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.424423 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet ce6e907d627f4f3e8219eaabe4373c6e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.424815 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 806e5502a95e4a0396c008267e16f2d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.425226 11780 raft_consensus.cc:2466] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:04.425601 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e2f30f99bdda41dba6960ffdeb69226b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.425977 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5c0d1c43f3014a00b19cb9ab5403039b" } new_table_name: "default.Table_e888412c9a454ef690a8c2a0ce33c075" modify_external_catalogs: true
I20250625 14:02:04.427407 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.427424 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet f2576ff766494c37b316552a66a5ff31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.427651 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fd261d824c34864a7b15e4736254062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.427657 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]). Expected version 1 got 0
I20250625 14:02:04.427768 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet b08135db764c4eb286d5f67ccba94ed5 (table default.Table_c769119bc7a3472d91c5e524724929e9 [id=44f2f74bfee54c72b3dee93db46b35e5]). Expected version 3 got 0
I20250625 14:02:04.427879 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:04.427901 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 3faa8782ba0d45dbbd89437685a64aef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.427917 11858 leader_election.cc:304] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:04.427950 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 288e0c1644a34b8dabc06ccdda9f0fa9 (table default.Table_6b9f4eac4c5c4498bdc292d173bada95 [id=8082aa269ffd46148b58dd2279034161]). Expected version 1 got 0
I20250625 14:02:04.428208 12265 raft_consensus.cc:3058] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.429405 12265 raft_consensus.cc:2747] T e2f30f99bdda41dba6960ffdeb69226b P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.429940 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet dfbf6959677547a6a2582b73b2be4c03 (table default.Table_a5fc3132af7544519819617719f71e77 [id=70d3fc86e64847b9b7edd7945c195dc6]). Expected version 2 got 0
I20250625 14:02:04.430084 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]). Expected version 1 got 0
I20250625 14:02:04.430169 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet b08135db764c4eb286d5f67ccba94ed5 (table default.Table_c769119bc7a3472d91c5e524724929e9 [id=44f2f74bfee54c72b3dee93db46b35e5]). Expected version 3 got 0
I20250625 14:02:04.430533 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet dff6358de0e4446e8dfc9465180ba395 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.430855 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.431078 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 3faa8782ba0d45dbbd89437685a64aef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.431872 11899 tablet_service.cc:1468] Processing CreateTablet for tablet f2d6c49888274fed8985bb001ee0be9b (DEFAULT_TABLE table=default.Table_8a0bff77cd224946a1389d74120cba18 [id=64fc1b7dc4d7486c998e5d5e0e729feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.432176 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d6c49888274fed8985bb001ee0be9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.432169 12033 tablet_service.cc:1468] Processing CreateTablet for tablet f2d6c49888274fed8985bb001ee0be9b (DEFAULT_TABLE table=default.Table_8a0bff77cd224946a1389d74120cba18 [id=64fc1b7dc4d7486c998e5d5e0e729feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.432440 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d6c49888274fed8985bb001ee0be9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.434429 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.436734 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 4317c3460f664f32aeb9b25ffb57d5bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:04.436972 11519 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 0fa45ae948254d51bf545969d7587fc7 (table default.Table_c4c126af60ae4c13b87f04779c942a3f [id=f6301381a1af44bf91ed7a00812c62ac], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0fa45ae948254d51bf545969d7587fc7 consensus state has no leader
I20250625 14:02:04.437650 11749 tablet_service.cc:1468] Processing CreateTablet for tablet f2d6c49888274fed8985bb001ee0be9b (DEFAULT_TABLE table=default.Table_8a0bff77cd224946a1389d74120cba18 [id=64fc1b7dc4d7486c998e5d5e0e729feb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.437940 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d6c49888274fed8985bb001ee0be9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.440502 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]). Expected version 1 got 0
I20250625 14:02:04.440608 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 288e0c1644a34b8dabc06ccdda9f0fa9 (table default.Table_6b9f4eac4c5c4498bdc292d173bada95 [id=8082aa269ffd46148b58dd2279034161]). Expected version 1 got 0
I20250625 14:02:04.443341 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 50f55f37173246bc8dab611f5d28c24e
I20250625 14:02:04.443782 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 2c6ea639901540038cdcf7e2d50e3555 (DEFAULT_TABLE table=default.Table_b25bc5f5f50c447982a32d8b89898f9f [id=a17b19c5dc614aab99e5bc2de2f68336]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.444070 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6ea639901540038cdcf7e2d50e3555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.444139 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 990d03f434044571aa2b61577495ab77
I20250625 14:02:04.444365 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 990d03f434044571aa2b61577495ab77 deleted and replaced by tablet 49ea64f543dc4d2c855661ac48127298
W20250625 14:02:04.444607 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40624157a77a4649b34a1d281f9fc8ca consensus state has no leader
I20250625 14:02:04.445722 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 2c6ea639901540038cdcf7e2d50e3555 (DEFAULT_TABLE table=default.Table_b25bc5f5f50c447982a32d8b89898f9f [id=a17b19c5dc614aab99e5bc2de2f68336]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.445799 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 50f55f37173246bc8dab611f5d28c24e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.446015 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6ea639901540038cdcf7e2d50e3555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.446391 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 91f6e41ac5554c9fad29ed15441d2f3b (DEFAULT_TABLE table=default.Table_9fea52e2385c43a9859657e70497d530 [id=73bdfa18a5df459b8514fd9fef9bb88b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.446470 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 2c6ea639901540038cdcf7e2d50e3555 (DEFAULT_TABLE table=default.Table_b25bc5f5f50c447982a32d8b89898f9f [id=a17b19c5dc614aab99e5bc2de2f68336]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.446969 12024 tablet_service.cc:1468] Processing CreateTablet for tablet 91f6e41ac5554c9fad29ed15441d2f3b (DEFAULT_TABLE table=default.Table_9fea52e2385c43a9859657e70497d530 [id=73bdfa18a5df459b8514fd9fef9bb88b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.447167 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 990d03f434044571aa2b61577495ab77 with delete_type TABLET_DATA_DELETED (replaced by tablet 49ea64f543dc4d2c855661ac48127298) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.447216 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f6e41ac5554c9fad29ed15441d2f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.447422 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 990d03f434044571aa2b61577495ab77 with delete_type TABLET_DATA_DELETED (replaced by tablet 49ea64f543dc4d2c855661ac48127298) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.448338 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 50f55f37173246bc8dab611f5d28c24e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.449347 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_5171599cd58f4906897a3e7da2c30d6e [id=416264ede8644650b07f6c60ffb3cc52] alter complete (version 5)
I20250625 14:02:04.450333 12172 tablet_bootstrap.cc:492] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.450426 12172 ts_tablet_manager.cc:1397] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.095s user 0.002s sys 0.000s
I20250625 14:02:04.450918 12172 raft_consensus.cc:357] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.451041 12172 raft_consensus.cc:383] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.451077 12172 raft_consensus.cc:738] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.451189 12172 consensus_queue.cc:260] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.451602 12172 ts_tablet_manager.cc:1428] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.451925 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f6e41ac5554c9fad29ed15441d2f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.452840 11993 leader_election.cc:304] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.453208 13121 raft_consensus.cc:2802] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.453294 13121 raft_consensus.cc:695] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:04.453433 13121 consensus_queue.cc:237] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.454926 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6ea639901540038cdcf7e2d50e3555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.455331 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 32e39d974af9439c873ba8ec6523c428 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.456404 13531 tablet.cc:1722] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:04.463611 12172 tablet_bootstrap.cc:492] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.464795 12172 tablet_bootstrap.cc:654] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.466435 12024 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f6c287461864f6dba5f47711eb69fae with delete_type TABLET_DATA_DELETED (replaced by tablet 59556a6da95144f88aa806a7febd6a58) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.468425 13535 tablet.cc:1722] T 288e0c1644a34b8dabc06ccdda9f0fa9 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:04.470259 13774 consensus_queue.cc:1035] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.470434 13334 consensus_queue.cc:1035] T e2f30f99bdda41dba6960ffdeb69226b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.471489 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 91f6e41ac5554c9fad29ed15441d2f3b (DEFAULT_TABLE table=default.Table_9fea52e2385c43a9859657e70497d530 [id=73bdfa18a5df459b8514fd9fef9bb88b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.471757 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f6e41ac5554c9fad29ed15441d2f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.473980 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 50f55f37173246bc8dab611f5d28c24e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.474092 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 990d03f434044571aa2b61577495ab77 with delete_type TABLET_DATA_DELETED (replaced by tablet 49ea64f543dc4d2c855661ac48127298) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.474355 11748 tablet_service.cc:1468] Processing CreateTablet for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c (DEFAULT_TABLE table=default.Table_4befcf9542e44983bb76073252702495 [id=d06aae4647ab45ddb1a646983cb48ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.475145 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.487824 12175 ts_tablet_manager.cc:1918] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:04.488067 12175 log.cc:1199] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/169c59b473bd425296fa5bd9bbf2b616
I20250625 14:02:04.488492 12175 ts_tablet_manager.cc:1939] T 169c59b473bd425296fa5bd9bbf2b616 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:04.489500 12175 tablet_replica.cc:331] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:04.489743 12175 raft_consensus.cc:2241] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.489969 12175 pending_rounds.cc:70] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:02:04.490060 12175 pending_rounds.cc:77] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523069571006464 op_type: NO_OP noop_request { }
I20250625 14:02:04.490222 12175 raft_consensus.cc:2887] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:04.492839 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 929ed01b654b4aabb97c5db690a5f1f3 (DEFAULT_TABLE table=default.Table_8aaa44063346451f85e8a9b9742de378 [id=5083149497314b798d32d8cc76917b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.494206 12172 tablet_bootstrap.cc:492] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.494329 12172 ts_tablet_manager.cc:1397] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:02:04.494762 12173 ts_tablet_manager.cc:1918] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.494835 12173 log.cc:1199] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/dff6358de0e4446e8dfc9465180ba395
I20250625 14:02:04.494840 13678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: Bootstrap replayed 1/1 log segments. Stats: ops{read=992 overwritten=0 applied=990 ignored=0} inserts{seen=794 ignored=0} mutations{seen=1177 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20250625 14:02:04.494926 12172 raft_consensus.cc:357] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.495064 12173 ts_tablet_manager.cc:1939] T dff6358de0e4446e8dfc9465180ba395 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.495059 12172 raft_consensus.cc:383] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.495096 12172 raft_consensus.cc:738] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.495234 12172 consensus_queue.cc:260] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.495366 13678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: Bootstrap complete.
I20250625 14:02:04.495388 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 929ed01b654b4aabb97c5db690a5f1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.495740 12172 ts_tablet_manager.cc:1428] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.496064 12172 tablet_bootstrap.cc:492] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.498673 13535 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:04.499132 13678 raft_consensus.cc:357] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 1 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:02:04.500416 12172 tablet_bootstrap.cc:654] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.501104 13678 raft_consensus.cc:738] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b569e7a9e38b4882a89092d98a2f1b9b, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.504444 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet dff6358de0e4446e8dfc9465180ba395 (table default.Table_26cf2e4d1ba540b29a77b71d12a03688 [id=fd3941c6a70a48ac98571ef67bd9c5d7]) successfully deleted
I20250625 14:02:04.502058 12173 tablet_replica.cc:331] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.504670 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0 [id=f8e4990b036541f1b033de99bff1accc]) successfully deleted
I20250625 14:02:04.503958 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 929ed01b654b4aabb97c5db690a5f1f3 (DEFAULT_TABLE table=default.Table_8aaa44063346451f85e8a9b9742de378 [id=5083149497314b798d32d8cc76917b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.504778 12173 raft_consensus.cc:2241] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.504994 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 929ed01b654b4aabb97c5db690a5f1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.505913 11525 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_6b9f4eac4c5c4498bdc292d173bada95 [id=8082aa269ffd46148b58dd2279034161] alter complete (version 1)
I20250625 14:02:04.506028 12173 pending_rounds.cc:70] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:04.506071 12173 pending_rounds.cc:77] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523068522848256 op_type: NO_OP noop_request { }
I20250625 14:02:04.506134 12173 raft_consensus.cc:2887] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:04.506186 12173 raft_consensus.cc:2270] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.506723 12173 ts_tablet_manager.cc:1905] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.507298 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet a7d87f5ca2f74eaeae12f1a6b533c12c from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.504528 12024 tablet_service.cc:1468] Processing CreateTablet for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c (DEFAULT_TABLE table=default.Table_4befcf9542e44983bb76073252702495 [id=d06aae4647ab45ddb1a646983cb48ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.509138 12173 ts_tablet_manager.cc:1918] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:04.509191 12173 log.cc:1199] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/4317c3460f664f32aeb9b25ffb57d5bd
I20250625 14:02:04.509325 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.509446 12173 ts_tablet_manager.cc:1939] T 4317c3460f664f32aeb9b25ffb57d5bd P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.509518 11831 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:04.504539 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 5947ad4bff51429f8071075c8cdd8f34 (DEFAULT_TABLE table=default.Table_0edcafdd98474f9591d5f2c451b3775a [id=15e82c5d77e24a25b764d1f8757faa8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.510553 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5947ad4bff51429f8071075c8cdd8f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.510574 13678 consensus_queue.cc:260] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 990, Last appended: 1.992, Last appended by leader: 992, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:02:04.511977 13678 sys_catalog.cc:564] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: configured and running, proceeding with master startup.
I20250625 14:02:04.512739 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d9f3b918daa24f5793772fd13f284974"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.512903 12173 tablet_replica.cc:331] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.513028 12173 raft_consensus.cc:2241] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.513129 12173 raft_consensus.cc:2270] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:04.513211 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9f3b918daa24f5793772fd13f284974 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.513522 12173 ts_tablet_manager.cc:1905] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.513715 13651 raft_consensus.cc:1215] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.990->[1.991-1.1220] Dedup: 1.992->[1.993-1.1220]
I20250625 14:02:04.514480 12177 tablet_replica.cc:331] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.514632 12177 raft_consensus.cc:2241] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.514858 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9b0ab65cb6b34b5e842f0024f6a8302b" } new_table_name: "default.Table_a1eacb4021394ce184aa2cfdcee46a7d" modify_external_catalogs: true
I20250625 14:02:04.514966 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a3bf731b414c40fea1cafe7176c74b02" } modify_external_catalogs: true
I20250625 14:02:04.515072 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a3bf731b414c40fea1cafe7176c74b02" } modify_external_catalogs: true
I20250625 14:02:04.515251 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1ee82ccaed7a448b92f6dcace8a2d8b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.515586 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ee82ccaed7a448b92f6dcace8a2d8b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.515718 12177 raft_consensus.cc:2270] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.516139 12173 ts_tablet_manager.cc:1918] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.516225 12173 log.cc:1199] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7ff70668bede407c816db9779ce5221d
I20250625 14:02:04.516441 12173 ts_tablet_manager.cc:1939] T 7ff70668bede407c816db9779ce5221d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.522730 12177 ts_tablet_manager.cc:1905] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.523041 12172 tablet_bootstrap.cc:492] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.523144 12172 ts_tablet_manager.cc:1397] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250625 14:02:04.523257 12173 tablet_replica.cc:331] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.523409 12173 raft_consensus.cc:2241] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.523689 12173 raft_consensus.cc:2270] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.523640 12172 raft_consensus.cc:357] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.523757 12172 raft_consensus.cc:383] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.523831 12172 raft_consensus.cc:738] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.524061 12172 consensus_queue.cc:260] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.524457 12172 ts_tablet_manager.cc:1428] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.524748 12172 tablet_bootstrap.cc:492] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.524856 12173 ts_tablet_manager.cc:1905] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.525372 11748 tablet_service.cc:1468] Processing CreateTablet for tablet 30c1a61739e84e4aab5cc553bb3c6575 (DEFAULT_TABLE table=default.Table_70ef26dd935f494d9b67e97499efd65c [id=424a95f531024dba97b1cf8606272cfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.525614 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c1a61739e84e4aab5cc553bb3c6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.526006 12172 tablet_bootstrap.cc:654] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.527377 12173 ts_tablet_manager.cc:1918] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.527442 12173 log.cc:1199] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/ce6e907d627f4f3e8219eaabe4373c6e
I20250625 14:02:04.527632 12173 ts_tablet_manager.cc:1939] T ce6e907d627f4f3e8219eaabe4373c6e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.528532 11748 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f6c287461864f6dba5f47711eb69fae with delete_type TABLET_DATA_DELETED (replaced by tablet 59556a6da95144f88aa806a7febd6a58) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.528959 11748 tablet_service.cc:1468] Processing CreateTablet for tablet 1c7f541371be494ba77156c251c148b7 (DEFAULT_TABLE table=default.Table_d61d2d203bec435bb70dc93c563fd08f [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.529227 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7f541371be494ba77156c251c148b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.530293 12173 tablet_replica.cc:331] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.530444 12173 raft_consensus.cc:2241] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.530575 12173 pending_rounds.cc:70] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:04.530597 12173 pending_rounds.cc:77] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523069762592768 op_type: NO_OP noop_request { }
I20250625 14:02:04.530650 12173 raft_consensus.cc:2887] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:04.530692 12173 raft_consensus.cc:2270] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.531654 11748 tablet_service.cc:1468] Processing CreateTablet for tablet 8f515ef1e644499da3f2b197bcc8aba5 (DEFAULT_TABLE table=default.Table_d9db4adbbed242fdb6cf2b0bd4434cb3 [id=0a1d0dae9e6f4fc290a1697e123f7dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.532097 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f515ef1e644499da3f2b197bcc8aba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.532050 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 12aeec6dd27b4807864685ebdf9bfdf5 (DEFAULT_TABLE table=default.Table_437396c20b3840f5baa9da089b395a38 [id=659b5a707a11410ea9232a3b431e46de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.532378 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12aeec6dd27b4807864685ebdf9bfdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.534049 12177 ts_tablet_manager.cc:1918] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.534181 12177 log.cc:1199] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/84a1eb4471544de9afbb5b35d0071dcc
I20250625 14:02:04.534946 12172 tablet_bootstrap.cc:492] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.535079 12172 ts_tablet_manager.cc:1397] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
I20250625 14:02:04.535645 12172 raft_consensus.cc:357] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.535804 12172 raft_consensus.cc:383] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.535873 12172 raft_consensus.cc:738] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.536150 12172 consensus_queue.cc:260] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.536635 12172 ts_tablet_manager.cc:1428] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:04.537374 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 5947ad4bff51429f8071075c8cdd8f34 (DEFAULT_TABLE table=default.Table_0edcafdd98474f9591d5f2c451b3775a [id=15e82c5d77e24a25b764d1f8757faa8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.543751 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 9d600f6cf7074b3ca4f0d73af6479357 (DEFAULT_TABLE table=default.Table_8beee31d79394da795ce06738a98e812 [id=85f8f5c2767a49e981a53d6b0f09f766]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.544772 12177 ts_tablet_manager.cc:1939] T 84a1eb4471544de9afbb5b35d0071dcc P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.547902 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet b08135db764c4eb286d5f67ccba94ed5 (table default.Table_c769119bc7a3472d91c5e524724929e9 [id=44f2f74bfee54c72b3dee93db46b35e5]). Expected version 3 got 0
I20250625 14:02:04.552629 11748 tablet_service.cc:1468] Processing CreateTablet for tablet 464e2c65420e41acbe47b30f24179cc2 (DEFAULT_TABLE table=default.Table_813f6ae0f07545babbab5dc4769bc1d3 [id=3feb568ca7a64303a034678506ff18ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.553011 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_c769119bc7a3472d91c5e524724929e9" } new_table_name: "default.Table_39f38f3fc23e425f87d7ae5fdbf08233" modify_external_catalogs: true
I20250625 14:02:04.553350 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ca2784febf474360b12bb7a8329d312c" } modify_external_catalogs: true
I20250625 14:02:04.553447 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ca2784febf474360b12bb7a8329d312c" } modify_external_catalogs: true
I20250625 14:02:04.554455 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bdb8c169c9af4735b29c0aaa9981261f" } modify_external_catalogs: true
I20250625 14:02:04.554551 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bdb8c169c9af4735b29c0aaa9981261f" } modify_external_catalogs: true
I20250625 14:02:04.556104 12172 tablet_bootstrap.cc:492] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.557313 12172 tablet_bootstrap.cc:654] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.559656 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9aa283baefba46e0aba04a8c95c2f3c6" } modify_external_catalogs: true
I20250625 14:02:04.559801 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9aa283baefba46e0aba04a8c95c2f3c6" } modify_external_catalogs: true
I20250625 14:02:04.559929 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d600f6cf7074b3ca4f0d73af6479357. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.562821 12177 tablet_replica.cc:331] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.562901 12172 tablet_bootstrap.cc:492] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.562987 12177 raft_consensus.cc:2241] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.563098 12177 raft_consensus.cc:2270] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.563726 12177 ts_tablet_manager.cc:1905] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.566201 12177 ts_tablet_manager.cc:1918] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.566279 12177 log.cc:1199] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/3faa8782ba0d45dbbd89437685a64aef
I20250625 14:02:04.567358 12177 ts_tablet_manager.cc:1939] T 3faa8782ba0d45dbbd89437685a64aef P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.562978 12172 ts_tablet_manager.cc:1397] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20250625 14:02:04.568054 12172 raft_consensus.cc:357] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.568189 12172 raft_consensus.cc:383] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.568231 12172 raft_consensus.cc:738] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.568343 12172 consensus_queue.cc:260] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.568866 12172 ts_tablet_manager.cc:1428] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.570526 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5947ad4bff51429f8071075c8cdd8f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.570852 12172 tablet_bootstrap.cc:492] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.571167 12177 tablet_replica.cc:331] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.571307 12177 raft_consensus.cc:2241] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.571417 12177 raft_consensus.cc:2270] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.571934 12177 ts_tablet_manager.cc:1905] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.574219 12172 tablet_bootstrap.cc:654] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.574342 12177 ts_tablet_manager.cc:1918] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.574409 12177 log.cc:1199] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/54a59027aef04a12a0bf1fbece3c3161
I20250625 14:02:04.574637 12177 ts_tablet_manager.cc:1939] T 54a59027aef04a12a0bf1fbece3c3161 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.575275 12177 tablet_replica.cc:331] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.575439 12177 raft_consensus.cc:2241] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.575556 12177 raft_consensus.cc:2270] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.577638 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464e2c65420e41acbe47b30f24179cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.578202 12177 ts_tablet_manager.cc:1905] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.580448 12177 ts_tablet_manager.cc:1918] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.580528 12177 log.cc:1199] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/4317c3460f664f32aeb9b25ffb57d5bd
I20250625 14:02:04.580730 12177 ts_tablet_manager.cc:1939] T 4317c3460f664f32aeb9b25ffb57d5bd P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.581439 12177 tablet_replica.cc:331] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.581566 12177 raft_consensus.cc:2241] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.581657 12177 raft_consensus.cc:2270] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.582983 12024 tablet_service.cc:1468] Processing CreateTablet for tablet 30c1a61739e84e4aab5cc553bb3c6575 (DEFAULT_TABLE table=default.Table_70ef26dd935f494d9b67e97499efd65c [id=424a95f531024dba97b1cf8606272cfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.583318 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c1a61739e84e4aab5cc553bb3c6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.584535 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 12aeec6dd27b4807864685ebdf9bfdf5 (DEFAULT_TABLE table=default.Table_437396c20b3840f5baa9da089b395a38 [id=659b5a707a11410ea9232a3b431e46de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.584794 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12aeec6dd27b4807864685ebdf9bfdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.585292 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 4317c3460f664f32aeb9b25ffb57d5bd (table default.Table_02b107aff218434e8b66fde53ea34376 [id=db5d1d3ff141472b901e2930ccc829df]) successfully deleted
I20250625 14:02:04.585656 12033 tablet_service.cc:1468] Processing CreateTablet for tablet 1c7f541371be494ba77156c251c148b7 (DEFAULT_TABLE table=default.Table_d61d2d203bec435bb70dc93c563fd08f [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.585711 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7ff70668bede407c816db9779ce5221d (table default.Table_dab2b89c092c432f989c600f2f724b87 [id=f35c972d51bd4a3b9ea74dd70cad5913]) successfully deleted
I20250625 14:02:04.585873 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7f541371be494ba77156c251c148b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.586023 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet ce6e907d627f4f3e8219eaabe4373c6e (table default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]) successfully deleted
I20250625 14:02:04.587069 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 9d600f6cf7074b3ca4f0d73af6479357 (DEFAULT_TABLE table=default.Table_8beee31d79394da795ce06738a98e812 [id=85f8f5c2767a49e981a53d6b0f09f766]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.587296 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d600f6cf7074b3ca4f0d73af6479357. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.587981 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 8f515ef1e644499da3f2b197bcc8aba5 (DEFAULT_TABLE table=default.Table_d9db4adbbed242fdb6cf2b0bd4434cb3 [id=0a1d0dae9e6f4fc290a1697e123f7dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.588204 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f515ef1e644499da3f2b197bcc8aba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.590294 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 464e2c65420e41acbe47b30f24179cc2 (DEFAULT_TABLE table=default.Table_813f6ae0f07545babbab5dc4769bc1d3 [id=3feb568ca7a64303a034678506ff18ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.590525 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464e2c65420e41acbe47b30f24179cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.592680 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a7d87f5ca2f74eaeae12f1a6b533c12c
I20250625 14:02:04.592958 11530 catalog_manager.cc:6652] ReplaceTablet: tablet a7d87f5ca2f74eaeae12f1a6b533c12c deleted and replaced by tablet d36088153ec7485786fedf97d2287742
W20250625 14:02:04.593492 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 611afe6d28214382a538791e33a5ed78 consensus state has no leader
I20250625 14:02:04.594019 11532 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 95f2595593e049f1b9d7ccbd90c1cb86
I20250625 14:02:04.594388 13238 mvcc.cc:204] Tried to move back new op lower bound from 7171523069194182656 to 7171523067535450112. Current Snapshot: MvccSnapshot[applied={T|T < 7171523069194182656}]
I20250625 14:02:04.594955 13531 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20250625 14:02:04.597774 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet dff6358de0e4446e8dfc9465180ba395 because the tablet was not found. No further retry: Not found: Tablet not found: dff6358de0e4446e8dfc9465180ba395
I20250625 14:02:04.600468 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dc7fb5009dac47e582df7e883e7e1a36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.600922 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc7fb5009dac47e582df7e883e7e1a36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.601079 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 84a1eb4471544de9afbb5b35d0071dcc (table default.Table_89bc204107184f1aae8f924ca65ecd16 [id=f3af928f08964073b0314bfc509bf634]) successfully deleted
I20250625 14:02:04.601790 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bf2e234312fc4624a87a5c279976f86c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.601989 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_df2a1e2aa3314729b2ce06dc83366c30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.602161 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf2e234312fc4624a87a5c279976f86c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.602340 12175 raft_consensus.cc:2270] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:04.602383 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df2a1e2aa3314729b2ce06dc83366c30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.603292 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 3faa8782ba0d45dbbd89437685a64aef (table default.Table_f7ef8af8357846339868b61391e6199c [id=492a3d0d7a8e44a9a4e12606ef07a9fd]) successfully deleted
I20250625 14:02:04.503280 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c (DEFAULT_TABLE table=default.Table_4befcf9542e44983bb76073252702495 [id=d06aae4647ab45ddb1a646983cb48ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.603884 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.503692 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 929ed01b654b4aabb97c5db690a5f1f3 (DEFAULT_TABLE table=default.Table_8aaa44063346451f85e8a9b9742de378 [id=5083149497314b798d32d8cc76917b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.606704 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 929ed01b654b4aabb97c5db690a5f1f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:04.607838 13811 consensus_queue.cc:1162] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87a003e25dbf461ebec24a29ad7016ed" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:02:04.608582 12166 tablet_bootstrap.cc:492] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.608675 12166 ts_tablet_manager.cc:1397] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.246s user 0.002s sys 0.000s
I20250625 14:02:04.504099 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 5947ad4bff51429f8071075c8cdd8f34 (DEFAULT_TABLE table=default.Table_0edcafdd98474f9591d5f2c451b3775a [id=15e82c5d77e24a25b764d1f8757faa8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.609246 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5947ad4bff51429f8071075c8cdd8f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.609193 12166 raft_consensus.cc:357] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.609295 12166 raft_consensus.cc:383] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.609325 12166 raft_consensus.cc:738] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.609428 12166 consensus_queue.cc:260] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.609772 12166 ts_tablet_manager.cc:1428] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.609962 12166 tablet_bootstrap.cc:492] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.611141 12166 tablet_bootstrap.cc:654] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.544894 13532 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:04.582983 11902 tablet_service.cc:1468] Processing CreateTablet for tablet 30c1a61739e84e4aab5cc553bb3c6575 (DEFAULT_TABLE table=default.Table_70ef26dd935f494d9b67e97499efd65c [id=424a95f531024dba97b1cf8606272cfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.611903 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c1a61739e84e4aab5cc553bb3c6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.583602 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 1c7f541371be494ba77156c251c148b7 (DEFAULT_TABLE table=default.Table_d61d2d203bec435bb70dc93c563fd08f [id=50267944f4e24298b94151d9f1a1563f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.614250 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7f541371be494ba77156c251c148b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.583963 11889 tablet_service.cc:1468] Processing CreateTablet for tablet 8f515ef1e644499da3f2b197bcc8aba5 (DEFAULT_TABLE table=default.Table_d9db4adbbed242fdb6cf2b0bd4434cb3 [id=0a1d0dae9e6f4fc290a1697e123f7dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.584430 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 12aeec6dd27b4807864685ebdf9bfdf5 (DEFAULT_TABLE table=default.Table_437396c20b3840f5baa9da089b395a38 [id=659b5a707a11410ea9232a3b431e46de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.616627 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f515ef1e644499da3f2b197bcc8aba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.588603 13768 raft_consensus.cc:491] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.616727 13768 raft_consensus.cc:513] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.617156 13768 leader_election.cc:290] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:04.617187 13809 consensus_queue.cc:1162] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfff52620fea460d850827814b790c35" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:02:04.589061 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 9d600f6cf7074b3ca4f0d73af6479357 (DEFAULT_TABLE table=default.Table_8beee31d79394da795ce06738a98e812 [id=85f8f5c2767a49e981a53d6b0f09f766]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.589109 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 464e2c65420e41acbe47b30f24179cc2 (DEFAULT_TABLE table=default.Table_813f6ae0f07545babbab5dc4769bc1d3 [id=3feb568ca7a64303a034678506ff18ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.617808 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d600f6cf7074b3ca4f0d73af6479357. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.617985 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464e2c65420e41acbe47b30f24179cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.619814 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12aeec6dd27b4807864685ebdf9bfdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.620098 13532 tablet.cc:1722] T 288e0c1644a34b8dabc06ccdda9f0fa9 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:04.620491 12175 ts_tablet_manager.cc:1905] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:04.622607 11858 leader_election.cc:343] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: f2576ff766494c37b316552a66a5ff31
W20250625 14:02:04.625017 11855 leader_election.cc:343] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: f2576ff766494c37b316552a66a5ff31
I20250625 14:02:04.625104 11855 leader_election.cc:304] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:04.625288 13768 raft_consensus.cc:2747] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.626653 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_0338ff3edcae43938f90540b34370738"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.627101 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0338ff3edcae43938f90540b34370738 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.627313 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 54a59027aef04a12a0bf1fbece3c3161 (table default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]) successfully deleted
I20250625 14:02:04.627951 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 4317c3460f664f32aeb9b25ffb57d5bd (table default.Table_02b107aff218434e8b66fde53ea34376 [id=db5d1d3ff141472b901e2930ccc829df]) successfully deleted
W20250625 14:02:04.628290 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 50f55f37173246bc8dab611f5d28c24e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50f55f37173246bc8dab611f5d28c24e already in progress: creating tablet
W20250625 14:02:04.628602 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 990d03f434044571aa2b61577495ab77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 990d03f434044571aa2b61577495ab77 already in progress: creating tablet
I20250625 14:02:04.631305 12173 ts_tablet_manager.cc:1905] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.631364 12167 tablet_bootstrap.cc:492] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.631454 12167 ts_tablet_manager.cc:1397] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.223s user 0.000s sys 0.002s
I20250625 14:02:04.631951 12167 raft_consensus.cc:357] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.632063 12167 raft_consensus.cc:383] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.632097 12167 raft_consensus.cc:738] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.632227 12167 consensus_queue.cc:260] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.632515 12167 ts_tablet_manager.cc:1428] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:04.632681 12167 tablet_bootstrap.cc:492] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.633553 12167 tablet_bootstrap.cc:654] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.633783 12173 ts_tablet_manager.cc:1918] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:04.633850 12173 log.cc:1199] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/54a59027aef04a12a0bf1fbece3c3161
I20250625 14:02:04.634122 12173 ts_tablet_manager.cc:1939] T 54a59027aef04a12a0bf1fbece3c3161 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.634524 13768 raft_consensus.cc:491] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.634621 13768 raft_consensus.cc:513] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.635040 13768 leader_election.cc:290] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:04.635403 13334 raft_consensus.cc:491] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.635504 13334 raft_consensus.cc:513] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.635874 13334 leader_election.cc:290] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.636543 11748 tablet_service.cc:1515] Processing DeleteTablet for tablet a7d87f5ca2f74eaeae12f1a6b533c12c with delete_type TABLET_DATA_DELETED (replaced by tablet d36088153ec7485786fedf97d2287742) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.636982 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b9a788be0b8640dc9d6d06fa86580f6b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.637118 12042 raft_consensus.cc:2466] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:04.637598 12177 ts_tablet_manager.cc:1905] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.638785 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b9a788be0b8640dc9d6d06fa86580f6b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:04.639358 11858 leader_election.cc:343] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 806e5502a95e4a0396c008267e16f2d5
I20250625 14:02:04.639606 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet a7d87f5ca2f74eaeae12f1a6b533c12c with delete_type TABLET_DATA_DELETED (replaced by tablet d36088153ec7485786fedf97d2287742) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.639691 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet b6318e27fb194a209c1c80ffcaf24a64 with delete_type TABLET_DATA_DELETED (replaced by tablet 73a40d0ee5034aaea24684739c3f5154) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.640734 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet a7d87f5ca2f74eaeae12f1a6b533c12c with delete_type TABLET_DATA_DELETED (replaced by tablet d36088153ec7485786fedf97d2287742) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.641713 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 54a59027aef04a12a0bf1fbece3c3161 (table default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]) successfully deleted
W20250625 14:02:04.642757 11717 leader_election.cc:343] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:04.646986 11855 leader_election.cc:343] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 806e5502a95e4a0396c008267e16f2d5
I20250625 14:02:04.647080 11855 leader_election.cc:304] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:04.647233 13788 raft_consensus.cc:2747] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.647558 11717 leader_election.cc:304] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.648103 11969 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:04.648111 13334 raft_consensus.cc:2802] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.648164 13334 raft_consensus.cc:491] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.648213 13334 raft_consensus.cc:3058] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.648980 12172 tablet_bootstrap.cc:492] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.649071 12172 ts_tablet_manager.cc:1397] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.000s
I20250625 14:02:04.649151 13334 raft_consensus.cc:513] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.649514 13334 leader_election.cc:290] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.649592 12172 raft_consensus.cc:357] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.649703 12172 raft_consensus.cc:383] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.649739 12172 raft_consensus.cc:738] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.650182 12173 tablet_replica.cc:331] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.650363 12173 raft_consensus.cc:2241] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.650480 12173 raft_consensus.cc:2270] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.650915 12173 ts_tablet_manager.cc:1905] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.649864 12172 consensus_queue.cc:260] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.652493 12172 ts_tablet_manager.cc:1428] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:04.652727 12172 tablet_bootstrap.cc:492] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.654285 12172 tablet_bootstrap.cc:654] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.655395 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bb93358ba0104c5bad3e7eba35962030
I20250625 14:02:04.655978 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_009d6f19fc88401bb89b017cea240a2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.656436 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e98a2085fe67479db141b2675f69a2d9
I20250625 14:02:04.656723 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a5fc3132af7544519819617719f71e77" } new_table_name: "default.Table_ce207d86e10b457089caedc1452d8318" modify_external_catalogs: true
I20250625 14:02:04.656961 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_55a7a183514a4c8fb0bccc8ee4751b96" } new_table_name: "default.Table_c7701905b82f45ff9d39814905b5e248" modify_external_catalogs: true
I20250625 14:02:04.657006 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a89682235f934b91a058bfd43e3b54b2" } modify_external_catalogs: true
I20250625 14:02:04.657092 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a89682235f934b91a058bfd43e3b54b2" } modify_external_catalogs: true
W20250625 14:02:04.657593 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_009d6f19fc88401bb89b017cea240a2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.657898 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8578d07c9b4a44f887b5a30e92c1ede9
I20250625 14:02:04.658349 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_21b55de037b74cc69101bc65ec02bb76" } new_table_name: "default.Table_88e1a1caf12b4d52b97e8f08d34ffae6" modify_external_catalogs: true
I20250625 14:02:04.659233 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3a4a0b60b9a1494cbf2f7a7dbfcd09de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.659560 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a4a0b60b9a1494cbf2f7a7dbfcd09de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.661268 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet bb93358ba0104c5bad3e7eba35962030 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.661428 12175 ts_tablet_manager.cc:1918] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:04.661504 12175 log.cc:1199] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/ce6e907d627f4f3e8219eaabe4373c6e
I20250625 14:02:04.661779 12175 ts_tablet_manager.cc:1939] T ce6e907d627f4f3e8219eaabe4373c6e P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:04.663360 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 8578d07c9b4a44f887b5a30e92c1ede9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.663306 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b9a788be0b8640dc9d6d06fa86580f6b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.663939 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet e98a2085fe67479db141b2675f69a2d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.664149 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 8578d07c9b4a44f887b5a30e92c1ede9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.664640 12021 tablet_service.cc:1515] Processing DeleteTablet for tablet e98a2085fe67479db141b2675f69a2d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.664837 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet bb93358ba0104c5bad3e7eba35962030 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.668532 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b9a788be0b8640dc9d6d06fa86580f6b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:04.668746 12056 raft_consensus.cc:3058] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.670006 12056 raft_consensus.cc:2466] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
W20250625 14:02:04.671099 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0357aab4556d46d9b4d89e7da15ecea1 consensus state has no leader
I20250625 14:02:04.671399 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_51796cf165e2492ebc3cdb05a3e84807"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.671828 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51796cf165e2492ebc3cdb05a3e84807 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.672056 12173 ts_tablet_manager.cc:1918] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.672012 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ab0e5c75bb46419a8f85de1bfa8a6c64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.672122 12173 log.cc:1199] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b6318e27fb194a209c1c80ffcaf24a64
I20250625 14:02:04.672349 12173 ts_tablet_manager.cc:1939] T b6318e27fb194a209c1c80ffcaf24a64 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:04.672356 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab0e5c75bb46419a8f85de1bfa8a6c64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.673014 12173 tablet_replica.cc:331] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:02:04.673005 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86d1b58fd1a9483b9ead08a55e3b1e63 consensus state has no leader
I20250625 14:02:04.663223 13334 raft_consensus.cc:491] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.673149 12173 raft_consensus.cc:2241] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.673154 13334 raft_consensus.cc:513] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.673276 12173 raft_consensus.cc:2270] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.673553 13334 leader_election.cc:290] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.673655 12173 ts_tablet_manager.cc:1905] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.673774 13121 raft_consensus.cc:491] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.673851 13121 raft_consensus.cc:513] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:04.673944 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dfbf6959677547a6a2582b73b2be4c03 consensus state has no leader
I20250625 14:02:04.674197 13121 leader_election.cc:290] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.674938 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fd261d824c34864a7b15e4736254062" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:04.676172 11990 leader_election.cc:343] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.663353 11748 tablet_service.cc:1515] Processing DeleteTablet for tablet bb93358ba0104c5bad3e7eba35962030 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.664851 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet e98a2085fe67479db141b2675f69a2d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.665206 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 8578d07c9b4a44f887b5a30e92c1ede9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.682444 12173 ts_tablet_manager.cc:1918] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:04.686131 12173 log.cc:1199] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/169c59b473bd425296fa5bd9bbf2b616
I20250625 14:02:04.686623 12173 ts_tablet_manager.cc:1939] T 169c59b473bd425296fa5bd9bbf2b616 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.688217 12172 tablet_bootstrap.cc:492] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.688395 12172 ts_tablet_manager.cc:1397] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:02:04.688977 12172 raft_consensus.cc:357] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.689181 12172 raft_consensus.cc:383] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.689260 12172 raft_consensus.cc:738] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.689559 12172 consensus_queue.cc:260] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.689950 12172 ts_tablet_manager.cc:1428] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.690191 12172 tablet_bootstrap.cc:492] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:04.669237 11717 leader_election.cc:343] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.691752 12172 tablet_bootstrap.cc:654] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.692021 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b6318e27fb194a209c1c80ffcaf24a64 (table default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]) successfully deleted
I20250625 14:02:04.692866 12173 tablet_replica.cc:331] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.693089 12173 raft_consensus.cc:2241] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.693259 12173 raft_consensus.cc:2270] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.693953 12172 tablet_bootstrap.cc:492] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.694036 12172 ts_tablet_manager.cc:1397] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:04.694526 12172 raft_consensus.cc:357] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.694620 12172 raft_consensus.cc:383] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.694648 12172 raft_consensus.cc:738] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.694912 12172 consensus_queue.cc:260] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.695035 12166 tablet_bootstrap.cc:492] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.695140 12166 ts_tablet_manager.cc:1397] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.085s user 0.002s sys 0.000s
I20250625 14:02:04.695286 12172 ts_tablet_manager.cc:1428] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.695291 12173 ts_tablet_manager.cc:1905] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.695454 12172 tablet_bootstrap.cc:492] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.695608 12166 raft_consensus.cc:357] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.695710 12166 raft_consensus.cc:383] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.695739 12166 raft_consensus.cc:738] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.695861 12166 consensus_queue.cc:260] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.696148 12166 ts_tablet_manager.cc:1428] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.696324 12166 tablet_bootstrap.cc:492] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.696529 12172 tablet_bootstrap.cc:654] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.697227 12166 tablet_bootstrap.cc:654] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.697526 12172 tablet_bootstrap.cc:492] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.697594 12172 ts_tablet_manager.cc:1397] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:02:04.698058 12172 raft_consensus.cc:357] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.698156 12172 raft_consensus.cc:383] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.698187 12172 raft_consensus.cc:738] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.698280 12172 consensus_queue.cc:260] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.698531 12173 ts_tablet_manager.cc:1918] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.698568 12172 ts_tablet_manager.cc:1428] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.698599 12173 log.cc:1199] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b9a788be0b8640dc9d6d06fa86580f6b
I20250625 14:02:04.698726 12172 tablet_bootstrap.cc:492] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.698807 12173 ts_tablet_manager.cc:1939] T b9a788be0b8640dc9d6d06fa86580f6b P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.699397 12173 tablet_replica.cc:331] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.699518 12173 raft_consensus.cc:2241] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.699607 12173 raft_consensus.cc:2270] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.692507 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet d7d225545467475d9d656f5354585aa0 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.699704 12172 tablet_bootstrap.cc:654] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.700588 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae093ced6ff4255b75f634701ed259b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.700623 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 169c59b473bd425296fa5bd9bbf2b616 (table default.Table_4ec4dd190f674ee68c6d9f99ab1e94d0 [id=f8e4990b036541f1b033de99bff1accc]) successfully deleted
I20250625 14:02:04.700709 12056 raft_consensus.cc:2466] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:02:04.700783 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d015e28856e849898287bf4fd19626c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d015e28856e849898287bf4fd19626c3 already in progress: creating tablet
W20250625 14:02:04.700878 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet c68e055191704da8862b0fe6b30bfcfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c68e055191704da8862b0fe6b30bfcfc already in progress: creating tablet
I20250625 14:02:04.702620 12175 tablet_replica.cc:331] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:04.702775 12175 raft_consensus.cc:2241] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.702893 12175 raft_consensus.cc:2270] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.703140 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae093ced6ff4255b75f634701ed259b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.703497 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 38ed475ff22e49d6b6962c7c0cd621de from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.703114 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "1fd261d824c34864a7b15e4736254062" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.703766 11784 raft_consensus.cc:2466] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:04.703934 12173 ts_tablet_manager.cc:1905] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.702298 12177 ts_tablet_manager.cc:1918] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.704236 12177 log.cc:1199] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/0f6c287461864f6dba5f47711eb69fae
I20250625 14:02:04.705940 12167 tablet_bootstrap.cc:492] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.706041 12167 ts_tablet_manager.cc:1397] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.001s
I20250625 14:02:04.706625 12167 raft_consensus.cc:357] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.706727 12167 raft_consensus.cc:383] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.706755 12167 raft_consensus.cc:738] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.706856 12173 ts_tablet_manager.cc:1918] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.706934 12173 log.cc:1199] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/1fd261d824c34864a7b15e4736254062
I20250625 14:02:04.706876 12167 consensus_queue.cc:260] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.707165 12173 ts_tablet_manager.cc:1939] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.707412 12167 ts_tablet_manager.cc:1428] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.707629 12167 tablet_bootstrap.cc:492] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.707738 12173 tablet_replica.cc:331] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.707878 12173 raft_consensus.cc:2241] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.708001 12173 pending_rounds.cc:70] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:04.708020 12173 pending_rounds.cc:77] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523069192126464 op_type: NO_OP noop_request { }
I20250625 14:02:04.708057 12173 raft_consensus.cc:2887] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:04.708091 12173 raft_consensus.cc:2270] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.708534 12173 ts_tablet_manager.cc:1905] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.708959 12167 tablet_bootstrap.cc:654] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.709868 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 600c108480fb45e18f8004aea752f233 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.710244 12167 tablet_bootstrap.cc:492] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.710346 12167 ts_tablet_manager.cc:1397] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:04.710429 12173 ts_tablet_manager.cc:1918] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:04.710615 12173 log.cc:1199] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/3faa8782ba0d45dbbd89437685a64aef
I20250625 14:02:04.710876 12173 ts_tablet_manager.cc:1939] T 3faa8782ba0d45dbbd89437685a64aef P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.710906 12167 raft_consensus.cc:357] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.711017 12167 raft_consensus.cc:383] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.711055 12167 raft_consensus.cc:738] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.711265 12167 consensus_queue.cc:260] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.711633 12167 ts_tablet_manager.cc:1428] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.711856 12167 tablet_bootstrap.cc:492] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.711898 12173 tablet_replica.cc:331] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.712064 12173 raft_consensus.cc:2241] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.712182 12173 raft_consensus.cc:2270] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.712566 12173 ts_tablet_manager.cc:1905] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.712989 12167 tablet_bootstrap.cc:654] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.714184 12175 ts_tablet_manager.cc:1905] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.714721 12173 ts_tablet_manager.cc:1918] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.714860 12173 log.cc:1199] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/0f6c287461864f6dba5f47711eb69fae
I20250625 14:02:04.715095 12173 ts_tablet_manager.cc:1939] T 0f6c287461864f6dba5f47711eb69fae P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.716143 12173 tablet_replica.cc:331] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.716295 12173 raft_consensus.cc:2241] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.716713 12173 raft_consensus.cc:2270] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.716805 12175 ts_tablet_manager.cc:1918] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.716902 12175 log.cc:1199] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/806e5502a95e4a0396c008267e16f2d5
I20250625 14:02:04.717048 12167 tablet_bootstrap.cc:492] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.717128 12175 ts_tablet_manager.cc:1939] T 806e5502a95e4a0396c008267e16f2d5 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:04.717173 12167 ts_tablet_manager.cc:1397] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:04.717554 12173 ts_tablet_manager.cc:1905] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.717691 12167 raft_consensus.cc:357] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.717829 12167 raft_consensus.cc:383] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.717903 12167 raft_consensus.cc:738] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.718070 12167 consensus_queue.cc:260] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.718449 12167 ts_tablet_manager.cc:1428] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.718675 12167 tablet_bootstrap.cc:492] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.722522 12167 tablet_bootstrap.cc:654] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.723369 12104 heartbeater.cc:344] Connected to a master server at 127.11.39.190:38199
I20250625 14:02:04.721877 11918 raft_consensus.cc:3058] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.735076 12177 ts_tablet_manager.cc:1939] T 0f6c287461864f6dba5f47711eb69fae P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.730686 12166 tablet_bootstrap.cc:492] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.735610 12177 tablet_replica.cc:331] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.735659 12166 ts_tablet_manager.cc:1397] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20250625 14:02:04.735751 12177 raft_consensus.cc:2241] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.735918 13121 consensus_queue.cc:1035] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.736263 12166 raft_consensus.cc:357] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.736377 12166 raft_consensus.cc:383] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.736413 12166 raft_consensus.cc:738] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.736548 12166 consensus_queue.cc:260] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.736871 12166 ts_tablet_manager.cc:1428] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.737097 12166 tablet_bootstrap.cc:492] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.737373 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 063a910b914144938ffd7c6bac8c899b (DEFAULT_TABLE table=default.Table_bc0e4c79bfa64b45bb0f39f20012635e [id=a2f01b89ef8a45c4b2f9780578d88480]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.704146 11717 leader_election.cc:304] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.707396 12172 tablet_bootstrap.cc:492] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.737838 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063a910b914144938ffd7c6bac8c899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.737915 12172 ts_tablet_manager.cc:1397] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20250625 14:02:04.738049 11717 leader_election.cc:304] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.738216 12166 tablet_bootstrap.cc:654] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.706676 13334 raft_consensus.cc:491] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.738412 11993 leader_election.cc:304] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.738380 13334 raft_consensus.cc:513] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.738461 12172 raft_consensus.cc:357] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:04.738507 11993 raft_consensus.cc:2684] T 1fd261d824c34864a7b15e4736254062 P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:04.738529 12172 raft_consensus.cc:383] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.738557 12172 raft_consensus.cc:738] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.738662 12172 consensus_queue.cc:260] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.738742 13334 leader_election.cc:290] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:04.738818 13334 raft_consensus.cc:2802] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.738867 13334 raft_consensus.cc:695] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:04.738951 12172 ts_tablet_manager.cc:1428] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.738994 13334 consensus_queue.cc:237] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.739113 12172 tablet_bootstrap.cc:492] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.739579 13334 raft_consensus.cc:2802] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.739634 13334 raft_consensus.cc:491] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.739671 13334 raft_consensus.cc:3058] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.740094 12172 tablet_bootstrap.cc:654] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.740756 13334 raft_consensus.cc:513] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.741091 13334 leader_election.cc:290] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.741744 12036 tablet_service.cc:1468] Processing CreateTablet for tablet b2a3c060efaf4419a3c6907af0d34019 (DEFAULT_TABLE table=default.Table_4f41fddb9c5143f5ad20fe27c41a90b2 [id=d3e76f20490845ef9353cda8545cc91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.741842 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 063a910b914144938ffd7c6bac8c899b (DEFAULT_TABLE table=default.Table_bc0e4c79bfa64b45bb0f39f20012635e [id=a2f01b89ef8a45c4b2f9780578d88480]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.741990 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a3c060efaf4419a3c6907af0d34019. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.742082 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063a910b914144938ffd7c6bac8c899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.743875 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 2aa5f96083d642188766b420002198b9 (DEFAULT_TABLE table=default.Table_39a01bfa58794952934eb2fb8b889b0f [id=e194dfa91e654ad49af8b78e46583838]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.744462 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa5f96083d642188766b420002198b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.745488 11530 master_service.cc:948] ReplaceTablet: received request to replace tablet 0f3c5e4b77724849ab5703f84775e370 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.746977 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b9a788be0b8640dc9d6d06fa86580f6b (table default.Table_3ef297edd2b74ada8037c6bc3018ccb8 [id=3fb5b2ae009c4365812e750040fa0b97]) successfully deleted
I20250625 14:02:04.747053 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 5ecae25fa8e74a25a3d99ff300c0394d (DEFAULT_TABLE table=default.Table_a6544a9b408946abb14fab1114bee055 [id=9bffb66ff18349fe8112fff32e021fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.747110 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 1fd261d824c34864a7b15e4736254062 (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
I20250625 14:02:04.747218 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 3faa8782ba0d45dbbd89437685a64aef (table default.Table_f7ef8af8357846339868b61391e6199c [id=492a3d0d7a8e44a9a4e12606ef07a9fd]) successfully deleted
I20250625 14:02:04.747262 12033 tablet_service.cc:1468] Processing CreateTablet for tablet dfdf0c6576c240e2956d75e7089f34e6 (DEFAULT_TABLE table=default.Table_10e6a1ed964b487bbdfb6aa6815225f0 [id=73b8340cf7be45c78907d74b03bebaa4]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:04.747328 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 990d03f434044571aa2b61577495ab77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 990d03f434044571aa2b61577495ab77 already in progress: creating tablet
W20250625 14:02:04.747418 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 50f55f37173246bc8dab611f5d28c24e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50f55f37173246bc8dab611f5d28c24e already in progress: creating tablet
I20250625 14:02:04.747489 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 0f6c287461864f6dba5f47711eb69fae (table default.Table_8b6663de9f0f48ea92b610c69d981c0f [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]) successfully deleted
W20250625 14:02:04.747573 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a7d87f5ca2f74eaeae12f1a6b533c12c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7d87f5ca2f74eaeae12f1a6b533c12c already in progress: creating tablet
W20250625 14:02:04.747650 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet bb93358ba0104c5bad3e7eba35962030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb93358ba0104c5bad3e7eba35962030 already in progress: creating tablet
I20250625 14:02:04.747632 12024 tablet_service.cc:1468] Processing CreateTablet for tablet a4fb02efa02348efa206d7c923fdea8f (DEFAULT_TABLE table=default.Table_c72a257dcdec4555bf5a1e1d706936c5 [id=6d96e32082dc4352b7b5164d6501bcdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.747817 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet ce6e907d627f4f3e8219eaabe4373c6e (table default.Table_91d863c5798a413a87bfb07793e23653 [id=29e750f2b74b4d67bab90a78c61c84b4]) successfully deleted
I20250625 14:02:04.747928 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 806e5502a95e4a0396c008267e16f2d5 (table default.Table_2c2b195f74a64e3990919d0efcb9e1ac [id=2b820ab8a4944bdd9b3e272975715817]) successfully deleted
I20250625 14:02:04.747993 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 0b6f99eebcd04986a08acc903983d98b (DEFAULT_TABLE table=default.Table_9b41aea39b8742708a9383406513993b [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.748131 12021 tablet_service.cc:1468] Processing CreateTablet for tablet fb92588d24a24b3c9dd8cfd1af1501a6 (DEFAULT_TABLE table=default.Table_a6560277272a410bb47de244e2adc6c7 [id=36f03bf8596c48dd8c48656b25fb2a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.748361 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 49ea64f543dc4d2c855661ac48127298 (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.748637 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 54a59027aef04a12a0bf1fbece3c3161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.748716 12037 tablet_service.cc:1468] Processing CreateTablet for tablet e0266a8bcf0146a194ebabcba39ec94f (DEFAULT_TABLE table=default.Table_44c950a6e31d446ea2653489dca5a188 [id=61d9f7de49e64cb4a476cddc59bade71]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.748853 11901 tablet_service.cc:1468] Processing CreateTablet for tablet 617782664e1547288a3b361bf8471d12 (DEFAULT_TABLE table=default.Table_803deaef2bc34cf3ae96731d810e19e4 [id=a567d4195a6c46b08a4de0fdf34db0e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.749146 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617782664e1547288a3b361bf8471d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.749722 11899 tablet_service.cc:1468] Processing CreateTablet for tablet b2a3c060efaf4419a3c6907af0d34019 (DEFAULT_TABLE table=default.Table_4f41fddb9c5143f5ad20fe27c41a90b2 [id=d3e76f20490845ef9353cda8545cc91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.750536 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet b08135db764c4eb286d5f67ccba94ed5 (table default.Table_39f38f3fc23e425f87d7ae5fdbf08233 [id=44f2f74bfee54c72b3dee93db46b35e5]). Expected version 4 got 3
I20250625 14:02:04.750650 11524 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:04.750691 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 5ecae25fa8e74a25a3d99ff300c0394d (DEFAULT_TABLE table=default.Table_a6544a9b408946abb14fab1114bee055 [id=9bffb66ff18349fe8112fff32e021fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.750828 11900 tablet_service.cc:1468] Processing CreateTablet for tablet dfdf0c6576c240e2956d75e7089f34e6 (DEFAULT_TABLE table=default.Table_10e6a1ed964b487bbdfb6aa6815225f0 [id=73b8340cf7be45c78907d74b03bebaa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.748853 11889 tablet_service.cc:1468] Processing CreateTablet for tablet fb92588d24a24b3c9dd8cfd1af1501a6 (DEFAULT_TABLE table=default.Table_a6560277272a410bb47de244e2adc6c7 [id=36f03bf8596c48dd8c48656b25fb2a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.751091 11902 tablet_service.cc:1468] Processing CreateTablet for tablet a4fb02efa02348efa206d7c923fdea8f (DEFAULT_TABLE table=default.Table_c72a257dcdec4555bf5a1e1d706936c5 [id=6d96e32082dc4352b7b5164d6501bcdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.751305 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fb02efa02348efa206d7c923fdea8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:04.751360 11524 catalog_manager.cc:5774] Failed to send AlterTable RPC for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 7160c6353e2d48d8a5d5a71563797051 consensus state has no leader
I20250625 14:02:04.751763 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 0b6f99eebcd04986a08acc903983d98b (DEFAULT_TABLE table=default.Table_9b41aea39b8742708a9383406513993b [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.751844 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 2aa5f96083d642188766b420002198b9 (DEFAULT_TABLE table=default.Table_39a01bfa58794952934eb2fb8b889b0f [id=e194dfa91e654ad49af8b78e46583838]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.752060 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecae25fa8e74a25a3d99ff300c0394d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.752172 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 49ea64f543dc4d2c855661ac48127298 (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.752367 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb92588d24a24b3c9dd8cfd1af1501a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.752525 11891 tablet_service.cc:1468] Processing CreateTablet for tablet e0266a8bcf0146a194ebabcba39ec94f (DEFAULT_TABLE table=default.Table_44c950a6e31d446ea2653489dca5a188 [id=61d9f7de49e64cb4a476cddc59bade71]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.752637 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdf0c6576c240e2956d75e7089f34e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.747277 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecae25fa8e74a25a3d99ff300c0394d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.753631 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a3c060efaf4419a3c6907af0d34019. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.753859 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb92588d24a24b3c9dd8cfd1af1501a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.755241 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ea64f543dc4d2c855661ac48127298. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.755571 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0266a8bcf0146a194ebabcba39ec94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.755674 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0266a8bcf0146a194ebabcba39ec94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.755836 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6f99eebcd04986a08acc903983d98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.756142 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa5f96083d642188766b420002198b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.757558 11524 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:04.757862 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fb02efa02348efa206d7c923fdea8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.759936 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdf0c6576c240e2956d75e7089f34e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.762195 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ea64f543dc4d2c855661ac48127298. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.763044 12175 tablet_replica.cc:331] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:04.763212 12175 raft_consensus.cc:2241] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.763334 12175 raft_consensus.cc:2270] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.763770 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 0f6c287461864f6dba5f47711eb69fae (table default.Table_8b6663de9f0f48ea92b610c69d981c0f [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]) successfully deleted
W20250625 14:02:04.764130 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a7d87f5ca2f74eaeae12f1a6b533c12c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7d87f5ca2f74eaeae12f1a6b533c12c already in progress: creating tablet
I20250625 14:02:04.764480 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6f99eebcd04986a08acc903983d98b. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:04.764475 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet bb93358ba0104c5bad3e7eba35962030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb93358ba0104c5bad3e7eba35962030 already in progress: creating tablet
I20250625 14:02:04.764555 13121 consensus_queue.cc:1035] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:04.765046 13334 raft_consensus.cc:491] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.765084 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 063a910b914144938ffd7c6bac8c899b (DEFAULT_TABLE table=default.Table_bc0e4c79bfa64b45bb0f39f20012635e [id=a2f01b89ef8a45c4b2f9780578d88480]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.765141 13334 raft_consensus.cc:513] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.765352 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063a910b914144938ffd7c6bac8c899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.765496 13334 leader_election.cc:290] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:04.767565 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 617782664e1547288a3b361bf8471d12 (DEFAULT_TABLE table=default.Table_803deaef2bc34cf3ae96731d810e19e4 [id=a567d4195a6c46b08a4de0fdf34db0e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.767884 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617782664e1547288a3b361bf8471d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.768141 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.768357 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.768517 11749 tablet_service.cc:1468] Processing CreateTablet for tablet b2a3c060efaf4419a3c6907af0d34019 (DEFAULT_TABLE table=default.Table_4f41fddb9c5143f5ad20fe27c41a90b2 [id=d3e76f20490845ef9353cda8545cc91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.768677 11745 tablet_service.cc:1468] Processing CreateTablet for tablet 617782664e1547288a3b361bf8471d12 (DEFAULT_TABLE table=default.Table_803deaef2bc34cf3ae96731d810e19e4 [id=a567d4195a6c46b08a4de0fdf34db0e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.768774 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a3c060efaf4419a3c6907af0d34019. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.768918 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617782664e1547288a3b361bf8471d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.769471 11762 tablet_service.cc:1468] Processing CreateTablet for tablet fb92588d24a24b3c9dd8cfd1af1501a6 (DEFAULT_TABLE table=default.Table_a6560277272a410bb47de244e2adc6c7 [id=36f03bf8596c48dd8c48656b25fb2a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.769698 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb92588d24a24b3c9dd8cfd1af1501a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.769959 11761 tablet_service.cc:1468] Processing CreateTablet for tablet 2aa5f96083d642188766b420002198b9 (DEFAULT_TABLE table=default.Table_39a01bfa58794952934eb2fb8b889b0f [id=e194dfa91e654ad49af8b78e46583838]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.770152 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aa5f96083d642188766b420002198b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.772147 11762 tablet_service.cc:1468] Processing CreateTablet for tablet dfdf0c6576c240e2956d75e7089f34e6 (DEFAULT_TABLE table=default.Table_10e6a1ed964b487bbdfb6aa6815225f0 [id=73b8340cf7be45c78907d74b03bebaa4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.772189 11745 tablet_service.cc:1468] Processing CreateTablet for tablet 5ecae25fa8e74a25a3d99ff300c0394d (DEFAULT_TABLE table=default.Table_a6544a9b408946abb14fab1114bee055 [id=9bffb66ff18349fe8112fff32e021fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.772392 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdf0c6576c240e2956d75e7089f34e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.772637 11754 tablet_service.cc:1468] Processing CreateTablet for tablet 49ea64f543dc4d2c855661ac48127298 (DEFAULT_TABLE table=default.Table_056ad2bdca0a4a0bbd86417dcb233492 [id=5a045b419e8d4d22bb154493eb35d417]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.772971 11750 tablet_service.cc:1468] Processing CreateTablet for tablet e0266a8bcf0146a194ebabcba39ec94f (DEFAULT_TABLE table=default.Table_44c950a6e31d446ea2653489dca5a188 [id=61d9f7de49e64cb4a476cddc59bade71]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:04.773159 11717 leader_election.cc:343] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.774062 11916 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae093ced6ff4255b75f634701ed259b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.774231 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7160c6353e2d48d8a5d5a71563797051" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.774361 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfbf6959677547a6a2582b73b2be4c03" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.774446 11747 tablet_service.cc:1468] Processing CreateTablet for tablet 0b6f99eebcd04986a08acc903983d98b (DEFAULT_TABLE table=default.Table_9b41aea39b8742708a9383406513993b [id=f64f7d5b36ce42b39034f4439346303e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.775370 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfbf6959677547a6a2582b73b2be4c03" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.775508 12056 raft_consensus.cc:2466] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:04.775699 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae093ced6ff4255b75f634701ed259b" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:04.775807 12047 raft_consensus.cc:3058] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.775947 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ea64f543dc4d2c855661ac48127298. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.776876 12047 raft_consensus.cc:2466] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:04.775507 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7160c6353e2d48d8a5d5a71563797051" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.777133 12042 raft_consensus.cc:2466] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:04.777544 11761 tablet_service.cc:1468] Processing CreateTablet for tablet a4fb02efa02348efa206d7c923fdea8f (DEFAULT_TABLE table=default.Table_c72a257dcdec4555bf5a1e1d706936c5 [id=6d96e32082dc4352b7b5164d6501bcdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.777642 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecae25fa8e74a25a3d99ff300c0394d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.777765 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fb02efa02348efa206d7c923fdea8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.781056 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0266a8bcf0146a194ebabcba39ec94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.783247 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6f99eebcd04986a08acc903983d98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.784463 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 600c108480fb45e18f8004aea752f233
I20250625 14:02:04.784523 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 7376f9dc4c8d4ed0a539eceead2a9a23
I20250625 14:02:04.784787 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 600c108480fb45e18f8004aea752f233 deleted and replaced by tablet 0afd4fac76cb4424af7bfc1c89add7f0
I20250625 14:02:04.785009 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 38ed475ff22e49d6b6962c7c0cd621de
I20250625 14:02:04.785293 11532 catalog_manager.cc:6652] ReplaceTablet: tablet 38ed475ff22e49d6b6962c7c0cd621de deleted and replaced by tablet 6f0cc665cb164feaa1e52ee48796e22f
I20250625 14:02:04.787724 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (table default.Table_88e1a1caf12b4d52b97e8f08d34ffae6 [id=1f4a03c6bde742a581596005b19a818f]). Expected version 1 got 0
I20250625 14:02:04.787827 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:04.787925 11525 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet edc5b7cc92564ba4ad04f68e18b56dfe (table default.Table_84156ec483954d3eb4f9a7f57244204c [id=205b876e2e7a4f54bbddec9150d67e0a]). Expected version 1 got 0
I20250625 14:02:04.789155 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:04.789592 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 3faa8782ba0d45dbbd89437685a64aef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.789986 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 600c108480fb45e18f8004aea752f233 with delete_type TABLET_DATA_DELETED (replaced by tablet 0afd4fac76cb4424af7bfc1c89add7f0) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.790392 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.791878 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 38ed475ff22e49d6b6962c7c0cd621de with delete_type TABLET_DATA_DELETED (replaced by tablet 6f0cc665cb164feaa1e52ee48796e22f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.793864 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 600c108480fb45e18f8004aea752f233 with delete_type TABLET_DATA_DELETED (replaced by tablet 0afd4fac76cb4424af7bfc1c89add7f0) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.793776 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.794042 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 38ed475ff22e49d6b6962c7c0cd621de with delete_type TABLET_DATA_DELETED (replaced by tablet 6f0cc665cb164feaa1e52ee48796e22f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.794042 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.794283 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bf7d2d7ae6fa49baba4eef521b8edb05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.794770 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf7d2d7ae6fa49baba4eef521b8edb05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.795692 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bd001e13c0144ddcbdd8ce1d81d37596" } modify_external_catalogs: true
I20250625 14:02:04.795665 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e6988886a56842e8a8a59aeae0d70913"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.795802 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bd001e13c0144ddcbdd8ce1d81d37596" } modify_external_catalogs: true
I20250625 14:02:04.796108 11717 leader_election.cc:304] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
W20250625 14:02:04.796507 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6988886a56842e8a8a59aeae0d70913 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.796725 13835 raft_consensus.cc:491] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.796823 13835 raft_consensus.cc:513] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.797621 13835 leader_election.cc:290] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:04.798086 11858 leader_election.cc:343] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 54a59027aef04a12a0bf1fbece3c3161
I20250625 14:02:04.798210 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_84156ec483954d3eb4f9a7f57244204c" } new_table_name: "default.Table_0255a6753f1443abb6d5c32d77404997" modify_external_catalogs: true
I20250625 14:02:04.799649 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.800756 11717 leader_election.cc:304] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.801424 13651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41234 (request call id 0) took 1883 ms. Trace:
I20250625 14:02:04.802469 13818 sys_catalog.cc:455] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b19d4bb9dd34b4c92dd939a17482334. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:02:04.802632 13818 sys_catalog.cc:458] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:02:04.802784 13817 sys_catalog.cc:455] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:02:04.802855 13817 sys_catalog.cc:458] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [sys.catalog]: This master's current role is: FOLLOWER
I20250625 14:02:04.803067 12175 ts_tablet_manager.cc:1905] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.802892 13335 raft_consensus.cc:2802] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.805023 13335 raft_consensus.cc:695] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:04.805101 13632 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" instance_seqno: 1750860112228776) as {username='slave'} at 127.11.39.131:41241; Asking this server to re-register.
I20250625 14:02:04.805159 13335 consensus_queue.cc:237] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.805958 12104 heartbeater.cc:461] Registering TS with master...
I20250625 14:02:04.802650 13699 raft_consensus.cc:2802] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.806069 13699 raft_consensus.cc:491] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.806128 13699 raft_consensus.cc:3058] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.807216 13699 raft_consensus.cc:513] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:04.807269 11855 leader_election.cc:343] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 54a59027aef04a12a0bf1fbece3c3161
I20250625 14:02:04.807356 11855 leader_election.cc:304] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:04.807518 13835 raft_consensus.cc:2747] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.807554 13699 leader_election.cc:290] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:04.801836 11717 leader_election.cc:304] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.807929 13699 raft_consensus.cc:2802] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.807996 13699 raft_consensus.cc:491] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.808043 13699 raft_consensus.cc:3058] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.808347 13632 ts_manager.cc:194] Registered new tserver with Master: 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:04.809012 13699 raft_consensus.cc:513] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.809358 13699 leader_election.cc:290] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:04.809686 12177 raft_consensus.cc:2270] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.724419 12173 ts_tablet_manager.cc:1918] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:04.809899 12173 log.cc:1199] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/8578d07c9b4a44f887b5a30e92c1ede9
I20250625 14:02:04.810204 12173 ts_tablet_manager.cc:1939] T 8578d07c9b4a44f887b5a30e92c1ede9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.810927 12173 tablet_replica.cc:331] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.810966 12177 ts_tablet_manager.cc:1905] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.811118 12173 raft_consensus.cc:2241] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.811265 12173 raft_consensus.cc:2270] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.811638 12173 ts_tablet_manager.cc:1905] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.813488 12177 ts_tablet_manager.cc:1918] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:04.813630 12177 log.cc:1199] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/8578d07c9b4a44f887b5a30e92c1ede9
I20250625 14:02:04.813977 12177 ts_tablet_manager.cc:1939] T 8578d07c9b4a44f887b5a30e92c1ede9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.814085 12173 ts_tablet_manager.cc:1918] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:04.814162 12173 log.cc:1199] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/e98a2085fe67479db141b2675f69a2d9
I20250625 14:02:04.816164 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:04.816569 12166 tablet_bootstrap.cc:492] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.816679 12166 ts_tablet_manager.cc:1397] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.000s
I20250625 14:02:04.817256 12166 raft_consensus.cc:357] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.817375 12166 raft_consensus.cc:383] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.817404 12166 raft_consensus.cc:738] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.817520 12166 consensus_queue.cc:260] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.817808 12166 ts_tablet_manager.cc:1428] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.818338 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 8578d07c9b4a44f887b5a30e92c1ede9 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]) successfully deleted
I20250625 14:02:04.818583 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfbf6959677547a6a2582b73b2be4c03" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.819820 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:04.821202 13632 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "bfff52620fea460d850827814b790c35" instance_seqno: 1750860112036552) as {username='slave'} at 127.11.39.130:51099; Asking this server to re-register.
I20250625 14:02:04.821260 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfbf6959677547a6a2582b73b2be4c03" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:04.821367 12056 raft_consensus.cc:3058] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.821903 11969 heartbeater.cc:461] Registering TS with master...
I20250625 14:02:04.822448 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7160c6353e2d48d8a5d5a71563797051" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:04.822566 12044 raft_consensus.cc:3058] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:04.823240 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet edc5b7cc92564ba4ad04f68e18b56dfe consensus state has no leader
I20250625 14:02:04.823678 12044 raft_consensus.cc:2466] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:04.823880 13633 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" instance_seqno: 1750860111839732) as {username='slave'} at 127.11.39.129:37917; Asking this server to re-register.
I20250625 14:02:04.824240 13641 ts_manager.cc:194] Registered new tserver with Master: bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.824362 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7160c6353e2d48d8a5d5a71563797051" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.824952 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9169d58caf8b440abe39fe2b09859d07
I20250625 14:02:04.826680 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 9169d58caf8b440abe39fe2b09859d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.828621 12056 raft_consensus.cc:2466] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:04.829828 12166 tablet_bootstrap.cc:492] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.815770 12172 tablet_bootstrap.cc:492] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.830686 12172 ts_tablet_manager.cc:1397] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.092s user 0.002s sys 0.000s
I20250625 14:02:04.830922 12177 tablet_replica.cc:331] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.831074 12177 raft_consensus.cc:2241] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.831228 12177 raft_consensus.cc:2270] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.831248 12172 raft_consensus.cc:357] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.831364 12172 raft_consensus.cc:383] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.831409 12172 raft_consensus.cc:738] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.831540 12172 consensus_queue.cc:260] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.831593 12177 ts_tablet_manager.cc:1905] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.831837 12172 ts_tablet_manager.cc:1428] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.832024 12172 tablet_bootstrap.cc:492] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.833002 12172 tablet_bootstrap.cc:654] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.819204 11747 tablet_service.cc:1515] Processing DeleteTablet for tablet 600c108480fb45e18f8004aea752f233 with delete_type TABLET_DATA_DELETED (replaced by tablet 0afd4fac76cb4424af7bfc1c89add7f0) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.819399 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.819548 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 38ed475ff22e49d6b6962c7c0cd621de with delete_type TABLET_DATA_DELETED (replaced by tablet 6f0cc665cb164feaa1e52ee48796e22f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.819763 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet d185c7be82b04fe2a30626a6fb082219 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca235e89ed14e8697c73bc4d3ebec7b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.833686 11831 heartbeater.cc:461] Registering TS with master...
I20250625 14:02:04.834661 12166 tablet_bootstrap.cc:654] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.835376 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fd261d824c34864a7b15e4736254062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:04.820222 11717 leader_election.cc:343] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.835657 12175 ts_tablet_manager.cc:1918] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.835683 13632 ts_manager.cc:194] Registered new tserver with Master: 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:04.835731 12175 log.cc:1199] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f2576ff766494c37b316552a66a5ff31
I20250625 14:02:04.835943 12175 ts_tablet_manager.cc:1939] T f2576ff766494c37b316552a66a5ff31 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:04.836159 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 9169d58caf8b440abe39fe2b09859d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.836602 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet d185c7be82b04fe2a30626a6fb082219 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca235e89ed14e8697c73bc4d3ebec7b) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:04.836730 11717 leader_election.cc:343] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:04.836905 11717 leader_election.cc:343] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:04.837148 11717 leader_election.cc:343] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:04.837348 11717 leader_election.cc:343] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.837599 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f2576ff766494c37b316552a66a5ff31 (table default.Table_47a020733f644c45b54865bbd14ff779 [id=4ca78651d63b411b83d97f628dbf849d]) successfully deleted
I20250625 14:02:04.837661 13535 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20250625 14:02:04.838214 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 50f55f37173246bc8dab611f5d28c24e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 50f55f37173246bc8dab611f5d28c24e already in progress: creating tablet
W20250625 14:02:04.838762 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 990d03f434044571aa2b61577495ab77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 990d03f434044571aa2b61577495ab77 already in progress: creating tablet
I20250625 14:02:04.840163 12173 ts_tablet_manager.cc:1939] T e98a2085fe67479db141b2675f69a2d9 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.840927 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:04.841138 12175 tablet_replica.cc:331] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:04.841351 12175 raft_consensus.cc:2241] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.841531 12175 raft_consensus.cc:2270] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.842286 12175 ts_tablet_manager.cc:1905] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.844269 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 8578d07c9b4a44f887b5a30e92c1ede9 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]) successfully deleted
I20250625 14:02:04.844813 11717 leader_election.cc:304] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.845114 11717 leader_election.cc:304] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:04.845288 13699 raft_consensus.cc:2802] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.845376 13699 raft_consensus.cc:695] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:04.845505 13699 consensus_queue.cc:237] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.845965 12167 tablet_bootstrap.cc:492] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.846065 12167 ts_tablet_manager.cc:1397] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.127s user 0.002s sys 0.000s
I20250625 14:02:04.846632 12167 raft_consensus.cc:357] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.846741 12167 raft_consensus.cc:383] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.846773 12167 raft_consensus.cc:738] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.846879 12167 consensus_queue.cc:260] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.847160 12167 ts_tablet_manager.cc:1428] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.845124 13335 raft_consensus.cc:2802] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.847548 13335 raft_consensus.cc:695] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:04.847658 13335 consensus_queue.cc:237] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.848495 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 9169d58caf8b440abe39fe2b09859d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.849388 13836 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:04.849879 12167 tablet_bootstrap.cc:492] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.850131 12172 tablet_bootstrap.cc:492] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:04.850237 12172 ts_tablet_manager.cc:1397] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:02:04.850777 12172 raft_consensus.cc:357] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.850907 12172 raft_consensus.cc:383] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.850950 12172 raft_consensus.cc:738] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.851073 12172 consensus_queue.cc:260] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.851089 13531 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250625 14:02:04.851382 12172 ts_tablet_manager.cc:1428] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.851572 12172 tablet_bootstrap.cc:492] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:04.852571 12172 tablet_bootstrap.cc:654] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.853612 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_bdb8c169c9af4735b29c0aaa9981261f [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
I20250625 14:02:04.853744 12177 ts_tablet_manager.cc:1918] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:04.853804 12177 log.cc:1199] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/e98a2085fe67479db141b2675f69a2d9
I20250625 14:02:04.854069 12177 ts_tablet_manager.cc:1939] T e98a2085fe67479db141b2675f69a2d9 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:02:04.854233 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 600c108480fb45e18f8004aea752f233 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 600c108480fb45e18f8004aea752f233 already in progress: creating tablet
I20250625 14:02:04.854753 12173 tablet_replica.cc:331] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.854895 12173 raft_consensus.cc:2241] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.855088 12173 raft_consensus.cc:2270] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.855415 13835 raft_consensus.cc:491] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.855507 13835 raft_consensus.cc:513] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.855860 13835 leader_election.cc:290] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:04.856582 11858 leader_election.cc:343] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 3faa8782ba0d45dbbd89437685a64aef
I20250625 14:02:04.856992 12173 ts_tablet_manager.cc:1905] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:04.857250 11855 leader_election.cc:343] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 3faa8782ba0d45dbbd89437685a64aef
I20250625 14:02:04.857319 11855 leader_election.cc:304] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:04.857721 13835 raft_consensus.cc:2747] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.858814 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7b87d17923ce49cda6bb7de761f700d3" } modify_external_catalogs: true
I20250625 14:02:04.859254 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7b87d17923ce49cda6bb7de761f700d3" } modify_external_catalogs: true
I20250625 14:02:04.859088 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_61cd97c7a2044d468ce5381949b33cb4" } modify_external_catalogs: true
I20250625 14:02:04.859696 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_61cd97c7a2044d468ce5381949b33cb4" } modify_external_catalogs: true
I20250625 14:02:04.860038 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4d033eef3b9e4a4c97d4dbb39bd68006"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.860152 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5171599cd58f4906897a3e7da2c30d6e" } modify_external_catalogs: true
I20250625 14:02:04.860234 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5171599cd58f4906897a3e7da2c30d6e" } modify_external_catalogs: true
I20250625 14:02:04.860196 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bd07ded692c74d01b5365ba660ca00dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.860435 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d033eef3b9e4a4c97d4dbb39bd68006 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:04.860520 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd07ded692c74d01b5365ba660ca00dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.860453 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_65882e25be8d4c5f9997d5a89f31e88e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.860932 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65882e25be8d4c5f9997d5a89f31e88e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.861605 12166 tablet_bootstrap.cc:492] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.861701 12166 ts_tablet_manager.cc:1397] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.002s
I20250625 14:02:04.862216 12166 raft_consensus.cc:357] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.862351 12166 raft_consensus.cc:383] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.862388 12166 raft_consensus.cc:738] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.862543 12166 consensus_queue.cc:260] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.864117 12166 ts_tablet_manager.cc:1428] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:02:04.864342 12166 tablet_bootstrap.cc:492] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.866657 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_39f38f3fc23e425f87d7ae5fdbf08233 [id=44f2f74bfee54c72b3dee93db46b35e5] alter complete (version 4)
I20250625 14:02:04.866976 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e08928012af340a280579da7de533f9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:04.867108 12166 tablet_bootstrap.cc:654] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:04.867362 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e08928012af340a280579da7de533f9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.851094 12167 tablet_bootstrap.cc:654] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.867913 13335 raft_consensus.cc:491] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.868014 13335 raft_consensus.cc:513] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.868432 13335 leader_election.cc:290] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.868966 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86d1b58fd1a9483b9ead08a55e3b1e63" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.869385 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86d1b58fd1a9483b9ead08a55e3b1e63" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.869510 12056 raft_consensus.cc:2466] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:04.874625 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet d185c7be82b04fe2a30626a6fb082219 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ca235e89ed14e8697c73bc4d3ebec7b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.875265 11717 leader_election.cc:304] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.875483 13335 raft_consensus.cc:2802] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.875551 13335 raft_consensus.cc:491] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.875588 13335 raft_consensus.cc:3058] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.876358 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet b9a788be0b8640dc9d6d06fa86580f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.876753 13335 raft_consensus.cc:513] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.877138 13335 leader_election.cc:290] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:04.875480 11717 leader_election.cc:343] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.878803 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5e4cdf8f78d14c7d8ba3bda009d33719
I20250625 14:02:04.878950 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86d1b58fd1a9483b9ead08a55e3b1e63" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:04.879035 12177 tablet_replica.cc:331] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.879087 12056 raft_consensus.cc:3058] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.879189 12177 raft_consensus.cc:2241] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.879465 12177 pending_rounds.cc:70] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:04.879526 12177 pending_rounds.cc:77] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523070932140032 op_type: NO_OP noop_request { }
I20250625 14:02:04.879595 12177 raft_consensus.cc:2887] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:04.879662 12177 raft_consensus.cc:2270] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.879640 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86d1b58fd1a9483b9ead08a55e3b1e63" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.879743 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_bdb8c169c9af4735b29c0aaa9981261f [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
I20250625 14:02:04.880270 12056 raft_consensus.cc:2466] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:04.880426 12167 tablet_bootstrap.cc:492] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.880511 12167 ts_tablet_manager.cc:1397] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20250625 14:02:04.881068 12167 raft_consensus.cc:357] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.881182 12167 raft_consensus.cc:383] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.881213 12167 raft_consensus.cc:738] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.881335 12167 consensus_queue.cc:260] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.881629 12167 ts_tablet_manager.cc:1428] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.881793 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.881790 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.882004 12167 tablet_bootstrap.cc:492] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.884388 12167 tablet_bootstrap.cc:654] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.889246 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bf7d2d7ae6fa49baba4eef521b8edb05" } new_table_name: "default.Table_88f7a3f8dc4f4b6292359bfff07f591b" modify_external_catalogs: true
I20250625 14:02:04.889494 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_16248c1613424ffabcdbfd0173d5678b" } new_table_name: "default.Table_972e2b5ba1434aa39649fb5d8c8b9d78" modify_external_catalogs: true
I20250625 14:02:04.889993 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_96c4b1885cd441048632e01c02fd2d86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.890376 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96c4b1885cd441048632e01c02fd2d86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.890408 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7e3a28e81f114ea487edc03961693f5c" } new_table_name: "default.Table_9239bf59a7764cd1887acd145d055543" modify_external_catalogs: true
I20250625 14:02:04.892062 11717 leader_election.cc:304] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.892328 13334 raft_consensus.cc:491] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.892413 13334 raft_consensus.cc:513] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.892763 13334 leader_election.cc:290] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.892858 13334 raft_consensus.cc:2802] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.892923 13334 raft_consensus.cc:695] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:04.893059 13334 consensus_queue.cc:237] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.893240 12167 tablet_bootstrap.cc:492] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.893334 12167 ts_tablet_manager.cc:1397] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:02:04.893812 12167 raft_consensus.cc:357] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.893929 12167 raft_consensus.cc:383] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.893972 12167 raft_consensus.cc:738] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.894089 12167 consensus_queue.cc:260] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.894397 12167 ts_tablet_manager.cc:1428] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.894582 12167 tablet_bootstrap.cc:492] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.895238 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ccba0555eb234e0fb2246d46b57d7fab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.895577 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccba0555eb234e0fb2246d46b57d7fab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:04.898066 11717 leader_election.cc:343] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.898416 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 5e4cdf8f78d14c7d8ba3bda009d33719 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.899219 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f325061ce4bb4468886cfe0a0d752596" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:04.899467 12167 tablet_bootstrap.cc:654] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.899523 12177 ts_tablet_manager.cc:1905] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.899498 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f325061ce4bb4468886cfe0a0d752596" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:04.899691 11717 leader_election.cc:343] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:04.901854 11717 leader_election.cc:343] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.901937 11717 leader_election.cc:304] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:04.902195 13699 raft_consensus.cc:2747] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:04.908334 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 382a495348be45fc872f1602ee0c6165 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:04.908425 11527 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 899b47cc4b9e4afc854dccac27d7fec0 consensus state has no leader
W20250625 14:02:04.909003 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08b3ba59f0374c6199cd470d136c59ee consensus state has no leader
I20250625 14:02:04.909435 12177 ts_tablet_manager.cc:1918] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:04.909518 12177 log.cc:1199] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b9a788be0b8640dc9d6d06fa86580f6b
W20250625 14:02:04.910594 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet faa0dc0cffaa405a9b6ec8a0582c1cb1 has no consensus state
I20250625 14:02:04.912360 12175 ts_tablet_manager.cc:1918] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.912511 12175 log.cc:1199] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b6318e27fb194a209c1c80ffcaf24a64
I20250625 14:02:04.913229 13121 raft_consensus.cc:491] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.913331 13121 raft_consensus.cc:513] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.913769 13121 leader_election.cc:290] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.914053 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58bd9c8a0eb43b5aeedcca452fa7a98" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.914208 11778 raft_consensus.cc:2466] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:04.914569 11993 leader_election.cc:304] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.915341 13121 raft_consensus.cc:2802] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.915406 13121 raft_consensus.cc:491] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.915447 13121 raft_consensus.cc:3058] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.915465 11532 catalog_manager.cc:5582] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:04.916352 11526 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet edc5b7cc92564ba4ad04f68e18b56dfe (table default.Table_0255a6753f1443abb6d5c32d77404997 [id=205b876e2e7a4f54bbddec9150d67e0a]). Expected version 2 got 0
I20250625 14:02:04.916618 13121 raft_consensus.cc:513] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.916960 13121 leader_election.cc:290] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.917438 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58bd9c8a0eb43b5aeedcca452fa7a98" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:04.917558 11778 raft_consensus.cc:3058] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.918977 11778 raft_consensus.cc:2466] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:04.919660 11993 leader_election.cc:304] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.919826 13121 raft_consensus.cc:2802] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.919921 13121 raft_consensus.cc:695] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:04.920006 12173 ts_tablet_manager.cc:1918] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.920534 12173 log.cc:1199] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/84a1eb4471544de9afbb5b35d0071dcc
I20250625 14:02:04.920660 12167 tablet_bootstrap.cc:492] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.920066 13121 consensus_queue.cc:237] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.909778 12177 ts_tablet_manager.cc:1939] T b9a788be0b8640dc9d6d06fa86580f6b P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.921689 12177 tablet_replica.cc:331] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.920783 12167 ts_tablet_manager.cc:1397] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20250625 14:02:04.922874 12167 raft_consensus.cc:357] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.922996 12167 raft_consensus.cc:383] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.923034 12167 raft_consensus.cc:738] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.923159 12167 consensus_queue.cc:260] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.923472 12167 ts_tablet_manager.cc:1428] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.923496 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_be97292d424145e18538b8e77b13f862" } new_table_name: "default.Table_0bdfb982168b456f95dd51d38214412b" modify_external_catalogs: true
I20250625 14:02:04.923661 12167 tablet_bootstrap.cc:492] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.923672 12177 raft_consensus.cc:2241] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.924465 12177 raft_consensus.cc:2270] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.924849 12167 tablet_bootstrap.cc:654] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.925530 12177 ts_tablet_manager.cc:1905] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.925837 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 6fd041441d71459f970966c1540848b0 (DEFAULT_TABLE table=default.Table_009d6f19fc88401bb89b017cea240a2e [id=d9ed4362d45d4fe8aa9dce05b8e209a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.926999 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd041441d71459f970966c1540848b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.928690 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 1058c4b2094d41109ad0c2fc05b8e3f2 (DEFAULT_TABLE table=default.Table_bf2e234312fc4624a87a5c279976f86c [id=4f0cc03386bb4140b004dbd5e6cf0d5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.928934 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1058c4b2094d41109ad0c2fc05b8e3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.929347 12028 tablet_service.cc:1468] Processing CreateTablet for tablet b015d43ee7a84667bb24053dee4e4481 (DEFAULT_TABLE table=default.Table_0338ff3edcae43938f90540b34370738 [id=44ef742301164816b4395fe9efa41e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.929545 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b015d43ee7a84667bb24053dee4e4481. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.931077 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 19486c8297bc4380be71ecfa91febd83 (DEFAULT_TABLE table=default.Table_d9f3b918daa24f5793772fd13f284974 [id=50b099c5648f454291d21b9b4bf76106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.931293 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19486c8297bc4380be71ecfa91febd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.933677 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b9a788be0b8640dc9d6d06fa86580f6b (table default.Table_3ef297edd2b74ada8037c6bc3018ccb8 [id=3fb5b2ae009c4365812e750040fa0b97]) successfully deleted
I20250625 14:02:04.934468 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 6fd041441d71459f970966c1540848b0 (DEFAULT_TABLE table=default.Table_009d6f19fc88401bb89b017cea240a2e [id=d9ed4362d45d4fe8aa9dce05b8e209a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.934725 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd041441d71459f970966c1540848b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.936650 12177 ts_tablet_manager.cc:1918] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.936713 12177 log.cc:1199] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a36ed3e126ef4edfa69fcffb098d0e4f
I20250625 14:02:04.936918 12177 ts_tablet_manager.cc:1939] T a36ed3e126ef4edfa69fcffb098d0e4f P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.937494 11749 tablet_service.cc:1468] Processing CreateTablet for tablet b015d43ee7a84667bb24053dee4e4481 (DEFAULT_TABLE table=default.Table_0338ff3edcae43938f90540b34370738 [id=44ef742301164816b4395fe9efa41e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.937733 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b015d43ee7a84667bb24053dee4e4481. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.940083 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 1058c4b2094d41109ad0c2fc05b8e3f2 (DEFAULT_TABLE table=default.Table_bf2e234312fc4624a87a5c279976f86c [id=4f0cc03386bb4140b004dbd5e6cf0d5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.940393 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1058c4b2094d41109ad0c2fc05b8e3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.940799 12177 tablet_replica.cc:331] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:04.940960 12177 raft_consensus.cc:2241] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.941072 12177 raft_consensus.cc:2270] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.941871 12167 tablet_bootstrap.cc:492] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.942034 12167 ts_tablet_manager.cc:1397] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250625 14:02:04.942230 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]). Expected version 1 got 0
I20250625 14:02:04.942476 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet f325061ce4bb4468886cfe0a0d752596 (table default.Table_e3322169c32b4dd8af57a18e67156a86 [id=cd68b5ad9c1849298e961363e2e27608]). Expected version 1 got 0
I20250625 14:02:04.942586 11531 catalog_manager.cc:5582] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:04.943073 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 19486c8297bc4380be71ecfa91febd83 (DEFAULT_TABLE table=default.Table_d9f3b918daa24f5793772fd13f284974 [id=50b099c5648f454291d21b9b4bf76106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.943343 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19486c8297bc4380be71ecfa91febd83. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.943575 12167 raft_consensus.cc:357] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.943778 12167 raft_consensus.cc:383] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.943856 12167 raft_consensus.cc:738] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.944067 12167 consensus_queue.cc:260] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.945087 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0f3c5e4b77724849ab5703f84775e370
I20250625 14:02:04.945423 11530 catalog_manager.cc:6652] ReplaceTablet: tablet 0f3c5e4b77724849ab5703f84775e370 deleted and replaced by tablet 5fea0b0fa5874d569f26613b85125a2f
I20250625 14:02:04.946051 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a36ed3e126ef4edfa69fcffb098d0e4f (table default.Table_99867a76f7444c73b03daf2d410e0156 [id=249cebeb7f5b4990ad3776656f4586ab]) successfully deleted
I20250625 14:02:04.946067 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 147dbf21a3d242b9a8d7d1389c7cecb5
I20250625 14:02:04.946385 13121 raft_consensus.cc:491] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.946471 13121 raft_consensus.cc:513] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.946550 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 25dd555e539f4278b9a04c4959a740f3
I20250625 14:02:04.946863 13121 leader_election.cc:290] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:04.947223 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 600c108480fb45e18f8004aea752f233 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 600c108480fb45e18f8004aea752f233 already in progress: creating tablet
W20250625 14:02:04.947499 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7376f9dc4c8d4ed0a539eceead2a9a23 already in progress: creating tablet
W20250625 14:02:04.947727 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 38ed475ff22e49d6b6962c7c0cd621de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38ed475ff22e49d6b6962c7c0cd621de already in progress: creating tablet
I20250625 14:02:04.947876 12177 ts_tablet_manager.cc:1905] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.948074 12167 ts_tablet_manager.cc:1428] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250625 14:02:04.948596 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "edc5b7cc92564ba4ad04f68e18b56dfe" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.948632 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f3c5e4b77724849ab5703f84775e370 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fea0b0fa5874d569f26613b85125a2f) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:04.948693 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4ac61620d0e40dca0a9039c9477619c consensus state has no leader
I20250625 14:02:04.948729 11778 raft_consensus.cc:2466] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:04.949155 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.949393 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 25dd555e539f4278b9a04c4959a740f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:04.949399 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f3c5e4b77724849ab5703f84775e370 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fea0b0fa5874d569f26613b85125a2f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.950228 11993 leader_election.cc:304] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.950469 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 25dd555e539f4278b9a04c4959a740f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.950528 13121 raft_consensus.cc:2802] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.950570 13121 raft_consensus.cc:491] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.950608 13121 raft_consensus.cc:3058] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.951666 13121 raft_consensus.cc:513] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.950485 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:04.952311 13121 leader_election.cc:290] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.953150 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "edc5b7cc92564ba4ad04f68e18b56dfe" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:04.953269 11778 raft_consensus.cc:3058] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.920855 12173 ts_tablet_manager.cc:1939] T 84a1eb4471544de9afbb5b35d0071dcc P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.914358 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58bd9c8a0eb43b5aeedcca452fa7a98" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.917450 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58bd9c8a0eb43b5aeedcca452fa7a98" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.953855 12175 ts_tablet_manager.cc:1939] T b6318e27fb194a209c1c80ffcaf24a64 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:04.925338 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 6fd041441d71459f970966c1540848b0 (DEFAULT_TABLE table=default.Table_009d6f19fc88401bb89b017cea240a2e [id=d9ed4362d45d4fe8aa9dce05b8e209a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.926062 11898 tablet_service.cc:1468] Processing CreateTablet for tablet b015d43ee7a84667bb24053dee4e4481 (DEFAULT_TABLE table=default.Table_0338ff3edcae43938f90540b34370738 [id=44ef742301164816b4395fe9efa41e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.928221 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 1058c4b2094d41109ad0c2fc05b8e3f2 (DEFAULT_TABLE table=default.Table_bf2e234312fc4624a87a5c279976f86c [id=4f0cc03386bb4140b004dbd5e6cf0d5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.928906 11897 tablet_service.cc:1468] Processing CreateTablet for tablet 19486c8297bc4380be71ecfa91febd83 (DEFAULT_TABLE table=default.Table_d9f3b918daa24f5793772fd13f284974 [id=50b099c5648f454291d21b9b4bf76106]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.947762 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "edc5b7cc92564ba4ad04f68e18b56dfe" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.949662 11902 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f3c5e4b77724849ab5703f84775e370 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fea0b0fa5874d569f26613b85125a2f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.950069 11889 tablet_service.cc:1515] Processing DeleteTablet for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.950475 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 25dd555e539f4278b9a04c4959a740f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:04.954401 11778 raft_consensus.cc:2466] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
W20250625 14:02:04.954809 11990 leader_election.cc:343] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.954867 12167 tablet_bootstrap.cc:492] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:02:04.955014 11990 leader_election.cc:343] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.955050 12173 tablet_replica.cc:331] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
W20250625 14:02:04.955163 11990 leader_election.cc:343] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.955188 12173 raft_consensus.cc:2241] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.955303 12173 raft_consensus.cc:2270] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.956012 12166 tablet_bootstrap.cc:492] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.956099 12166 ts_tablet_manager.cc:1397] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.092s user 0.002s sys 0.000s
I20250625 14:02:04.956593 12166 raft_consensus.cc:357] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.956714 12166 raft_consensus.cc:383] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.956748 12166 raft_consensus.cc:738] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.956866 12166 consensus_queue.cc:260] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.957170 12166 ts_tablet_manager.cc:1428] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.957679 11993 leader_election.cc:304] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:04.957839 13121 raft_consensus.cc:2802] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.958043 13121 raft_consensus.cc:695] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:04.958238 13121 consensus_queue.cc:237] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.958241 11749 tablet_service.cc:1468] Processing CreateTablet for tablet d36088153ec7485786fedf97d2287742 (DEFAULT_TABLE table=default.Table_992ed60a855e433995e83e54f5f7d7db [id=4b6ca272e844442db3e8cda112fae525]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.959056 11745 tablet_service.cc:1468] Processing CreateTablet for tablet f187dd07742144668c03b8c7caa8c828 (DEFAULT_TABLE table=default.Table_dc7fb5009dac47e582df7e883e7e1a36 [id=6b104adbf05a474b991fb1e63208e724]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.959580 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 00f96426571446d49a9273055c1c155c (DEFAULT_TABLE table=default.Table_3a4a0b60b9a1494cbf2f7a7dbfcd09de [id=84088ce1b38d43adaa864084003d6df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.962169 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet dfbf6959677547a6a2582b73b2be4c03 (table default.Table_ce207d86e10b457089caedc1452d8318 [id=70d3fc86e64847b9b7edd7945c195dc6]). Expected version 3 got 0
I20250625 14:02:04.962374 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "edc5b7cc92564ba4ad04f68e18b56dfe" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.962545 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19486c8297bc4380be71ecfa91febd83. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:04.962798 11990 leader_election.cc:343] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:04.963299 13121 raft_consensus.cc:491] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:04.963389 13121 raft_consensus.cc:513] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.963703 13121 leader_election.cc:290] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.964151 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d185c7be82b04fe2a30626a6fb082219" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:04.964257 11919 raft_consensus.cc:2466] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:04.964354 12167 tablet_bootstrap.cc:654] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.964471 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d185c7be82b04fe2a30626a6fb082219" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:04.964552 11990 leader_election.cc:304] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:04.964713 13121 raft_consensus.cc:2802] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:04.964776 13121 raft_consensus.cc:491] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:04.964818 13121 raft_consensus.cc:3058] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:04.964828 11993 leader_election.cc:343] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: Tablet not RUNNING: STOPPED
I20250625 14:02:04.964920 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd041441d71459f970966c1540848b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.965629 13121 raft_consensus.cc:513] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.965922 13121 leader_election.cc:290] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:04.966281 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d185c7be82b04fe2a30626a6fb082219" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:04.966436 11919 raft_consensus.cc:3058] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:04.967361 11919 raft_consensus.cc:2466] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:04.967593 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d185c7be82b04fe2a30626a6fb082219" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:04.967675 11990 leader_election.cc:304] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:02:04.967954 11993 leader_election.cc:343] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: Tablet not RUNNING: STOPPED
I20250625 14:02:04.968200 13121 raft_consensus.cc:2802] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:04.968261 12166 tablet_bootstrap.cc:492] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.968434 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b015d43ee7a84667bb24053dee4e4481. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.968562 13121 raft_consensus.cc:695] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:04.968779 13121 consensus_queue.cc:237] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.969272 12166 tablet_bootstrap.cc:654] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.970820 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1058c4b2094d41109ad0c2fc05b8e3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.971872 12173 ts_tablet_manager.cc:1905] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.976243 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet dfbf6959677547a6a2582b73b2be4c03 (table default.Table_ce207d86e10b457089caedc1452d8318 [id=70d3fc86e64847b9b7edd7945c195dc6]). Expected version 3 got 0
I20250625 14:02:04.976809 12166 tablet_bootstrap.cc:492] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:04.976902 12166 ts_tablet_manager.cc:1397] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250625 14:02:04.977459 12166 raft_consensus.cc:357] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.977579 12166 raft_consensus.cc:383] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.977615 12166 raft_consensus.cc:738] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.977754 12166 consensus_queue.cc:260] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:04.978053 12166 ts_tablet_manager.cc:1428] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.979960 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f187dd07742144668c03b8c7caa8c828. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.980402 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f96426571446d49a9273055c1c155c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.980366 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet d53e9ef9d5f64cb893a552ab0784c120 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:04.981159 12166 tablet_bootstrap.cc:492] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:04.982765 12173 ts_tablet_manager.cc:1918] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.982875 12173 log.cc:1199] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a36ed3e126ef4edfa69fcffb098d0e4f
I20250625 14:02:04.983120 12173 ts_tablet_manager.cc:1939] T a36ed3e126ef4edfa69fcffb098d0e4f P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:04.982286 12166 tablet_bootstrap.cc:654] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:04.984163 12173 tablet_replica.cc:331] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:04.984369 12173 raft_consensus.cc:2241] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:04.984562 12173 pending_rounds.cc:70] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:04.984651 12173 pending_rounds.cc:77] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523071874961408 op_type: NO_OP noop_request { }
I20250625 14:02:04.984771 12173 raft_consensus.cc:2887] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:04.984879 12173 raft_consensus.cc:2270] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:04.985574 12173 ts_tablet_manager.cc:1905] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.986414 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36088153ec7485786fedf97d2287742. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.986723 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_545ed70704b9480980d400c1c14a4edf" } modify_external_catalogs: true
I20250625 14:02:04.986847 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_545ed70704b9480980d400c1c14a4edf" } modify_external_catalogs: true
I20250625 14:02:04.988430 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e19c4f793b7d45c49084192e837f0570"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.988862 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e19c4f793b7d45c49084192e837f0570 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.986101 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:04.991364 12177 ts_tablet_manager.cc:1918] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:04.991465 12177 log.cc:1199] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d185c7be82b04fe2a30626a6fb082219
I20250625 14:02:04.991696 12177 ts_tablet_manager.cc:1939] T d185c7be82b04fe2a30626a6fb082219 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:04.993026 12167 tablet_bootstrap.cc:492] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:04.993156 12167 ts_tablet_manager.cc:1397] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20250625 14:02:04.993713 12167 raft_consensus.cc:357] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.993852 12167 raft_consensus.cc:383] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:04.993908 12167 raft_consensus.cc:738] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:04.994046 12167 consensus_queue.cc:260] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.994263 11530 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:04.994401 12167 ts_tablet_manager.cc:1428] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:04.994611 12167 tablet_bootstrap.cc:492] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:04.994633 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_42741884e19b41859a14690aaff60e01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:04.995010 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42741884e19b41859a14690aaff60e01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:04.996457 11891 tablet_service.cc:1468] Processing CreateTablet for tablet d36088153ec7485786fedf97d2287742 (DEFAULT_TABLE table=default.Table_992ed60a855e433995e83e54f5f7d7db [id=4b6ca272e844442db3e8cda112fae525]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.996713 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36088153ec7485786fedf97d2287742. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.996671 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 00f96426571446d49a9273055c1c155c (DEFAULT_TABLE table=default.Table_3a4a0b60b9a1494cbf2f7a7dbfcd09de [id=84088ce1b38d43adaa864084003d6df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.996894 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f96426571446d49a9273055c1c155c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.997079 11898 tablet_service.cc:1468] Processing CreateTablet for tablet f187dd07742144668c03b8c7caa8c828 (DEFAULT_TABLE table=default.Table_dc7fb5009dac47e582df7e883e7e1a36 [id=6b104adbf05a474b991fb1e63208e724]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.997289 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f187dd07742144668c03b8c7caa8c828. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.996061 12034 tablet_service.cc:1468] Processing CreateTablet for tablet d36088153ec7485786fedf97d2287742 (DEFAULT_TABLE table=default.Table_992ed60a855e433995e83e54f5f7d7db [id=4b6ca272e844442db3e8cda112fae525]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.998958 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36088153ec7485786fedf97d2287742. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.999598 12028 tablet_service.cc:1468] Processing CreateTablet for tablet f187dd07742144668c03b8c7caa8c828 (DEFAULT_TABLE table=default.Table_dc7fb5009dac47e582df7e883e7e1a36 [id=6b104adbf05a474b991fb1e63208e724]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:04.999751 12175 tablet_replica.cc:331] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:04.999807 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f187dd07742144668c03b8c7caa8c828. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:04.999881 12175 raft_consensus.cc:2241] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:04.999997 12175 raft_consensus.cc:2270] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.000341 12175 ts_tablet_manager.cc:1905] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:04.995692 12167 tablet_bootstrap.cc:654] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.002795 12167 tablet_bootstrap.cc:492] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.002888 12167 ts_tablet_manager.cc:1397] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:02:05.003418 12167 raft_consensus.cc:357] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.003513 12167 raft_consensus.cc:383] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.003541 12167 raft_consensus.cc:738] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.003651 12167 consensus_queue.cc:260] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.003943 12167 ts_tablet_manager.cc:1428] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.004137 12167 tablet_bootstrap.cc:492] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.005151 12167 tablet_bootstrap.cc:654] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.006824 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 00f96426571446d49a9273055c1c155c (DEFAULT_TABLE table=default.Table_3a4a0b60b9a1494cbf2f7a7dbfcd09de [id=84088ce1b38d43adaa864084003d6df1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.007081 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f96426571446d49a9273055c1c155c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.008096 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b6318e27fb194a209c1c80ffcaf24a64 (table default.Table_096fdb53835b4885953dbe0f68c7faaa [id=293fe275a8ed4eee81c988b80b507f05]) successfully deleted
W20250625 14:02:05.008315 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a7d87f5ca2f74eaeae12f1a6b533c12c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7d87f5ca2f74eaeae12f1a6b533c12c already in progress: creating tablet
I20250625 14:02:05.011034 12167 tablet_bootstrap.cc:492] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.011126 12167 ts_tablet_manager.cc:1397] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
W20250625 14:02:05.011368 11855 consensus_peers.cc:487] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8578d07c9b4a44f887b5a30e92c1ede9. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:05.011616 12167 raft_consensus.cc:357] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.011722 12167 raft_consensus.cc:383] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.011756 12167 raft_consensus.cc:738] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.011875 12167 consensus_queue.cc:260] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.012163 12167 ts_tablet_manager.cc:1428] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.012357 12167 tablet_bootstrap.cc:492] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.012526 12172 tablet_bootstrap.cc:492] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.012617 12172 ts_tablet_manager.cc:1397] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.161s user 0.002s sys 0.000s
I20250625 14:02:05.013110 12172 raft_consensus.cc:357] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.013227 12172 raft_consensus.cc:383] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.013258 12172 raft_consensus.cc:738] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.013373 12172 consensus_queue.cc:260] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.013645 12172 ts_tablet_manager.cc:1428] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.013830 12172 tablet_bootstrap.cc:492] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.014848 12172 tablet_bootstrap.cc:654] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.015136 13531 tablet.cc:1722] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.015592 13817 raft_consensus.cc:491] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9b19d4bb9dd34b4c92dd939a17482334)
I20250625 14:02:05.015733 13817 raft_consensus.cc:513] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } }
I20250625 14:02:05.016814 12173 ts_tablet_manager.cc:1918] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:05.016881 12173 log.cc:1199] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d185c7be82b04fe2a30626a6fb082219
I20250625 14:02:05.017269 13817 leader_election.cc:290] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9b19d4bb9dd34b4c92dd939a17482334 (127.11.39.189:44065), 4ac8e2e2cf5c4faea7755bbad7d23d99 (127.11.39.188:43359)
I20250625 14:02:05.017910 11543 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1220 } } ignore_live_leader: false dest_uuid: "9b19d4bb9dd34b4c92dd939a17482334" is_pre_election: true
I20250625 14:02:05.018757 13836 tablet.cc:1722] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.019023 13085 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1220 } } ignore_live_leader: false dest_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" is_pre_election: true
I20250625 14:02:05.020004 13619 leader_election.cc:304] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b569e7a9e38b4882a89092d98a2f1b9b; no voters: 4ac8e2e2cf5c4faea7755bbad7d23d99, 9b19d4bb9dd34b4c92dd939a17482334
I20250625 14:02:05.020956 12166 tablet_bootstrap.cc:492] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.021134 12166 ts_tablet_manager.cc:1397] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.002s
I20250625 14:02:05.021724 12166 raft_consensus.cc:357] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.021997 12166 raft_consensus.cc:383] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.023335 12166 raft_consensus.cc:738] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.023564 12166 consensus_queue.cc:260] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.023988 12166 ts_tablet_manager.cc:1428] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250625 14:02:05.024369 12177 tablet_replica.cc:331] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.024736 11762 tablet_service.cc:1468] Processing CreateTablet for tablet ae45d9be3a3848da8a01b693e363109b (DEFAULT_TABLE table=default.Table_1ee82ccaed7a448b92f6dcace8a2d8b6 [id=1b01123f7a04474785ad71f82b357fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.024742 13535 tablet.cc:1722] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.025113 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d185c7be82b04fe2a30626a6fb082219 (table default.Table_dc9acbfacd2248c4afbe5de227109f68 [id=2c5856c86f724fca9b7f2f52c6614392]) successfully deleted
I20250625 14:02:05.024959 12177 raft_consensus.cc:2241] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.025044 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae45d9be3a3848da8a01b693e363109b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.026006 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_37e44727f643447ea580d6fa6ebc699a" } new_table_name: "default.Table_3d8edf25dd064095abdacadeb698b45b" modify_external_catalogs: true
I20250625 14:02:05.026988 12167 tablet_bootstrap.cc:654] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.030874 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c6c480793ece4dab9bc7cc716b1ff1d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.031122 12173 ts_tablet_manager.cc:1939] T d185c7be82b04fe2a30626a6fb082219 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:05.031360 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6c480793ece4dab9bc7cc716b1ff1d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.031785 12166 tablet_bootstrap.cc:492] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.031808 12173 tablet_replica.cc:331] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.031950 12173 raft_consensus.cc:2241] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.032127 12173 raft_consensus.cc:2270] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.031738 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 9154f61103b0414c9816c228184d7606 (DEFAULT_TABLE table=default.Table_df2a1e2aa3314729b2ce06dc83366c30 [id=893b4b8b5b6547f495f1f10f8d552437]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.032547 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9154f61103b0414c9816c228184d7606. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.030896 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_946189ff0eea4624816248c3b21c198a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.032797 13817 raft_consensus.cc:2747] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 14:02:05.032902 12166 tablet_bootstrap.cc:654] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.032910 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_946189ff0eea4624816248c3b21c198a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.033658 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a8cf7c9cdc674edd9250a057b4c4e28a" } modify_external_catalogs: true
I20250625 14:02:05.033746 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a8cf7c9cdc674edd9250a057b4c4e28a" } modify_external_catalogs: true
I20250625 14:02:05.030702 12177 raft_consensus.cc:2270] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.035835 12177 ts_tablet_manager.cc:1905] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.037163 12173 ts_tablet_manager.cc:1905] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.039709 12173 ts_tablet_manager.cc:1918] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20250625 14:02:05.039863 12173 log.cc:1199] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/5e4cdf8f78d14c7d8ba3bda009d33719
I20250625 14:02:05.040227 12173 ts_tablet_manager.cc:1939] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.040359 12177 ts_tablet_manager.cc:1918] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.040442 12177 log.cc:1199] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/1fd261d824c34864a7b15e4736254062
I20250625 14:02:05.040652 12177 ts_tablet_manager.cc:1939] T 1fd261d824c34864a7b15e4736254062 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.041074 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 1fd261d824c34864a7b15e4736254062 (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
I20250625 14:02:05.041616 12167 tablet_bootstrap.cc:492] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.041707 12167 ts_tablet_manager.cc:1397] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250625 14:02:05.042129 12167 raft_consensus.cc:357] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.042237 12167 raft_consensus.cc:383] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.042275 12167 raft_consensus.cc:738] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.042426 12167 consensus_queue.cc:260] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.044179 12177 tablet_replica.cc:331] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.044325 12177 raft_consensus.cc:2241] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.044440 12177 raft_consensus.cc:2270] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.044992 12177 ts_tablet_manager.cc:1905] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.045853 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 84a1eb4471544de9afbb5b35d0071dcc (table default.Table_89bc204107184f1aae8f924ca65ecd16 [id=f3af928f08964073b0314bfc509bf634]) successfully deleted
W20250625 14:02:05.046001 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 38ed475ff22e49d6b6962c7c0cd621de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38ed475ff22e49d6b6962c7c0cd621de already in progress: creating tablet
W20250625 14:02:05.046087 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7376f9dc4c8d4ed0a539eceead2a9a23 already in progress: creating tablet
I20250625 14:02:05.046150 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a36ed3e126ef4edfa69fcffb098d0e4f (table default.Table_99867a76f7444c73b03daf2d410e0156 [id=249cebeb7f5b4990ad3776656f4586ab]) successfully deleted
W20250625 14:02:05.046226 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9169d58caf8b440abe39fe2b09859d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9169d58caf8b440abe39fe2b09859d07 already in progress: creating tablet
I20250625 14:02:05.046470 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d185c7be82b04fe2a30626a6fb082219 (table default.Table_dc9acbfacd2248c4afbe5de227109f68 [id=2c5856c86f724fca9b7f2f52c6614392]) successfully deleted
I20250625 14:02:05.046542 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_5171599cd58f4906897a3e7da2c30d6e [id=416264ede8644650b07f6c60ffb3cc52]) successfully deleted
W20250625 14:02:05.046618 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 0f3c5e4b77724849ab5703f84775e370 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f3c5e4b77724849ab5703f84775e370 already in progress: creating tablet
W20250625 14:02:05.046691 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 25dd555e539f4278b9a04c4959a740f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25dd555e539f4278b9a04c4959a740f3 already in progress: creating tablet
W20250625 14:02:05.046767 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 147dbf21a3d242b9a8d7d1389c7cecb5 already in progress: creating tablet
I20250625 14:02:05.048318 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet f325061ce4bb4468886cfe0a0d752596 (table default.Table_e3322169c32b4dd8af57a18e67156a86 [id=cd68b5ad9c1849298e961363e2e27608]). Expected version 1 got 0
I20250625 14:02:05.048441 11528 catalog_manager.cc:5582] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:05.048615 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:05.048715 11528 catalog_manager.cc:5582] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:05.048835 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (table default.Table_88e1a1caf12b4d52b97e8f08d34ffae6 [id=1f4a03c6bde742a581596005b19a818f]). Expected version 1 got 0
I20250625 14:02:05.048954 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 1cfcb08ddbdd43dd92472dcbdc772a2d (table default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb]). Expected version 3 got 0
I20250625 14:02:05.049039 11528 catalog_manager.cc:5582] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:05.049157 11528 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet dfbf6959677547a6a2582b73b2be4c03 (table default.Table_ce207d86e10b457089caedc1452d8318 [id=70d3fc86e64847b9b7edd7945c195dc6]). Expected version 3 got 0
I20250625 14:02:05.049660 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 7353ef647c3649d59fadbd240ccae7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.050040 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 9154f61103b0414c9816c228184d7606 (DEFAULT_TABLE table=default.Table_df2a1e2aa3314729b2ce06dc83366c30 [id=893b4b8b5b6547f495f1f10f8d552437]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.050107 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet f9ed052ae88e4b679ac55177a3bbab88 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.050100 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 9154f61103b0414c9816c228184d7606 (DEFAULT_TABLE table=default.Table_df2a1e2aa3314729b2ce06dc83366c30 [id=893b4b8b5b6547f495f1f10f8d552437]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.050364 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9154f61103b0414c9816c228184d7606. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.050365 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9154f61103b0414c9816c228184d7606. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.052790 12019 tablet_service.cc:1468] Processing CreateTablet for tablet ae45d9be3a3848da8a01b693e363109b (DEFAULT_TABLE table=default.Table_1ee82ccaed7a448b92f6dcace8a2d8b6 [id=1b01123f7a04474785ad71f82b357fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.053033 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae45d9be3a3848da8a01b693e363109b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.052978 11898 tablet_service.cc:1468] Processing CreateTablet for tablet ae45d9be3a3848da8a01b693e363109b (DEFAULT_TABLE table=default.Table_1ee82ccaed7a448b92f6dcace8a2d8b6 [id=1b01123f7a04474785ad71f82b357fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.002734 12175 ts_tablet_manager.cc:1918] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250625 14:02:05.053158 12175 log.cc:1199] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/e98a2085fe67479db141b2675f69a2d9
I20250625 14:02:05.053197 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae45d9be3a3848da8a01b693e363109b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.053465 12175 ts_tablet_manager.cc:1939] T e98a2085fe67479db141b2675f69a2d9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.053915 12172 tablet_bootstrap.cc:492] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.054015 12172 ts_tablet_manager.cc:1397] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.002s
I20250625 14:02:05.054188 12175 tablet_replica.cc:331] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.054360 12175 raft_consensus.cc:2241] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.054558 12175 raft_consensus.cc:2270] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.054520 12172 raft_consensus.cc:357] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.054629 12172 raft_consensus.cc:383] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.054668 12172 raft_consensus.cc:738] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.054793 12172 consensus_queue.cc:260] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.054890 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet e98a2085fe67479db141b2675f69a2d9 (table default.Table_bdb8c169c9af4735b29c0aaa9981261f [id=f25d25a79da644d082f3ae135c27f354]) successfully deleted
I20250625 14:02:05.055116 12172 ts_tablet_manager.cc:1428] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.055328 12172 tablet_bootstrap.cc:492] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.055358 12173 tablet_replica.cc:331] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.055488 12173 raft_consensus.cc:2241] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.055588 12173 raft_consensus.cc:2270] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.056123 12173 ts_tablet_manager.cc:1905] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.056655 12172 tablet_bootstrap.cc:654] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.058424 12173 ts_tablet_manager.cc:1918] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.058490 12173 log.cc:1199] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7353ef647c3649d59fadbd240ccae7bb
I20250625 14:02:05.058709 12173 ts_tablet_manager.cc:1939] T 7353ef647c3649d59fadbd240ccae7bb P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.059513 12177 ts_tablet_manager.cc:1918] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20250625 14:02:05.060182 12177 log.cc:1199] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/5e4cdf8f78d14c7d8ba3bda009d33719
I20250625 14:02:05.060703 12177 ts_tablet_manager.cc:1939] T 5e4cdf8f78d14c7d8ba3bda009d33719 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.062327 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9cbe55597c0742c99750322cdca22289
I20250625 14:02:05.062392 12167 ts_tablet_manager.cc:1428] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20250625 14:02:05.063808 12167 tablet_bootstrap.cc:492] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.063956 12175 ts_tablet_manager.cc:1905] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:05.066529 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 042ea15848cf41949499f9878683bb83 consensus state has no leader
I20250625 14:02:05.066604 12175 ts_tablet_manager.cc:1918] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.066685 12175 log.cc:1199] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/8578d07c9b4a44f887b5a30e92c1ede9
I20250625 14:02:05.066951 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f66aff43813a4455aca34d82e7a4c1a3
I20250625 14:02:05.066984 12175 ts_tablet_manager.cc:1939] T 8578d07c9b4a44f887b5a30e92c1ede9 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.067394 12167 tablet_bootstrap.cc:654] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.067818 12175 tablet_replica.cc:331] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.068011 12175 raft_consensus.cc:2241] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.068138 12175 raft_consensus.cc:2270] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.068868 12172 tablet_bootstrap.cc:492] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.068960 12167 tablet_bootstrap.cc:492] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.068977 12172 ts_tablet_manager.cc:1397] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250625 14:02:05.069037 12167 ts_tablet_manager.cc:1397] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:05.069475 12167 raft_consensus.cc:357] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.069475 12172 raft_consensus.cc:357] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.069578 12167 raft_consensus.cc:383] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.069578 12172 raft_consensus.cc:383] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.069612 12167 raft_consensus.cc:738] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.069612 12172 raft_consensus.cc:738] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.069734 12167 consensus_queue.cc:260] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.069734 12172 consensus_queue.cc:260] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.070003 12167 ts_tablet_manager.cc:1428] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.070045 12172 ts_tablet_manager.cc:1428] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.070206 12167 tablet_bootstrap.cc:492] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.070219 12172 tablet_bootstrap.cc:492] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:05.070927 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9169d58caf8b440abe39fe2b09859d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9169d58caf8b440abe39fe2b09859d07 already in progress: creating tablet
I20250625 14:02:05.071075 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_5171599cd58f4906897a3e7da2c30d6e [id=416264ede8644650b07f6c60ffb3cc52]) successfully deleted
W20250625 14:02:05.071213 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 0f3c5e4b77724849ab5703f84775e370 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f3c5e4b77724849ab5703f84775e370 already in progress: creating tablet
I20250625 14:02:05.071230 12172 tablet_bootstrap.cc:654] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.071230 12167 tablet_bootstrap.cc:654] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.071322 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 147dbf21a3d242b9a8d7d1389c7cecb5 already in progress: creating tablet
W20250625 14:02:05.071440 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 25dd555e539f4278b9a04c4959a740f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25dd555e539f4278b9a04c4959a740f3 already in progress: creating tablet
I20250625 14:02:05.072887 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cbe55597c0742c99750322cdca22289 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.073053 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet f66aff43813a4455aca34d82e7a4c1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.076563 12167 tablet_bootstrap.cc:492] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.076757 12167 ts_tablet_manager.cc:1397] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250625 14:02:05.077369 12167 raft_consensus.cc:357] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.077559 12167 raft_consensus.cc:383] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.077643 12167 raft_consensus.cc:738] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.077821 12167 consensus_queue.cc:260] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.078200 12167 ts_tablet_manager.cc:1428] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.078480 12167 tablet_bootstrap.cc:492] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.078975 12175 ts_tablet_manager.cc:1905] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.079622 12167 tablet_bootstrap.cc:654] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.080911 12172 tablet_bootstrap.cc:492] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.081044 12172 ts_tablet_manager.cc:1397] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:02:05.081535 12172 raft_consensus.cc:357] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.081661 12172 raft_consensus.cc:383] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.081698 12172 raft_consensus.cc:738] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.081820 12172 consensus_queue.cc:260] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.082127 12172 ts_tablet_manager.cc:1428] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.082353 12172 tablet_bootstrap.cc:492] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:05.082638 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9cbe55597c0742c99750322cdca22289 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cbe55597c0742c99750322cdca22289 already in progress: creating tablet
W20250625 14:02:05.082820 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet f66aff43813a4455aca34d82e7a4c1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f66aff43813a4455aca34d82e7a4c1a3 already in progress: creating tablet
I20250625 14:02:05.083041 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_23431076f3204145a60c963da3d5d4da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.083349 12172 tablet_bootstrap.cc:654] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.083495 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23431076f3204145a60c963da3d5d4da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.085520 12175 ts_tablet_manager.cc:1918] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.087774 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95] alter complete (version 1)
I20250625 14:02:05.087965 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 7353ef647c3649d59fadbd240ccae7bb from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.091667 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_fc827ac37eab4719988b70aa93b1519e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.091832 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_2ee174970a064eb48f70813f12594d1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.092135 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc827ac37eab4719988b70aa93b1519e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:05.092164 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ee174970a064eb48f70813f12594d1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.091688 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b99ca2e1eafe4deb969626e446c95014"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.092454 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a541ff958c5d40e5a671a6be42dcbf41" } modify_external_catalogs: true
I20250625 14:02:05.092527 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a541ff958c5d40e5a671a6be42dcbf41" } modify_external_catalogs: true
W20250625 14:02:05.092715 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b99ca2e1eafe4deb969626e446c95014 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.098232 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cbe55597c0742c99750322cdca22289 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.098454 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet f66aff43813a4455aca34d82e7a4c1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.099001 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 8578d07c9b4a44f887b5a30e92c1ede9 (table default.Table_9aa283baefba46e0aba04a8c95c2f3c6 [id=2883f9d8cb1d40b19d6efe5c5f871a82]) successfully deleted
W20250625 14:02:05.099135 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet bb93358ba0104c5bad3e7eba35962030 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb93358ba0104c5bad3e7eba35962030 already in progress: creating tablet
I20250625 14:02:05.099275 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7353ef647c3649d59fadbd240ccae7bb (table default.Table_740cd4b264aa4d3baf5d5c296a06cd43 [id=7ccef3951cff4328a6ba48bd01587a5a]) successfully deleted
I20250625 14:02:05.098067 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 9cbe55597c0742c99750322cdca22289 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:04 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.104327 12175 log.cc:1199] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/54a59027aef04a12a0bf1fbece3c3161
I20250625 14:02:05.098750 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet f66aff43813a4455aca34d82e7a4c1a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.099956 12166 tablet_bootstrap.cc:492] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.104641 12175 ts_tablet_manager.cc:1939] T 54a59027aef04a12a0bf1fbece3c3161 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.104661 12166 ts_tablet_manager.cc:1397] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.001s
I20250625 14:02:05.105173 12166 raft_consensus.cc:357] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.105369 12166 raft_consensus.cc:383] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.105436 12166 raft_consensus.cc:738] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.105921 12166 consensus_queue.cc:260] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.106695 12166 ts_tablet_manager.cc:1428] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:05.107831 12167 tablet_bootstrap.cc:492] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.107991 12167 ts_tablet_manager.cc:1397] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250625 14:02:05.108516 12167 raft_consensus.cc:357] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.108675 12167 raft_consensus.cc:383] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.108741 12167 raft_consensus.cc:738] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.108929 12167 consensus_queue.cc:260] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.110440 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_43faae0acc284124bd4fe83a4846d4f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.111040 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43faae0acc284124bd4fe83a4846d4f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.111480 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_152685b1e6a74938b9531031675cb9d3" } new_table_name: "default.Table_0a0bde34c6cb4c8da873cdb4f8545e18" modify_external_catalogs: true
I20250625 14:02:05.111693 13335 raft_consensus.cc:491] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.111788 13335 raft_consensus.cc:513] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.112268 13335 leader_election.cc:290] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.113068 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d53e9ef9d5f64cb893a552ab0784c120" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.113392 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d53e9ef9d5f64cb893a552ab0784c120" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:05.099375 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9cbe55597c0742c99750322cdca22289 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cbe55597c0742c99750322cdca22289 already in progress: creating tablet
I20250625 14:02:05.113526 12056 raft_consensus.cc:2466] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:02:05.113678 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet f66aff43813a4455aca34d82e7a4c1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f66aff43813a4455aca34d82e7a4c1a3 already in progress: creating tablet
W20250625 14:02:05.113827 11717 leader_election.cc:343] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.114425 11717 leader_election.cc:304] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.114641 13335 raft_consensus.cc:491] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.114708 13335 raft_consensus.cc:513] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.115041 13335 leader_election.cc:290] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.115128 13335 raft_consensus.cc:2802] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.115167 13335 raft_consensus.cc:491] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.115231 13335 raft_consensus.cc:3058] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.116358 13335 raft_consensus.cc:513] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.116730 13335 leader_election.cc:290] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.117501 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10c13ce2b79f4bb9bea6fb3fca4d40a6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.117635 12044 raft_consensus.cc:2466] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:05.117817 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d53e9ef9d5f64cb893a552ab0784c120" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:05.117909 12047 raft_consensus.cc:3058] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.118449 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10c13ce2b79f4bb9bea6fb3fca4d40a6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.118521 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d53e9ef9d5f64cb893a552ab0784c120" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:05.118654 12166 tablet_bootstrap.cc:492] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.119055 12047 raft_consensus.cc:2466] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:05.119457 12167 ts_tablet_manager.cc:1428] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20250625 14:02:05.119715 12167 tablet_bootstrap.cc:492] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.119975 11717 leader_election.cc:304] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:05.120200 11717 leader_election.cc:304] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:05.120357 13699 raft_consensus.cc:2802] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 14:02:05.120378 11717 leader_election.cc:343] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.120412 13699 raft_consensus.cc:491] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.120452 13699 raft_consensus.cc:3058] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:05.120558 11717 leader_election.cc:343] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.120886 13335 raft_consensus.cc:2802] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.121402 13335 raft_consensus.cc:695] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:05.121577 13335 consensus_queue.cc:237] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.121577 13699 raft_consensus.cc:513] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.122488 13699 leader_election.cc:290] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.122524 12167 tablet_bootstrap.cc:654] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.123888 12167 tablet_bootstrap.cc:492] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.123988 12167 ts_tablet_manager.cc:1397] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:05.124647 13334 raft_consensus.cc:491] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.124720 13334 raft_consensus.cc:513] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.125031 12166 tablet_bootstrap.cc:654] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.125051 13334 leader_election.cc:290] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:05.124488 12167 raft_consensus.cc:357] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.125233 12167 raft_consensus.cc:383] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.125280 12167 raft_consensus.cc:738] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.125401 12167 consensus_queue.cc:260] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.125747 12167 ts_tablet_manager.cc:1428] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:02:05.125842 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "292e9c27637d410ea487761f50bdee88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.125972 12167 tablet_bootstrap.cc:492] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.125989 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10c13ce2b79f4bb9bea6fb3fca4d40a6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:05.126205 11717 leader_election.cc:343] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:05.126461 11717 leader_election.cc:343] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.127029 12167 tablet_bootstrap.cc:654] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.129331 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "292e9c27637d410ea487761f50bdee88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.129446 12056 raft_consensus.cc:2466] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:05.129576 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "10c13ce2b79f4bb9bea6fb3fca4d40a6" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:05.129674 12047 raft_consensus.cc:3058] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.130398 11717 leader_election.cc:304] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.130755 12047 raft_consensus.cc:2466] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:05.131314 13856 raft_consensus.cc:2802] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.131381 13856 raft_consensus.cc:491] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.131435 13856 raft_consensus.cc:3058] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.131589 12175 tablet_replica.cc:331] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.131760 12175 raft_consensus.cc:2241] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.131875 12175 raft_consensus.cc:2270] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.132346 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 84a1eb4471544de9afbb5b35d0071dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.132505 13856 raft_consensus.cc:513] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.132896 13856 leader_election.cc:290] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:05.133327 11717 leader_election.cc:304] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.133424 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "292e9c27637d410ea487761f50bdee88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:05.133525 12056 raft_consensus.cc:3058] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.134282 12056 raft_consensus.cc:2466] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:05.134459 13334 raft_consensus.cc:2802] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.134548 13334 raft_consensus.cc:695] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:05.134694 13334 consensus_queue.cc:237] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.134781 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "292e9c27637d410ea487761f50bdee88" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:05.135713 13854 catalog_manager.cc:1261] Loaded cluster ID: a3a3501b615546dbb967e53684a94696
I20250625 14:02:05.135783 13854 catalog_manager.cc:1554] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: loading cluster ID for follower catalog manager: success
I20250625 14:02:05.136662 12175 ts_tablet_manager.cc:1905] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.136796 13232 raft_consensus.cc:491] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 14:02:05.136828 11717 leader_election.cc:343] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.136883 13232 raft_consensus.cc:513] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.136942 11717 leader_election.cc:304] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.137225 13699 raft_consensus.cc:2802] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.137291 13232 leader_election.cc:290] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.137307 13699 raft_consensus.cc:695] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:05.137431 13699 consensus_queue.cc:237] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.138118 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b215f2dc28604d1387e9847a5247564d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.138433 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b215f2dc28604d1387e9847a5247564d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.132258 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 54a59027aef04a12a0bf1fbece3c3161 (table default.Table_7e1ecfc40f504452a262b91cfdf23a1b [id=39a8705a1ef94a78b60acfd8169948c2]) successfully deleted
W20250625 14:02:05.138806 11990 leader_election.cc:343] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:05.139019 11993 leader_election.cc:343] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.139156 11993 leader_election.cc:304] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.139500 13232 raft_consensus.cc:2747] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.139747 12175 ts_tablet_manager.cc:1918] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.139820 12175 log.cc:1199] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/3faa8782ba0d45dbbd89437685a64aef
I20250625 14:02:05.140049 12175 ts_tablet_manager.cc:1939] T 3faa8782ba0d45dbbd89437685a64aef P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.143036 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0fa9ab1010504819ad26e3193c3b4614" } new_table_name: "default.Table_362ffeafdcf14aed96f429c16f5f26e8" modify_external_catalogs: true
I20250625 14:02:05.143682 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6db36f516279421ea24a5c80f1f505af" } new_table_name: "default.Table_32b9498c9d164a948b37a18837bc676b" modify_external_catalogs: true
I20250625 14:02:05.143992 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet f9ed052ae88e4b679ac55177a3bbab88
I20250625 14:02:05.144253 11527 catalog_manager.cc:6652] ReplaceTablet: tablet f9ed052ae88e4b679ac55177a3bbab88 deleted and replaced by tablet 12284afa054544c59b54f66cccb4df66
I20250625 14:02:05.144456 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a8bd0f5efe2744339aaa8f05f6bcffdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.144805 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8bd0f5efe2744339aaa8f05f6bcffdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.145969 11529 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 5fea0b0fa5874d569f26613b85125a2f
I20250625 14:02:05.146637 11532 catalog_manager.cc:5582] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:05.146832 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet edc5b7cc92564ba4ad04f68e18b56dfe (table default.Table_0255a6753f1443abb6d5c32d77404997 [id=205b876e2e7a4f54bbddec9150d67e0a]). Expected version 2 got 0
I20250625 14:02:05.147044 12172 tablet_bootstrap.cc:492] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.147142 12172 ts_tablet_manager.cc:1397] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
I20250625 14:02:05.147614 12172 raft_consensus.cc:357] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.147713 12172 raft_consensus.cc:383] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.147740 12172 raft_consensus.cc:738] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.147877 12172 consensus_queue.cc:260] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.148154 12172 ts_tablet_manager.cc:1428] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.148350 12172 tablet_bootstrap.cc:492] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.149425 12172 tablet_bootstrap.cc:654] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.149672 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet f9ed052ae88e4b679ac55177a3bbab88 with delete_type TABLET_DATA_DELETED (replaced by tablet 12284afa054544c59b54f66cccb4df66) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.149873 12173 tablet_replica.cc:331] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.150028 12173 raft_consensus.cc:2241] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.150161 12173 raft_consensus.cc:2270] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.150609 12173 ts_tablet_manager.cc:1905] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.151144 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9c3797c29c8749c0bc57daae5224dcab" } modify_external_catalogs: true
I20250625 14:02:05.151278 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9c3797c29c8749c0bc57daae5224dcab" } modify_external_catalogs: true
I20250625 14:02:05.151551 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4befcf9542e44983bb76073252702495" } modify_external_catalogs: true
I20250625 14:02:05.151633 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4befcf9542e44983bb76073252702495" } modify_external_catalogs: true
I20250625 14:02:05.153369 12173 ts_tablet_manager.cc:1918] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.153447 12173 log.cc:1199] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f9ed052ae88e4b679ac55177a3bbab88
I20250625 14:02:05.153694 12173 ts_tablet_manager.cc:1939] T f9ed052ae88e4b679ac55177a3bbab88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.157313 12167 tablet_bootstrap.cc:492] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.157418 12167 ts_tablet_manager.cc:1397] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:02:05.157949 12167 raft_consensus.cc:357] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.158059 12167 raft_consensus.cc:383] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.158093 12167 raft_consensus.cc:738] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.158245 12167 consensus_queue.cc:260] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.158268 12166 tablet_bootstrap.cc:492] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.158416 12166 ts_tablet_manager.cc:1397] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250625 14:02:05.158460 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet f9ed052ae88e4b679ac55177a3bbab88 with delete_type TABLET_DATA_DELETED (replaced by tablet 12284afa054544c59b54f66cccb4df66) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.158584 12167 ts_tablet_manager.cc:1428] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.158782 12167 tablet_bootstrap.cc:492] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.159108 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 3faa8782ba0d45dbbd89437685a64aef (table default.Table_f7ef8af8357846339868b61391e6199c [id=492a3d0d7a8e44a9a4e12606ef07a9fd]) successfully deleted
I20250625 14:02:05.159135 13232 raft_consensus.cc:491] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.159214 13232 raft_consensus.cc:513] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.159076 12166 raft_consensus.cc:357] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.159418 12166 raft_consensus.cc:383] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.159475 12166 raft_consensus.cc:738] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.159572 13232 leader_election.cc:290] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.159650 12166 consensus_queue.cc:260] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.158424 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f6c287461864f6dba5f47711eb69fae with delete_type TABLET_DATA_DELETED (replaced by tablet 59556a6da95144f88aa806a7febd6a58) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.161496 12167 tablet_bootstrap.cc:654] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.162166 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b778a1b075794c0a86992066a14d5e11 consensus state has no leader
I20250625 14:02:05.164011 13837 raft_consensus.cc:491] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.164108 13837 raft_consensus.cc:513] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.164507 13837 leader_election.cc:290] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.164584 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]) successfully deleted
W20250625 14:02:05.165490 11855 leader_election.cc:343] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: b9a788be0b8640dc9d6d06fa86580f6b
W20250625 14:02:05.166203 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c342fb25ade45bba64f2130972f70f9 consensus state has no leader
I20250625 14:02:05.166172 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c06757067b3e465f8239b9ff38b68071" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.166741 11990 leader_election.cc:343] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.167250 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 292e9c27637d410ea487761f50bdee88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.167408 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet f9ed052ae88e4b679ac55177a3bbab88 with delete_type TABLET_DATA_DELETED (replaced by tablet 12284afa054544c59b54f66cccb4df66) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.167534 12177 tablet_replica.cc:331] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.167659 12177 raft_consensus.cc:2241] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.167609 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bd07ded692c74d01b5365ba660ca00dd" } new_table_name: "default.Table_a1264bda82fe4bc39be4dcb54ef7d41c" modify_external_catalogs: true
I20250625 14:02:05.167796 12177 pending_rounds.cc:70] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:05.167822 12177 pending_rounds.cc:77] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523072564375552 op_type: NO_OP noop_request { }
I20250625 14:02:05.167897 12177 raft_consensus.cc:2887] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:05.167958 12177 raft_consensus.cc:2270] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.168118 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c06757067b3e465f8239b9ff38b68071" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:02:05.168870 11858 leader_election.cc:343] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: b9a788be0b8640dc9d6d06fa86580f6b
I20250625 14:02:05.168957 11858 leader_election.cc:304] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.168958 12177 ts_tablet_manager.cc:1905] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.169188 13837 raft_consensus.cc:2747] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.170950 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f25aaee07242329014de1834ca881d with delete_type TABLET_DATA_DELETED (replaced by tablet 08b3ba59f0374c6199cd470d136c59ee) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.171105 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.171232 11747 tablet_service.cc:1515] Processing DeleteTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 with delete_type TABLET_DATA_DELETED (replaced by tablet 680b915f4d574d419a611d05ca2ddcfe) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.171332 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.171378 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 with delete_type TABLET_DATA_DELETED (replaced by tablet 680b915f4d574d419a611d05ca2ddcfe) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.171423 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 7353ef647c3649d59fadbd240ccae7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:05.171582 11993 leader_election.cc:343] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.171670 11993 leader_election.cc:304] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.171895 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f25aaee07242329014de1834ca881d with delete_type TABLET_DATA_DELETED (replaced by tablet 08b3ba59f0374c6199cd470d136c59ee) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.172446 12166 ts_tablet_manager.cc:1428] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20250625 14:02:05.172446 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 292e9c27637d410ea487761f50bdee88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.172595 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.173688 13121 raft_consensus.cc:2747] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.179615 12166 tablet_bootstrap.cc:492] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.180567 13352 raft_consensus.cc:491] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.180682 13352 raft_consensus.cc:513] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.180922 12166 tablet_bootstrap.cc:654] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.181193 13352 leader_election.cc:290] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.181634 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fd261d824c34864a7b15e4736254062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:57 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.181720 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f325061ce4bb4468886cfe0a0d752596" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.182102 11990 leader_election.cc:343] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.183398 12175 tablet_replica.cc:331] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.183609 12175 raft_consensus.cc:2241] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.183766 12175 raft_consensus.cc:2270] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.184634 12175 ts_tablet_manager.cc:1905] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:05.185076 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 600c108480fb45e18f8004aea752f233 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 600c108480fb45e18f8004aea752f233 already in progress: creating tablet
W20250625 14:02:05.185268 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 7376f9dc4c8d4ed0a539eceead2a9a23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7376f9dc4c8d4ed0a539eceead2a9a23 already in progress: creating tablet
W20250625 14:02:05.185374 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 38ed475ff22e49d6b6962c7c0cd621de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38ed475ff22e49d6b6962c7c0cd621de already in progress: creating tablet
I20250625 14:02:05.185698 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f325061ce4bb4468886cfe0a0d752596" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.185828 11778 raft_consensus.cc:2466] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:05.186470 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9169d58caf8b440abe39fe2b09859d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9169d58caf8b440abe39fe2b09859d07 already in progress: creating tablet
I20250625 14:02:05.187494 12177 ts_tablet_manager.cc:1918] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:05.187573 12177 log.cc:1199] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/292e9c27637d410ea487761f50bdee88
I20250625 14:02:05.190285 12166 tablet_bootstrap.cc:492] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.190285 12167 tablet_bootstrap.cc:492] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.190412 12167 ts_tablet_manager.cc:1397] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:02:05.190412 12166 ts_tablet_manager.cc:1397] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:02:05.190979 12167 raft_consensus.cc:357] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.191108 12167 raft_consensus.cc:383] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.191146 12167 raft_consensus.cc:738] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.191232 12166 raft_consensus.cc:357] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.191283 12167 consensus_queue.cc:260] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.191330 12166 raft_consensus.cc:383] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.191362 12166 raft_consensus.cc:738] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.191608 12167 ts_tablet_manager.cc:1428] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:05.191576 12166 consensus_queue.cc:260] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.192193 12167 tablet_bootstrap.cc:492] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.193322 12167 tablet_bootstrap.cc:654] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.197589 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet a36ed3e126ef4edfa69fcffb098d0e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.199448 12177 ts_tablet_manager.cc:1939] T 292e9c27637d410ea487761f50bdee88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.199985 12177 tablet_replica.cc:331] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.200219 12177 raft_consensus.cc:2241] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.200439 12177 raft_consensus.cc:2270] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.200484 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 292e9c27637d410ea487761f50bdee88 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
I20250625 14:02:05.200912 12177 ts_tablet_manager.cc:1905] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.201576 12166 ts_tablet_manager.cc:1428] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20250625 14:02:05.201793 11993 leader_election.cc:304] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.202060 13352 raft_consensus.cc:2802] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.202117 13352 raft_consensus.cc:491] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.202153 13352 raft_consensus.cc:3058] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.203239 13352 raft_consensus.cc:513] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.203666 13352 leader_election.cc:290] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.203866 12177 ts_tablet_manager.cc:1918] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.204048 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f325061ce4bb4468886cfe0a0d752596" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:05.204406 11990 leader_election.cc:343] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.206337 12047 raft_consensus.cc:1273] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:05.206512 12177 log.cc:1199] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f9ed052ae88e4b679ac55177a3bbab88
I20250625 14:02:05.206877 11919 raft_consensus.cc:3058] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.207132 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f325061ce4bb4468886cfe0a0d752596" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:05.207240 11784 raft_consensus.cc:3058] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.207988 13334 consensus_queue.cc:1035] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.208120 11919 raft_consensus.cc:1273] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250625 14:02:05.208238 11784 raft_consensus.cc:2466] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:05.208717 12177 ts_tablet_manager.cc:1939] T f9ed052ae88e4b679ac55177a3bbab88 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.209821 12166 tablet_bootstrap.cc:492] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.209836 12177 tablet_replica.cc:331] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.209879 13334 consensus_queue.cc:1035] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.209975 12177 raft_consensus.cc:2241] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.210058 12177 raft_consensus.cc:2270] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.210520 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]) successfully deleted
I20250625 14:02:05.211372 11993 leader_election.cc:304] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.211807 13121 raft_consensus.cc:491] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.211906 13121 raft_consensus.cc:513] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.212284 13121 leader_election.cc:290] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.212546 13121 raft_consensus.cc:2802] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.212608 13121 raft_consensus.cc:695] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:05.212584 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f2f25aaee07242329014de1834ca881d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.212721 13121 consensus_queue.cc:237] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:05.212896 11990 leader_election.cc:343] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.213676 13531 tablet.cc:1722] T 31157f3bd20f4db5a0baa05b61d92f87 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:05.213941 12177 ts_tablet_manager.cc:1905] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.214401 13836 tablet.cc:1722] T 31157f3bd20f4db5a0baa05b61d92f87 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:05.215837 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:05.216953 12175 ts_tablet_manager.cc:1918] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.217217 12175 log.cc:1199] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d185c7be82b04fe2a30626a6fb082219
I20250625 14:02:05.217525 12175 ts_tablet_manager.cc:1939] T d185c7be82b04fe2a30626a6fb082219 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.218367 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d185c7be82b04fe2a30626a6fb082219 (table default.Table_dc9acbfacd2248c4afbe5de227109f68 [id=2c5856c86f724fca9b7f2f52c6614392]) successfully deleted
I20250625 14:02:05.219429 13837 raft_consensus.cc:491] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.219520 13837 raft_consensus.cc:513] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.219907 13837 leader_election.cc:290] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:05.220510 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfbf6959677547a6a2582b73b2be4c03" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.220665 12056 raft_consensus.cc:2391] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:05.221151 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "dfbf6959677547a6a2582b73b2be4c03" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.221860 11858 leader_election.cc:304] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.222098 13837 raft_consensus.cc:3058] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.223212 13837 raft_consensus.cc:2747] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.223457 12166 tablet_bootstrap.cc:654] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.226737 12166 tablet_bootstrap.cc:492] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.227881 12166 ts_tablet_manager.cc:1397] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.002s
I20250625 14:02:05.228449 12166 raft_consensus.cc:357] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:04.801534 13651 rpcz_store.cc:276] 0625 14:02:02.917784 (+ 0us) service_pool.cc:168] Inserting onto call queue
0625 14:02:02.917850 (+ 66us) service_pool.cc:225] Handling call
0625 14:02:04.512266 (+1594416us) raft_consensus.cc:1469] Updating replica for 230 ops
0625 14:02:04.514261 (+ 1995us) raft_consensus.cc:1532] Early marking committed up to index 992
0625 14:02:04.516388 (+ 2127us) raft_consensus.cc:1537] Triggering prepare for 228 ops
0625 14:02:04.516690 (+ 302us) write_op.cc:270] Start()
0625 14:02:04.516743 (+ 53us) write_op.cc:276] Timestamp: P: 1750860120879747 usec, L: 0
0625 14:02:04.516954 (+ 211us) write_op.cc:270] Start()
0625 14:02:04.516972 (+ 18us) write_op.cc:276] Timestamp: P: 1750860120880220 usec, L: 0
0625 14:02:04.517084 (+ 112us) write_op.cc:270] Start()
0625 14:02:04.517100 (+ 16us) write_op.cc:276] Timestamp: P: 1750860120896101 usec, L: 0
0625 14:02:04.517396 (+ 296us) write_op.cc:270] Start()
0625 14:02:04.517423 (+ 27us) write_op.cc:276] Timestamp: P: 1750860120902552 usec, L: 0
0625 14:02:04.517545 (+ 122us) write_op.cc:270] Start()
0625 14:02:04.517567 (+ 22us) write_op.cc:276] Timestamp: P: 1750860120906170 usec, L: 0
0625 14:02:04.517662 (+ 95us) write_op.cc:270] Start()
0625 14:02:04.517675 (+ 13us) write_op.cc:276] Timestamp: P: 1750860120906610 usec, L: 0
0625 14:02:04.517773 (+ 98us) write_op.cc:270] Start()
0625 14:02:04.517825 (+ 52us) write_op.cc:276] Timestamp: P: 1750860120912906 usec, L: 0
0625 14:02:04.517973 (+ 148us) write_op.cc:270] Start()
0625 14:02:04.517991 (+ 18us) write_op.cc:276] Timestamp: P: 1750860120924225 usec, L: 0
0625 14:02:04.518088 (+ 97us) write_op.cc:270] Start()
0625 14:02:04.518101 (+ 13us) write_op.cc:276] Timestamp: P: 1750860120930010 usec, L: 0
0625 14:02:04.518168 (+ 67us) write_op.cc:270] Start()
0625 14:02:04.518178 (+ 10us) write_op.cc:276] Timestamp: P: 1750860120930493 usec, L: 0
0625 14:02:04.518240 (+ 62us) write_op.cc:270] Start()
0625 14:02:04.518251 (+ 11us) write_op.cc:276] Timestamp: P: 1750860120941746 usec, L: 0
0625 14:02:04.518345 (+ 94us) write_op.cc:270] Start()
0625 14:02:04.518357 (+ 12us) write_op.cc:276] Timestamp: P: 1750860120942682 usec, L: 0
0625 14:02:04.518431 (+ 74us) write_op.cc:270] Start()
0625 14:02:04.518446 (+ 15us) write_op.cc:276] Timestamp: P: 1750860120947366 usec, L: 0
0625 14:02:04.518515 (+ 69us) write_op.cc:270] Start()
0625 14:02:04.518527 (+ 12us) write_op.cc:276] Timestamp: P: 1750860120948103 usec, L: 0
0625 14:02:04.518594 (+ 67us) write_op.cc:270] Start()
0625 14:02:04.518609 (+ 15us) write_op.cc:276] Timestamp: P: 1750860120948780 usec, L: 0
0625 14:02:04.518696 (+ 87us) write_op.cc:270] Start()
0625 14:02:04.518706 (+ 10us) write_op.cc:276] Timestamp: P: 1750860120976356 usec, L: 0
0625 14:02:04.518793 (+ 87us) write_op.cc:270] Start()
0625 14:02:04.518804 (+ 11us) write_op.cc:276] Timestamp: P: 1750860120976933 usec, L: 0
0625 14:02:04.518890 (+ 86us) write_op.cc:270] Start()
0625 14:02:04.518902 (+ 12us) write_op.cc:276] Timestamp: P: 1750860120981809 usec, L: 0
0625 14:02:04.518973 (+ 71us) write_op.cc:270] Start()
0625 14:02:04.518984 (+ 11us) write_op.cc:276] Timestamp: P: 1750860120988217 usec, L: 0
0625 14:02:04.519058 (+ 74us) write_op.cc:270] Start()
0625 14:02:04.519069 (+ 11us) write_op.cc:276] Timestamp: P: 1750860120988654 usec, L: 0
0625 14:02:04.519150 (+ 81us) write_op.cc:270] Start()
0625 14:02:04.519162 (+ 12us) write_op.cc:276] Timestamp: P: 1750860120993462 usec, L: 0
0625 14:02:04.519231 (+ 69us) write_op.cc:270] Start()
0625 14:02:04.519243 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121004898 usec, L: 0
0625 14:02:04.519308 (+ 65us) write_op.cc:270] Start()
0625 14:02:04.519319 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121005367 usec, L: 0
0625 14:02:04.519383 (+ 64us) write_op.cc:270] Start()
0625 14:02:04.519394 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121018008 usec, L: 0
0625 14:02:04.519483 (+ 89us) write_op.cc:270] Start()
0625 14:02:04.519498 (+ 15us) write_op.cc:276] Timestamp: P: 1750860121055950 usec, L: 0
0625 14:02:04.519581 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.519597 (+ 16us) write_op.cc:276] Timestamp: P: 1750860121068063 usec, L: 0
0625 14:02:04.519698 (+ 101us) write_op.cc:270] Start()
0625 14:02:04.519711 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121087286 usec, L: 0
0625 14:02:04.519793 (+ 82us) write_op.cc:270] Start()
0625 14:02:04.519806 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121108633 usec, L: 0
0625 14:02:04.519918 (+ 112us) write_op.cc:270] Start()
0625 14:02:04.519931 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121123040 usec, L: 0
0625 14:02:04.520002 (+ 71us) write_op.cc:270] Start()
0625 14:02:04.520014 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121127092 usec, L: 0
0625 14:02:04.520076 (+ 62us) write_op.cc:270] Start()
0625 14:02:04.520088 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121139414 usec, L: 0
0625 14:02:04.520185 (+ 97us) write_op.cc:270] Start()
0625 14:02:04.520199 (+ 14us) write_op.cc:276] Timestamp: P: 1750860121139870 usec, L: 0
0625 14:02:04.520285 (+ 86us) write_op.cc:270] Start()
0625 14:02:04.520298 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121149025 usec, L: 0
0625 14:02:04.520383 (+ 85us) write_op.cc:270] Start()
0625 14:02:04.520396 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121174910 usec, L: 0
0625 14:02:04.520467 (+ 71us) write_op.cc:270] Start()
0625 14:02:04.520495 (+ 28us) write_op.cc:276] Timestamp: P: 1750860121177515 usec, L: 0
0625 14:02:04.520576 (+ 81us) write_op.cc:270] Start()
0625 14:02:04.520595 (+ 19us) write_op.cc:276] Timestamp: P: 1750860121179777 usec, L: 0
0625 14:02:04.520673 (+ 78us) write_op.cc:270] Start()
0625 14:02:04.520685 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121187709 usec, L: 0
0625 14:02:04.520766 (+ 81us) write_op.cc:270] Start()
0625 14:02:04.520781 (+ 15us) write_op.cc:276] Timestamp: P: 1750860121188240 usec, L: 0
0625 14:02:04.520892 (+ 111us) write_op.cc:270] Start()
0625 14:02:04.520905 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121188668 usec, L: 0
0625 14:02:04.520994 (+ 89us) write_op.cc:270] Start()
0625 14:02:04.521010 (+ 16us) write_op.cc:276] Timestamp: P: 1750860121195648 usec, L: 0
0625 14:02:04.521094 (+ 84us) write_op.cc:270] Start()
0625 14:02:04.521106 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121224630 usec, L: 0
0625 14:02:04.521206 (+ 100us) write_op.cc:270] Start()
0625 14:02:04.521219 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121227103 usec, L: 0
0625 14:02:04.521302 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.521317 (+ 15us) write_op.cc:276] Timestamp: P: 1750860121247884 usec, L: 0
0625 14:02:04.521394 (+ 77us) write_op.cc:270] Start()
0625 14:02:04.521408 (+ 14us) write_op.cc:276] Timestamp: P: 1750860121251707 usec, L: 0
0625 14:02:04.521483 (+ 75us) write_op.cc:270] Start()
0625 14:02:04.521496 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121255708 usec, L: 0
0625 14:02:04.521587 (+ 91us) write_op.cc:270] Start()
0625 14:02:04.521601 (+ 14us) write_op.cc:276] Timestamp: P: 1750860121256136 usec, L: 0
0625 14:02:04.521676 (+ 75us) write_op.cc:270] Start()
0625 14:02:04.521688 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121261006 usec, L: 0
0625 14:02:04.521761 (+ 73us) write_op.cc:270] Start()
0625 14:02:04.521772 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121267973 usec, L: 0
0625 14:02:04.521881 (+ 109us) write_op.cc:270] Start()
0625 14:02:04.521896 (+ 15us) write_op.cc:276] Timestamp: P: 1750860121270919 usec, L: 0
0625 14:02:04.521983 (+ 87us) write_op.cc:270] Start()
0625 14:02:04.521995 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121282486 usec, L: 0
0625 14:02:04.522077 (+ 82us) write_op.cc:270] Start()
0625 14:02:04.522089 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121282909 usec, L: 0
0625 14:02:04.522153 (+ 64us) write_op.cc:270] Start()
0625 14:02:04.522164 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121284873 usec, L: 0
0625 14:02:04.522226 (+ 62us) write_op.cc:270] Start()
0625 14:02:04.522237 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121286026 usec, L: 0
0625 14:02:04.536902 (+ 14665us) write_op.cc:270] Start()
0625 14:02:04.536933 (+ 31us) write_op.cc:276] Timestamp: P: 1750860121287566 usec, L: 0
0625 14:02:04.537097 (+ 164us) write_op.cc:270] Start()
0625 14:02:04.537117 (+ 20us) write_op.cc:276] Timestamp: P: 1750860121354765 usec, L: 0
0625 14:02:04.537206 (+ 89us) write_op.cc:270] Start()
0625 14:02:04.537219 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121356082 usec, L: 0
0625 14:02:04.537291 (+ 72us) write_op.cc:270] Start()
0625 14:02:04.537303 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121357960 usec, L: 0
0625 14:02:04.537369 (+ 66us) write_op.cc:270] Start()
0625 14:02:04.537381 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121369704 usec, L: 0
0625 14:02:04.537476 (+ 95us) write_op.cc:270] Start()
0625 14:02:04.537492 (+ 16us) write_op.cc:276] Timestamp: P: 1750860121370250 usec, L: 0
0625 14:02:04.537576 (+ 84us) write_op.cc:270] Start()
0625 14:02:04.537594 (+ 18us) write_op.cc:276] Timestamp: P: 1750860121371244 usec, L: 0
0625 14:02:04.537667 (+ 73us) write_op.cc:270] Start()
0625 14:02:04.537683 (+ 16us) write_op.cc:276] Timestamp: P: 1750860121375233 usec, L: 0
0625 14:02:04.537782 (+ 99us) write_op.cc:270] Start()
0625 14:02:04.537800 (+ 18us) write_op.cc:276] Timestamp: P: 1750860121414681 usec, L: 0
0625 14:02:04.537895 (+ 95us) write_op.cc:270] Start()
0625 14:02:04.537911 (+ 16us) write_op.cc:276] Timestamp: P: 1750860121420990 usec, L: 0
0625 14:02:04.538024 (+ 113us) write_op.cc:270] Start()
0625 14:02:04.538037 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121431117 usec, L: 0
0625 14:02:04.538117 (+ 80us) write_op.cc:270] Start()
0625 14:02:04.538128 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121431735 usec, L: 0
0625 14:02:04.538209 (+ 81us) write_op.cc:270] Start()
0625 14:02:04.538221 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121450569 usec, L: 0
0625 14:02:04.538335 (+ 114us) write_op.cc:270] Start()
0625 14:02:04.538350 (+ 15us) write_op.cc:276] Timestamp: P: 1750860121457959 usec, L: 0
0625 14:02:04.538451 (+ 101us) write_op.cc:270] Start()
0625 14:02:04.538464 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121458933 usec, L: 0
0625 14:02:04.538544 (+ 80us) write_op.cc:270] Start()
0625 14:02:04.538554 (+ 10us) write_op.cc:276] Timestamp: P: 1750860121467809 usec, L: 0
0625 14:02:04.538613 (+ 59us) write_op.cc:270] Start()
0625 14:02:04.538624 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121484350 usec, L: 0
0625 14:02:04.538693 (+ 69us) write_op.cc:270] Start()
0625 14:02:04.538704 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121487815 usec, L: 0
0625 14:02:04.538767 (+ 63us) write_op.cc:270] Start()
0625 14:02:04.538778 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121488346 usec, L: 0
0625 14:02:04.538842 (+ 64us) write_op.cc:270] Start()
0625 14:02:04.538853 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121527981 usec, L: 0
0625 14:02:04.538916 (+ 63us) write_op.cc:270] Start()
0625 14:02:04.538928 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121547443 usec, L: 0
0625 14:02:04.539033 (+ 105us) write_op.cc:270] Start()
0625 14:02:04.539046 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121571737 usec, L: 0
0625 14:02:04.539114 (+ 68us) write_op.cc:270] Start()
0625 14:02:04.539125 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121572658 usec, L: 0
0625 14:02:04.539201 (+ 76us) write_op.cc:270] Start()
0625 14:02:04.539213 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121574778 usec, L: 0
0625 14:02:04.539282 (+ 69us) write_op.cc:270] Start()
0625 14:02:04.539295 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121575339 usec, L: 0
0625 14:02:04.539374 (+ 79us) write_op.cc:270] Start()
0625 14:02:04.539397 (+ 23us) write_op.cc:276] Timestamp: P: 1750860121575779 usec, L: 0
0625 14:02:04.539518 (+ 121us) write_op.cc:270] Start()
0625 14:02:04.539535 (+ 17us) write_op.cc:276] Timestamp: P: 1750860121608917 usec, L: 0
0625 14:02:04.539618 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.539629 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121609754 usec, L: 0
0625 14:02:04.539694 (+ 65us) write_op.cc:270] Start()
0625 14:02:04.539706 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121613116 usec, L: 0
0625 14:02:04.539783 (+ 77us) write_op.cc:270] Start()
0625 14:02:04.539793 (+ 10us) write_op.cc:276] Timestamp: P: 1750860121621973 usec, L: 0
0625 14:02:04.539854 (+ 61us) write_op.cc:270] Start()
0625 14:02:04.539865 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121632154 usec, L: 0
0625 14:02:04.539924 (+ 59us) write_op.cc:270] Start()
0625 14:02:04.539933 (+ 9us) write_op.cc:276] Timestamp: P: 1750860121640680 usec, L: 0
0625 14:02:04.540020 (+ 87us) write_op.cc:270] Start()
0625 14:02:04.540032 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121653942 usec, L: 0
0625 14:02:04.540109 (+ 77us) write_op.cc:270] Start()
0625 14:02:04.540121 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121654537 usec, L: 0
0625 14:02:04.540183 (+ 62us) write_op.cc:270] Start()
0625 14:02:04.540194 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121658932 usec, L: 0
0625 14:02:04.540258 (+ 64us) write_op.cc:270] Start()
0625 14:02:04.540270 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121665363 usec, L: 0
0625 14:02:04.540353 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.540366 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121669967 usec, L: 0
0625 14:02:04.540452 (+ 86us) write_op.cc:270] Start()
0625 14:02:04.540465 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121672151 usec, L: 0
0625 14:02:04.540549 (+ 84us) write_op.cc:270] Start()
0625 14:02:04.540561 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121690364 usec, L: 0
0625 14:02:04.540637 (+ 76us) write_op.cc:270] Start()
0625 14:02:04.540651 (+ 14us) write_op.cc:276] Timestamp: P: 1750860121696862 usec, L: 0
0625 14:02:04.540735 (+ 84us) write_op.cc:270] Start()
0625 14:02:04.540748 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121715482 usec, L: 0
0625 14:02:04.541101 (+ 353us) write_op.cc:270] Start()
0625 14:02:04.541120 (+ 19us) write_op.cc:276] Timestamp: P: 1750860121716015 usec, L: 0
0625 14:02:04.541220 (+ 100us) write_op.cc:270] Start()
0625 14:02:04.541232 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121747848 usec, L: 0
0625 14:02:04.541318 (+ 86us) write_op.cc:270] Start()
0625 14:02:04.541329 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121752410 usec, L: 0
0625 14:02:04.541394 (+ 65us) write_op.cc:270] Start()
0625 14:02:04.541407 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121767243 usec, L: 0
0625 14:02:04.541483 (+ 76us) write_op.cc:270] Start()
0625 14:02:04.541495 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121767855 usec, L: 0
0625 14:02:04.541560 (+ 65us) write_op.cc:270] Start()
0625 14:02:04.541571 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121800807 usec, L: 0
0625 14:02:04.541633 (+ 62us) write_op.cc:270] Start()
0625 14:02:04.541644 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121802187 usec, L: 0
0625 14:02:04.541723 (+ 79us) write_op.cc:270] Start()
0625 14:02:04.541735 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121802689 usec, L: 0
0625 14:02:04.541828 (+ 93us) write_op.cc:270] Start()
0625 14:02:04.541840 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121803137 usec, L: 0
0625 14:02:04.541906 (+ 66us) write_op.cc:270] Start()
0625 14:02:04.541917 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121806062 usec, L: 0
0625 14:02:04.541994 (+ 77us) write_op.cc:270] Start()
0625 14:02:04.542007 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121817526 usec, L: 0
0625 14:02:04.542072 (+ 65us) write_op.cc:270] Start()
0625 14:02:04.542083 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121830288 usec, L: 0
0625 14:02:04.542160 (+ 77us) write_op.cc:270] Start()
0625 14:02:04.542172 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121830860 usec, L: 0
0625 14:02:04.542259 (+ 87us) write_op.cc:270] Start()
0625 14:02:04.542272 (+ 13us) write_op.cc:276] Timestamp: P: 1750860121840476 usec, L: 0
0625 14:02:04.542677 (+ 405us) write_op.cc:270] Start()
0625 14:02:04.542698 (+ 21us) write_op.cc:276] Timestamp: P: 1750860121887828 usec, L: 0
0625 14:02:04.542791 (+ 93us) write_op.cc:270] Start()
0625 14:02:04.542807 (+ 16us) write_op.cc:276] Timestamp: P: 1750860121888897 usec, L: 0
0625 14:02:04.543070 (+ 263us) write_op.cc:270] Start()
0625 14:02:04.543089 (+ 19us) write_op.cc:276] Timestamp: P: 1750860121892704 usec, L: 0
0625 14:02:04.543201 (+ 112us) write_op.cc:270] Start()
0625 14:02:04.543215 (+ 14us) write_op.cc:276] Timestamp: P: 1750860121896232 usec, L: 0
0625 14:02:04.543289 (+ 74us) write_op.cc:270] Start()
0625 14:02:04.543300 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121896574 usec, L: 0
0625 14:02:04.544618 (+ 1318us) write_op.cc:270] Start()
0625 14:02:04.544639 (+ 21us) write_op.cc:276] Timestamp: P: 1750860121896865 usec, L: 0
0625 14:02:04.544958 (+ 319us) write_op.cc:270] Start()
0625 14:02:04.544979 (+ 21us) write_op.cc:276] Timestamp: P: 1750860121897152 usec, L: 0
0625 14:02:04.545085 (+ 106us) write_op.cc:270] Start()
0625 14:02:04.545102 (+ 17us) write_op.cc:276] Timestamp: P: 1750860121897715 usec, L: 0
0625 14:02:04.545196 (+ 94us) write_op.cc:270] Start()
0625 14:02:04.545210 (+ 14us) write_op.cc:276] Timestamp: P: 1750860121927392 usec, L: 0
0625 14:02:04.545290 (+ 80us) write_op.cc:270] Start()
0625 14:02:04.545302 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121938660 usec, L: 0
0625 14:02:04.545909 (+ 607us) write_op.cc:270] Start()
0625 14:02:04.545929 (+ 20us) write_op.cc:276] Timestamp: P: 1750860121939151 usec, L: 0
0625 14:02:04.546032 (+ 103us) write_op.cc:270] Start()
0625 14:02:04.546046 (+ 14us) write_op.cc:276] Timestamp: P: 1750860121944466 usec, L: 0
0625 14:02:04.546116 (+ 70us) write_op.cc:270] Start()
0625 14:02:04.546128 (+ 12us) write_op.cc:276] Timestamp: P: 1750860121948373 usec, L: 0
0625 14:02:04.546197 (+ 69us) write_op.cc:270] Start()
0625 14:02:04.546208 (+ 11us) write_op.cc:276] Timestamp: P: 1750860121948774 usec, L: 0
0625 14:02:04.546291 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.546335 (+ 44us) write_op.cc:276] Timestamp: P: 1750860121951536 usec, L: 0
0625 14:02:04.546430 (+ 95us) write_op.cc:270] Start()
0625 14:02:04.546444 (+ 14us) write_op.cc:276] Timestamp: P: 1750860122000498 usec, L: 0
0625 14:02:04.546520 (+ 76us) write_op.cc:270] Start()
0625 14:02:04.546533 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122004010 usec, L: 0
0625 14:02:04.546630 (+ 97us) write_op.cc:270] Start()
0625 14:02:04.546648 (+ 18us) write_op.cc:276] Timestamp: P: 1750860122007502 usec, L: 0
0625 14:02:04.546731 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.546744 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122007997 usec, L: 0
0625 14:02:04.546829 (+ 85us) write_op.cc:270] Start()
0625 14:02:04.546841 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122041625 usec, L: 0
0625 14:02:04.546932 (+ 91us) write_op.cc:270] Start()
0625 14:02:04.547048 (+ 116us) write_op.cc:276] Timestamp: P: 1750860122054934 usec, L: 0
0625 14:02:04.547211 (+ 163us) write_op.cc:270] Start()
0625 14:02:04.547227 (+ 16us) write_op.cc:276] Timestamp: P: 1750860122055454 usec, L: 0
0625 14:02:04.547325 (+ 98us) write_op.cc:270] Start()
0625 14:02:04.547345 (+ 20us) write_op.cc:276] Timestamp: P: 1750860122055880 usec, L: 0
0625 14:02:04.547421 (+ 76us) write_op.cc:270] Start()
0625 14:02:04.547435 (+ 14us) write_op.cc:276] Timestamp: P: 1750860122082953 usec, L: 0
0625 14:02:04.547506 (+ 71us) write_op.cc:270] Start()
0625 14:02:04.547518 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122083808 usec, L: 0
0625 14:02:04.547589 (+ 71us) write_op.cc:270] Start()
0625 14:02:04.547601 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122084890 usec, L: 0
0625 14:02:04.547682 (+ 81us) write_op.cc:270] Start()
0625 14:02:04.547693 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122088442 usec, L: 0
0625 14:02:04.547774 (+ 81us) write_op.cc:270] Start()
0625 14:02:04.547792 (+ 18us) write_op.cc:276] Timestamp: P: 1750860122104435 usec, L: 0
0625 14:02:04.547890 (+ 98us) write_op.cc:270] Start()
0625 14:02:04.547902 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122113012 usec, L: 0
0625 14:02:04.547996 (+ 94us) write_op.cc:270] Start()
0625 14:02:04.548011 (+ 15us) write_op.cc:276] Timestamp: P: 1750860122113522 usec, L: 0
0625 14:02:04.548100 (+ 89us) write_op.cc:270] Start()
0625 14:02:04.548113 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122126259 usec, L: 0
0625 14:02:04.548196 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.548215 (+ 19us) write_op.cc:276] Timestamp: P: 1750860122126997 usec, L: 0
0625 14:02:04.548299 (+ 84us) write_op.cc:270] Start()
0625 14:02:04.548310 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122127407 usec, L: 0
0625 14:02:04.548401 (+ 91us) write_op.cc:270] Start()
0625 14:02:04.548415 (+ 14us) write_op.cc:276] Timestamp: P: 1750860122127980 usec, L: 0
0625 14:02:04.548505 (+ 90us) write_op.cc:270] Start()
0625 14:02:04.548517 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122128600 usec, L: 0
0625 14:02:04.548602 (+ 85us) write_op.cc:270] Start()
0625 14:02:04.548618 (+ 16us) write_op.cc:276] Timestamp: P: 1750860122129492 usec, L: 0
0625 14:02:04.548693 (+ 75us) write_op.cc:270] Start()
0625 14:02:04.548708 (+ 15us) write_op.cc:276] Timestamp: P: 1750860122153065 usec, L: 0
0625 14:02:04.548789 (+ 81us) write_op.cc:270] Start()
0625 14:02:04.548802 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122153784 usec, L: 0
0625 14:02:04.548899 (+ 97us) write_op.cc:270] Start()
0625 14:02:04.548915 (+ 16us) write_op.cc:276] Timestamp: P: 1750860122154342 usec, L: 0
0625 14:02:04.549025 (+ 110us) write_op.cc:270] Start()
0625 14:02:04.549043 (+ 18us) write_op.cc:276] Timestamp: P: 1750860122163582 usec, L: 0
0625 14:02:04.549115 (+ 72us) write_op.cc:270] Start()
0625 14:02:04.549126 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122164080 usec, L: 0
0625 14:02:04.549196 (+ 70us) write_op.cc:270] Start()
0625 14:02:04.549207 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122173304 usec, L: 0
0625 14:02:04.549295 (+ 88us) write_op.cc:270] Start()
0625 14:02:04.549309 (+ 14us) write_op.cc:276] Timestamp: P: 1750860122207103 usec, L: 0
0625 14:02:04.549396 (+ 87us) write_op.cc:270] Start()
0625 14:02:04.549410 (+ 14us) write_op.cc:276] Timestamp: P: 1750860122223169 usec, L: 0
0625 14:02:04.549482 (+ 72us) write_op.cc:270] Start()
0625 14:02:04.549493 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122228340 usec, L: 0
0625 14:02:04.549572 (+ 79us) write_op.cc:270] Start()
0625 14:02:04.549583 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122229295 usec, L: 0
0625 14:02:04.549667 (+ 84us) write_op.cc:270] Start()
0625 14:02:04.549680 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122235973 usec, L: 0
0625 14:02:04.549748 (+ 68us) write_op.cc:270] Start()
0625 14:02:04.549761 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122265643 usec, L: 0
0625 14:02:04.549828 (+ 67us) write_op.cc:270] Start()
0625 14:02:04.549840 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122274355 usec, L: 0
0625 14:02:04.549945 (+ 105us) write_op.cc:270] Start()
0625 14:02:04.549961 (+ 16us) write_op.cc:276] Timestamp: P: 1750860122275688 usec, L: 0
0625 14:02:04.550076 (+ 115us) write_op.cc:270] Start()
0625 14:02:04.550093 (+ 17us) write_op.cc:276] Timestamp: P: 1750860122293605 usec, L: 0
0625 14:02:04.550188 (+ 95us) write_op.cc:270] Start()
0625 14:02:04.550201 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122294212 usec, L: 0
0625 14:02:04.550284 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.550296 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122314759 usec, L: 0
0625 14:02:04.550411 (+ 115us) write_op.cc:270] Start()
0625 14:02:04.550424 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122316350 usec, L: 0
0625 14:02:04.550517 (+ 93us) write_op.cc:270] Start()
0625 14:02:04.550530 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122345990 usec, L: 0
0625 14:02:04.550624 (+ 94us) write_op.cc:270] Start()
0625 14:02:04.550644 (+ 20us) write_op.cc:276] Timestamp: P: 1750860122347751 usec, L: 0
0625 14:02:04.550749 (+ 105us) write_op.cc:270] Start()
0625 14:02:04.550766 (+ 17us) write_op.cc:276] Timestamp: P: 1750860122349378 usec, L: 0
0625 14:02:04.550853 (+ 87us) write_op.cc:270] Start()
0625 14:02:04.550866 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122351629 usec, L: 0
0625 14:02:04.550992 (+ 126us) write_op.cc:270] Start()
0625 14:02:04.551035 (+ 43us) write_op.cc:276] Timestamp: P: 1750860122352009 usec, L: 0
0625 14:02:04.551150 (+ 115us) write_op.cc:270] Start()
0625 14:02:04.551163 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122366125 usec, L: 0
0625 14:02:04.551239 (+ 76us) write_op.cc:270] Start()
0625 14:02:04.551253 (+ 14us) write_op.cc:276] Timestamp: P: 1750860122373262 usec, L: 0
0625 14:02:04.551334 (+ 81us) write_op.cc:270] Start()
0625 14:02:04.551348 (+ 14us) write_op.cc:276] Timestamp: P: 1750860122374444 usec, L: 0
0625 14:02:04.551431 (+ 83us) write_op.cc:270] Start()
0625 14:02:04.551443 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122381419 usec, L: 0
0625 14:02:04.551502 (+ 59us) write_op.cc:270] Start()
0625 14:02:04.551512 (+ 10us) write_op.cc:276] Timestamp: P: 1750860122382551 usec, L: 0
0625 14:02:04.551574 (+ 62us) write_op.cc:270] Start()
0625 14:02:04.551586 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122384404 usec, L: 0
0625 14:02:04.551658 (+ 72us) write_op.cc:270] Start()
0625 14:02:04.551669 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122421056 usec, L: 0
0625 14:02:04.551743 (+ 74us) write_op.cc:270] Start()
0625 14:02:04.551754 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122421588 usec, L: 0
0625 14:02:04.551832 (+ 78us) write_op.cc:270] Start()
0625 14:02:04.551842 (+ 10us) write_op.cc:276] Timestamp: P: 1750860122456217 usec, L: 0
0625 14:02:04.551905 (+ 63us) write_op.cc:270] Start()
0625 14:02:04.551929 (+ 24us) write_op.cc:276] Timestamp: P: 1750860122467097 usec, L: 0
0625 14:02:04.557196 (+ 5267us) write_op.cc:270] Start()
0625 14:02:04.557231 (+ 35us) write_op.cc:276] Timestamp: P: 1750860122476481 usec, L: 0
0625 14:02:04.557428 (+ 197us) write_op.cc:270] Start()
0625 14:02:04.557452 (+ 24us) write_op.cc:276] Timestamp: P: 1750860122476989 usec, L: 0
0625 14:02:04.557550 (+ 98us) write_op.cc:270] Start()
0625 14:02:04.557562 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122482773 usec, L: 0
0625 14:02:04.557652 (+ 90us) write_op.cc:270] Start()
0625 14:02:04.557670 (+ 18us) write_op.cc:276] Timestamp: P: 1750860122495532 usec, L: 0
0625 14:02:04.557752 (+ 82us) write_op.cc:270] Start()
0625 14:02:04.557764 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122498519 usec, L: 0
0625 14:02:04.557866 (+ 102us) write_op.cc:270] Start()
0625 14:02:04.557880 (+ 14us) write_op.cc:276] Timestamp: P: 1750860122534697 usec, L: 0
0625 14:02:04.557979 (+ 99us) write_op.cc:270] Start()
0625 14:02:04.557992 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122555358 usec, L: 0
0625 14:02:04.558069 (+ 77us) write_op.cc:270] Start()
0625 14:02:04.558082 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122556186 usec, L: 0
0625 14:02:04.558141 (+ 59us) write_op.cc:270] Start()
0625 14:02:04.558150 (+ 9us) write_op.cc:276] Timestamp: P: 1750860122559514 usec, L: 0
0625 14:02:04.558218 (+ 68us) write_op.cc:270] Start()
0625 14:02:04.558229 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122564905 usec, L: 0
0625 14:02:04.558535 (+ 306us) write_op.cc:270] Start()
0625 14:02:04.558553 (+ 18us) write_op.cc:276] Timestamp: P: 1750860122565367 usec, L: 0
0625 14:02:04.558665 (+ 112us) write_op.cc:270] Start()
0625 14:02:04.558678 (+ 13us) write_op.cc:276] Timestamp: P: 1750860122570131 usec, L: 0
0625 14:02:04.558748 (+ 70us) write_op.cc:270] Start()
0625 14:02:04.558758 (+ 10us) write_op.cc:276] Timestamp: P: 1750860122570565 usec, L: 0
0625 14:02:04.558833 (+ 75us) write_op.cc:270] Start()
0625 14:02:04.558845 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122581586 usec, L: 0
0625 14:02:04.558929 (+ 84us) write_op.cc:270] Start()
0625 14:02:04.558941 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122594842 usec, L: 0
0625 14:02:04.559005 (+ 64us) write_op.cc:270] Start()
0625 14:02:04.559015 (+ 10us) write_op.cc:276] Timestamp: P: 1750860122595307 usec, L: 0
0625 14:02:04.559076 (+ 61us) write_op.cc:270] Start()
0625 14:02:04.559087 (+ 11us) write_op.cc:276] Timestamp: P: 1750860122595671 usec, L: 0
0625 14:02:04.559166 (+ 79us) write_op.cc:270] Start()
0625 14:02:04.559178 (+ 12us) write_op.cc:276] Timestamp: P: 1750860122596017 usec, L: 0
0625 14:02:04.560698 (+ 1520us) write_op.cc:270] Start()
0625 14:02:04.560718 (+ 20us) write_op.cc:276] Timestamp: P: 1750860122600876 usec, L: 0
0625 14:02:04.560810 (+ 92us) write_op.cc:270] Start()
0625 14:02:04.560824 (+ 14us) write_op.cc:276] Timestamp: P: 17508
I20250625 14:02:05.230468 12173 tablet_replica.cc:331] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.230633 12173 raft_consensus.cc:2241] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.230751 12173 raft_consensus.cc:2270] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.231384 12173 ts_tablet_manager.cc:1905] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.232036 12166 raft_consensus.cc:383] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.232156 12166 raft_consensus.cc:738] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.232486 12166 consensus_queue.cc:260] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.232678 13837 raft_consensus.cc:491] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.232738 13837 raft_consensus.cc:513] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.233078 13837 leader_election.cc:290] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.233647 13535 tablet.cc:1722] T 31157f3bd20f4db5a0baa05b61d92f87 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:05.233757 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae093ced6ff4255b75f634701ed259b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.233906 12056 raft_consensus.cc:2391] T 3ae093ced6ff4255b75f634701ed259b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:05.233973 13872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9b19d4bb9dd34b4c92dd939a17482334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b569e7a9e38b4882a89092d98a2f1b9b" member_type: VOTER last_known_addr { host: "127.11.39.190" port: 38199 } } peers { permanent_uuid: "9b19d4bb9dd34b4c92dd939a17482334" member_type: VOTER last_known_addr { host: "127.11.39.189" port: 44065 } } peers { permanent_uuid: "4ac8e2e2cf5c4faea7755bbad7d23d99" member_type: VOTER last_known_addr { host: "127.11.39.188" port: 43359 } } }
I20250625 14:02:05.234087 13872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334 [sys.catalog]: This master's current role is: LEADER
I20250625 14:02:05.234416 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "f2f25aaee07242329014de1834ca881d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.234619 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "3ae093ced6ff4255b75f634701ed259b" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.236016 11855 leader_election.cc:304] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.236259 13837 raft_consensus.cc:3058] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.237270 13837 raft_consensus.cc:2747] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:05.237716 11993 leader_election.cc:343] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: Tablet not RUNNING: STOPPED
I20250625 14:02:05.237798 11993 leader_election.cc:304] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.238045 13352 raft_consensus.cc:2747] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.240654 12166 ts_tablet_manager.cc:1428] T 3ae093ced6ff4255b75f634701ed259b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20250625 14:02:05.240993 12166 tablet_bootstrap.cc:492] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.242250 12166 tablet_bootstrap.cc:654] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.242482 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3f3555d6f5a14a25b9e96bf4f60eda6c
I20250625 14:02:05.242928 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 70a02be03e4f42929e3cd0c521a00859
I20250625 14:02:05.243803 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.243996 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 70a02be03e4f42929e3cd0c521a00859 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.244686 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.245114 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 70a02be03e4f42929e3cd0c521a00859 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.245615 12173 ts_tablet_manager.cc:1918] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.245707 12173 log.cc:1199] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/d53e9ef9d5f64cb893a552ab0784c120
I20250625 14:02:05.245958 12173 ts_tablet_manager.cc:1939] T d53e9ef9d5f64cb893a552ab0784c120 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.246773 12173 tablet_replica.cc:331] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.246919 12173 raft_consensus.cc:2241] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.247045 12173 raft_consensus.cc:2270] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.243515 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.244303 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 70a02be03e4f42929e3cd0c521a00859 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.249326 13837 raft_consensus.cc:491] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.251953 13837 raft_consensus.cc:513] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.252408 13837 leader_election.cc:290] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:05.253123 11858 leader_election.cc:343] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 84a1eb4471544de9afbb5b35d0071dcc
I20250625 14:02:05.253258 12177 ts_tablet_manager.cc:1918] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.253340 12177 log.cc:1199] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/f2f25aaee07242329014de1834ca881d
I20250625 14:02:05.253544 12177 ts_tablet_manager.cc:1939] T f2f25aaee07242329014de1834ca881d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:02:05.253962 11855 leader_election.cc:343] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 84a1eb4471544de9afbb5b35d0071dcc
I20250625 14:02:05.254030 11855 leader_election.cc:304] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.254262 13837 raft_consensus.cc:2747] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.254523 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet d53e9ef9d5f64cb893a552ab0784c120 (table default.Table_06f52f09f53f4abf9d515f309f225205 [id=c3c11e126c464fdb8861f40571c798f2]) successfully deleted
I20250625 14:02:05.254729 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 3a5c9b1852a847188bb7e2f08a37fded from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.255029 12173 ts_tablet_manager.cc:1905] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.258879 12173 ts_tablet_manager.cc:1918] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.259032 12173 log.cc:1199] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/f2f25aaee07242329014de1834ca881d
I20250625 14:02:05.259426 12173 ts_tablet_manager.cc:1939] T f2f25aaee07242329014de1834ca881d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.260347 13535 tablet.cc:1722] T 7160c6353e2d48d8a5d5a71563797051 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.262352 12177 tablet_replica.cc:331] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.262578 12175 tablet_replica.cc:331] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.262773 12175 raft_consensus.cc:2241] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.264958 12177 raft_consensus.cc:2241] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.266404 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_0a0bde34c6cb4c8da873cdb4f8545e18 [id=03079048fe6d402892c777db10632ff7] alter complete (version 2)
I20250625 14:02:05.267127 12175 raft_consensus.cc:2270] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.264448 13837 raft_consensus.cc:491] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.266255 12672 mvcc.cc:204] Tried to move back new op lower bound from 7171523072826032128 to 7171523071377362944. Current Snapshot: MvccSnapshot[applied={T|T < 7171523072826032128}]
I20250625 14:02:05.267241 13837 raft_consensus.cc:513] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.267349 12177 raft_consensus.cc:2270] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.267618 13837 leader_election.cc:290] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.267943 12175 ts_tablet_manager.cc:1905] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.268393 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet f2f25aaee07242329014de1834ca881d (table default.Table_972e2b5ba1434aa39649fb5d8c8b9d78 [id=61ec0a905c47494993d61449ae285e91]) successfully deleted
I20250625 14:02:05.270705 13836 tablet.cc:1722] T 7160c6353e2d48d8a5d5a71563797051 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20250625 14:02:05.271250 11855 leader_election.cc:343] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: a36ed3e126ef4edfa69fcffb098d0e4f
W20250625 14:02:05.271543 11858 leader_election.cc:343] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: a36ed3e126ef4edfa69fcffb098d0e4f
I20250625 14:02:05.271607 11858 leader_election.cc:304] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.271874 13835 raft_consensus.cc:2747] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.271894 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 3a5c9b1852a847188bb7e2f08a37fded
I20250625 14:02:05.272229 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 3a5c9b1852a847188bb7e2f08a37fded deleted and replaced by tablet 118b6c8065704ff883a05bbb07ab2f37
I20250625 14:02:05.273125 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 3a5c9b1852a847188bb7e2f08a37fded with delete_type TABLET_DATA_DELETED (replaced by tablet 118b6c8065704ff883a05bbb07ab2f37) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.274650 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 3a5c9b1852a847188bb7e2f08a37fded with delete_type TABLET_DATA_DELETED (replaced by tablet 118b6c8065704ff883a05bbb07ab2f37) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.275017 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 725a0db4c6374805903657f755ca1783 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.275166 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1ca83fb6a17643d3a89aed2a88e32e1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.275364 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_362ffeafdcf14aed96f429c16f5f26e8" } modify_external_catalogs: true
I20250625 14:02:05.275379 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet 3a5c9b1852a847188bb7e2f08a37fded with delete_type TABLET_DATA_DELETED (replaced by tablet 118b6c8065704ff883a05bbb07ab2f37) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.275415 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_533afd5e6bb14c7697c5652f2c8ee713" } modify_external_catalogs: true
I20250625 14:02:05.275451 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_362ffeafdcf14aed96f429c16f5f26e8" } modify_external_catalogs: true
I20250625 14:02:05.275509 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_533afd5e6bb14c7697c5652f2c8ee713" } modify_external_catalogs: true
W20250625 14:02:05.275616 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ca83fb6a17643d3a89aed2a88e32e1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.275774 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_aff1ab56a44d4fee9bb639374c2fc0bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.276101 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aff1ab56a44d4fee9bb639374c2fc0bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.276762 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_847e7405f014463eb6b720987a1447a2" } new_table_name: "default.Table_09e9ef6199fa49c4a6f45e757f3a2682" modify_external_catalogs: true
I20250625 14:02:05.277354 12177 ts_tablet_manager.cc:1905] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.277468 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3e425976b7b745edb5a456f581fc492c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.277755 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e425976b7b745edb5a456f581fc492c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.282907 12172 tablet_bootstrap.cc:492] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.283033 12172 ts_tablet_manager.cc:1397] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.135s user 0.002s sys 0.000s
I20250625 14:02:05.283458 12172 raft_consensus.cc:357] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.283560 12172 raft_consensus.cc:383] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.283591 12172 raft_consensus.cc:738] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.283905 12172 consensus_queue.cc:260] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.284289 12172 ts_tablet_manager.cc:1428] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.284566 12172 tablet_bootstrap.cc:492] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.285521 12172 tablet_bootstrap.cc:654] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.286646 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bc8d9a93788f42a5b9d886f56e986983"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.287027 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc8d9a93788f42a5b9d886f56e986983 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:05.287807 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6463a93315844e359273bc7e5907cac3 consensus state has no leader
I20250625 14:02:05.289292 12177 ts_tablet_manager.cc:1918] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.296655 12175 ts_tablet_manager.cc:1918] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.296902 12175 log.cc:1199] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b9a788be0b8640dc9d6d06fa86580f6b
I20250625 14:02:05.297237 12175 ts_tablet_manager.cc:1939] T b9a788be0b8640dc9d6d06fa86580f6b P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.297768 11919 raft_consensus.cc:1273] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Refusing update from remote peer 56419e38d8e34f6985d4d970c1ce76e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250625 14:02:05.298480 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e545771afabc4716a1c8a94877ff7e0b has no consensus state
I20250625 14:02:05.298195 13855 consensus_queue.cc:1035] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.303089 13335 consensus_queue.cc:1035] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.303747 12177 log.cc:1199] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/60ca3a1ea9b944a2a1830cad6cee3cff
I20250625 14:02:05.304100 12177 ts_tablet_manager.cc:1939] T 60ca3a1ea9b944a2a1830cad6cee3cff P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.304497 12177 tablet_replica.cc:331] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.304659 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 60ca3a1ea9b944a2a1830cad6cee3cff (table default.Table_ba6488926235441ea0f1a8d78706f1d6 [id=8a0d72a771cc4aea88a1e400245cb1f8]) successfully deleted
I20250625 14:02:05.305858 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:05.305943 12166 tablet_bootstrap.cc:492] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.306027 12166 ts_tablet_manager.cc:1397] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.000s
I20250625 14:02:05.306381 12177 raft_consensus.cc:2241] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.306555 12177 pending_rounds.cc:70] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:05.306588 12177 pending_rounds.cc:77] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523072516935680 op_type: NO_OP noop_request { }
I20250625 14:02:05.306605 11531 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:05.306648 12177 raft_consensus.cc:2887] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:05.306604 12166 raft_consensus.cc:357] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.306705 12177 raft_consensus.cc:2270] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.306711 12166 raft_consensus.cc:383] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.306746 12166 raft_consensus.cc:738] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.307116 12173 tablet_replica.cc:331] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.307242 12173 raft_consensus.cc:2241] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.307364 11532 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 13a2c2f498e24f47a12181a89dcbd769 (table default.Table_c2fa6c9333664dedaedb249e523d7f55 [id=21a50fe75ad14d07b605f238ce89ca09]). Expected version 1 got 0
I20250625 14:02:05.308534 12166 consensus_queue.cc:260] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.308859 12166 ts_tablet_manager.cc:1428] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:05.309315 12166 tablet_bootstrap.cc:492] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.310711 12166 tablet_bootstrap.cc:654] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.310760 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet f2f25aaee07242329014de1834ca881d (table default.Table_972e2b5ba1434aa39649fb5d8c8b9d78 [id=61ec0a905c47494993d61449ae285e91]) successfully deleted
I20250625 14:02:05.312361 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet b215f2dc28604d1387e9847a5247564d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.312546 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.312372 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet b55487136b024aa788e31debeb1b2eca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.312404 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet c06757067b3e465f8239b9ff38b68071 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.313704 13854 catalog_manager.cc:1576] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: acquiring CA information for follower catalog manager: success
I20250625 14:02:05.315779 12177 ts_tablet_manager.cc:1905] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.317957 13915 tablet.cc:1722] T 7160c6353e2d48d8a5d5a71563797051 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.318260 12166 tablet_bootstrap.cc:492] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.318444 12166 ts_tablet_manager.cc:1397] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20250625 14:02:05.318986 12166 raft_consensus.cc:357] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.319161 12166 raft_consensus.cc:383] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.319263 12166 raft_consensus.cc:738] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.319499 12166 consensus_queue.cc:260] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.319927 12166 ts_tablet_manager.cc:1428] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.319937 12172 tablet_bootstrap.cc:492] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.320029 12172 ts_tablet_manager.cc:1397] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.000s
I20250625 14:02:05.320226 12166 tablet_bootstrap.cc:492] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.320518 13334 consensus_queue.cc:1035] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.320940 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 5ecae25fa8e74a25a3d99ff300c0394d from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.321051 12172 raft_consensus.cc:357] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.321193 12172 raft_consensus.cc:383] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.321237 12172 raft_consensus.cc:738] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.321347 12172 consensus_queue.cc:260] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.321645 12166 tablet_bootstrap.cc:654] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.321645 12172 ts_tablet_manager.cc:1428] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:05.321817 12172 tablet_bootstrap.cc:492] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.322779 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet dfbf6959677547a6a2582b73b2be4c03 (table default.Table_ce207d86e10b457089caedc1452d8318 [id=70d3fc86e64847b9b7edd7945c195dc6]). Expected version 3 got 0
I20250625 14:02:05.326560 12166 tablet_bootstrap.cc:492] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.326714 12166 ts_tablet_manager.cc:1397] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20250625 14:02:05.327268 12166 raft_consensus.cc:357] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.327469 12166 raft_consensus.cc:383] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.327566 12166 raft_consensus.cc:738] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.327860 12166 consensus_queue.cc:260] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.329540 12166 ts_tablet_manager.cc:1428] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250625 14:02:05.330052 13352 raft_consensus.cc:491] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.330161 13352 raft_consensus.cc:513] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.330288 11532 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (table default.Table_88e1a1caf12b4d52b97e8f08d34ffae6 [id=1f4a03c6bde742a581596005b19a818f]). Expected version 1 got 0
I20250625 14:02:05.330564 12166 tablet_bootstrap.cc:492] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.330585 13352 leader_election.cc:290] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:05.330838 11858 consensus_peers.cc:487] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9ed052ae88e4b679ac55177a3bbab88. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:05.332051 13837 raft_consensus.cc:491] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.332126 13837 raft_consensus.cc:513] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.332490 13837 leader_election.cc:290] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.332616 12167 tablet_bootstrap.cc:492] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.332716 12167 ts_tablet_manager.cc:1397] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.141s user 0.002s sys 0.001s
I20250625 14:02:05.333252 12166 tablet_bootstrap.cc:654] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.333189 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7353ef647c3649d59fadbd240ccae7bb" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.333333 11784 raft_consensus.cc:2466] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:05.333288 12167 raft_consensus.cc:357] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.333403 12167 raft_consensus.cc:383] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.333446 12167 raft_consensus.cc:738] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.333567 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7bcc674dc5e448c0871e4efe0c9100b8" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.333567 12167 consensus_queue.cc:260] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.333624 11858 leader_election.cc:304] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:05.333761 13837 raft_consensus.cc:2802] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.333807 13837 raft_consensus.cc:491] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.333847 13837 raft_consensus.cc:3058] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.333877 12167 ts_tablet_manager.cc:1428] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.334197 12167 tablet_bootstrap.cc:492] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.334983 13837 raft_consensus.cc:513] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.335336 12167 tablet_bootstrap.cc:654] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.335372 13837 leader_election.cc:290] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.335856 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7353ef647c3649d59fadbd240ccae7bb" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:05.336000 11784 raft_consensus.cc:3058] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:05.336846 11990 leader_election.cc:343] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.337296 11784 raft_consensus.cc:2466] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:05.337637 11858 leader_election.cc:304] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
W20250625 14:02:05.337739 11855 leader_election.cc:343] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 7353ef647c3649d59fadbd240ccae7bb
I20250625 14:02:05.337852 13837 raft_consensus.cc:2802] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.337939 13837 raft_consensus.cc:695] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
W20250625 14:02:05.337954 11855 leader_election.cc:343] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 7353ef647c3649d59fadbd240ccae7bb
I20250625 14:02:05.338081 13837 consensus_queue.cc:237] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.338562 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 7353ef647c3649d59fadbd240ccae7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.340101 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet b778a1b075794c0a86992066a14d5e11
I20250625 14:02:05.342720 12173 raft_consensus.cc:2270] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.343413 12173 ts_tablet_manager.cc:1905] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.343638 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet b778a1b075794c0a86992066a14d5e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.345736 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet b778a1b075794c0a86992066a14d5e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.346096 13352 raft_consensus.cc:491] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.346191 13352 raft_consensus.cc:513] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.346652 13352 leader_election.cc:290] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.347039 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet bf448c94caf447bd8ddbad9c6ace0712
I20250625 14:02:05.347532 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 5ecae25fa8e74a25a3d99ff300c0394d
I20250625 14:02:05.347793 11528 catalog_manager.cc:6652] ReplaceTablet: tablet 5ecae25fa8e74a25a3d99ff300c0394d deleted and replaced by tablet 35f16657b4514c92b5d1a88db036b39e
I20250625 14:02:05.348049 12173 ts_tablet_manager.cc:1918] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.348129 12173 log.cc:1199] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/292e9c27637d410ea487761f50bdee88
I20250625 14:02:05.348357 12173 ts_tablet_manager.cc:1939] T 292e9c27637d410ea487761f50bdee88 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.349390 13352 raft_consensus.cc:491] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.349478 13352 raft_consensus.cc:513] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.349750 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a753b44395994a4abaaa96fb9b6d594a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.349853 13352 leader_election.cc:290] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.350250 12175 tablet_replica.cc:331] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: stopping tablet replica
W20250625 14:02:05.350342 11990 leader_election.cc:343] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.350564 12175 raft_consensus.cc:2241] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.350749 12175 raft_consensus.cc:2270] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.350579 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f26de29aebc46b49d863c02fe8b1776" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.351490 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet bf448c94caf447bd8ddbad9c6ace0712 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:05.351631 11990 leader_election.cc:343] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.351760 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ecae25fa8e74a25a3d99ff300c0394d with delete_type TABLET_DATA_DELETED (replaced by tablet 35f16657b4514c92b5d1a88db036b39e) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.353011 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet bf448c94caf447bd8ddbad9c6ace0712 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.353029 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b9a788be0b8640dc9d6d06fa86580f6b (table default.Table_3ef297edd2b74ada8037c6bc3018ccb8 [id=3fb5b2ae009c4365812e750040fa0b97]) successfully deleted
I20250625 14:02:05.353348 12175 ts_tablet_manager.cc:1905] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.353739 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_17a1621fab7d4e22a98e28d43c15c977"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.354000 12166 tablet_bootstrap.cc:492] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.354087 12166 ts_tablet_manager.cc:1397] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.002s
W20250625 14:02:05.354202 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17a1621fab7d4e22a98e28d43c15c977 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.354645 12166 raft_consensus.cc:357] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.354676 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_efff2a18e5ca4d60856266534e3d947b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.354916 12166 raft_consensus.cc:383] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.355012 12166 raft_consensus.cc:738] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:02:05.355044 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efff2a18e5ca4d60856266534e3d947b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.355268 12166 consensus_queue.cc:260] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.355751 12166 ts_tablet_manager.cc:1428] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250625 14:02:05.355796 12167 tablet_bootstrap.cc:492] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.355895 12167 ts_tablet_manager.cc:1397] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:02:05.355988 12166 tablet_bootstrap.cc:492] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.356400 12167 raft_consensus.cc:357] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.356505 12167 raft_consensus.cc:383] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.356539 12167 raft_consensus.cc:738] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.356827 12167 consensus_queue.cc:260] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.357296 12167 ts_tablet_manager.cc:1428] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.357538 12167 tablet_bootstrap.cc:492] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.358582 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dacc3719139549cfa4d64f7f306e611d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.358826 12167 tablet_bootstrap.cc:654] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.359117 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dacc3719139549cfa4d64f7f306e611d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.359995 12166 tablet_bootstrap.cc:654] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.360291 11990 consensus_peers.cc:487] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed -> Peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Couldn't send request to peer bfff52620fea460d850827814b790c35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:05.360601 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ecae25fa8e74a25a3d99ff300c0394d with delete_type TABLET_DATA_DELETED (replaced by tablet 35f16657b4514c92b5d1a88db036b39e) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.362471 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bf89472b824e4e6bb4262550d846a433" } modify_external_catalogs: true
I20250625 14:02:05.362663 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_bf89472b824e4e6bb4262550d846a433" } modify_external_catalogs: true
I20250625 14:02:05.364426 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5767d7ea96074056935ac13348cb9897"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.365361 13837 raft_consensus.cc:491] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.365453 13837 raft_consensus.cc:513] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.365860 13837 leader_election.cc:290] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.368580 11530 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_95f72537a1a6427d90687b9ce3844506" } new_table_name: "default.Table_383c4209eda64f9aa6b96f37b69328b2" modify_external_catalogs: true
W20250625 14:02:05.369107 11855 leader_election.cc:343] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 0f6c287461864f6dba5f47711eb69fae
I20250625 14:02:05.369580 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d71a5103ec2b4d9c95e4858f89ef71a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.369980 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d71a5103ec2b4d9c95e4858f89ef71a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.370461 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_2d83ef3351a4455fb0f4e370455cff01" } new_table_name: "default.Table_52857dc21ea84f03a4a21340cb0c9991" modify_external_catalogs: true
W20250625 14:02:05.372519 11858 leader_election.cc:343] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 0f6c287461864f6dba5f47711eb69fae
I20250625 14:02:05.372614 11858 leader_election.cc:304] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.372849 13837 raft_consensus.cc:2747] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.373624 12173 tablet_replica.cc:331] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.374744 12173 raft_consensus.cc:2241] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.375571 12173 raft_consensus.cc:2270] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.376358 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bb784063ba1248438e039c64715cb515"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.376782 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb784063ba1248438e039c64715cb515 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.379086 12172 tablet_bootstrap.cc:654] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.379674 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 292e9c27637d410ea487761f50bdee88 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
I20250625 14:02:05.380371 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6dab46b8294a4cc1913268a5f6933b73" } new_table_name: "default.Table_d2b2e6f3136e451cbb109d8f43d96682" modify_external_catalogs: true
I20250625 14:02:05.381237 12177 ts_tablet_manager.cc:1918] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:05.381387 12177 log.cc:1199] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/d53e9ef9d5f64cb893a552ab0784c120
I20250625 14:02:05.381757 12177 ts_tablet_manager.cc:1939] T d53e9ef9d5f64cb893a552ab0784c120 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.382164 12177 tablet_replica.cc:331] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:02:05.383131 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5767d7ea96074056935ac13348cb9897 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:05.386008 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d7bd3487d954aeab0053b755d8ffe09 consensus state has no leader
I20250625 14:02:05.387059 12167 tablet_bootstrap.cc:492] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.387207 12167 ts_tablet_manager.cc:1397] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250625 14:02:05.387280 12177 raft_consensus.cc:2241] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.387792 12167 raft_consensus.cc:357] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.388797 12167 raft_consensus.cc:383] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.388850 12167 raft_consensus.cc:738] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.388309 12177 pending_rounds.cc:70] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:05.389472 12177 pending_rounds.cc:77] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523072553377792 op_type: NO_OP noop_request { }
I20250625 14:02:05.389621 12177 raft_consensus.cc:2887] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:05.389906 12177 raft_consensus.cc:2270] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.389853 12167 consensus_queue.cc:260] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.390424 12167 ts_tablet_manager.cc:1428] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:05.390735 12167 tablet_bootstrap.cc:492] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.391548 12177 ts_tablet_manager.cc:1905] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.391757 12167 tablet_bootstrap.cc:654] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.393738 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 17eee455777b4258a6d236c33ce10c0a
I20250625 14:02:05.388140 12173 ts_tablet_manager.cc:1905] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.395071 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 17eee455777b4258a6d236c33ce10c0a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.395604 13908 raft_consensus.cc:491] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.395613 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 17eee455777b4258a6d236c33ce10c0a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.395843 13908 raft_consensus.cc:513] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.396433 13908 leader_election.cc:290] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.396909 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b55487136b024aa788e31debeb1b2eca" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.397330 11990 leader_election.cc:343] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.397895 12172 tablet_bootstrap.cc:492] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.398000 12172 ts_tablet_manager.cc:1397] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.076s user 0.006s sys 0.005s
I20250625 14:02:05.398659 12172 raft_consensus.cc:357] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.398780 12172 raft_consensus.cc:383] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.398820 12172 raft_consensus.cc:738] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.398964 12172 consensus_queue.cc:260] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.399279 12172 ts_tablet_manager.cc:1428] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.399482 12172 tablet_bootstrap.cc:492] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:05.399652 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c744b3d26efa42c0bf7fe30c561c692d consensus state has no leader
I20250625 14:02:05.402647 12172 tablet_bootstrap.cc:654] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.395499 12175 ts_tablet_manager.cc:1918] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20250625 14:02:05.403549 12175 log.cc:1199] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/5e4cdf8f78d14c7d8ba3bda009d33719
I20250625 14:02:05.403978 12175 ts_tablet_manager.cc:1939] T 5e4cdf8f78d14c7d8ba3bda009d33719 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.405372 13836 tablet.cc:1722] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.405838 12177 ts_tablet_manager.cc:1918] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:05.406052 12173 ts_tablet_manager.cc:1918] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.406147 12173 log.cc:1199] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/10c13ce2b79f4bb9bea6fb3fca4d40a6
I20250625 14:02:05.406437 12173 ts_tablet_manager.cc:1939] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.406567 13915 tablet.cc:1722] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.407573 12167 tablet_bootstrap.cc:492] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.407727 12167 ts_tablet_manager.cc:1397] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20250625 14:02:05.408413 12167 raft_consensus.cc:357] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.408510 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 (table default.Table_a0513f1c1050428aafc99329d1115a93 [id=fdd8850d9bb54b189508d389454a1ef0]) successfully deleted
I20250625 14:02:05.408604 12167 raft_consensus.cc:383] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.408660 12167 raft_consensus.cc:738] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.408808 12167 consensus_queue.cc:260] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.409204 12167 ts_tablet_manager.cc:1428] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.409264 12175 tablet_replica.cc:331] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.409435 12167 tablet_bootstrap.cc:492] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.409437 12175 raft_consensus.cc:2241] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.410445 12175 raft_consensus.cc:2270] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.410843 12167 tablet_bootstrap.cc:654] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.411059 13837 raft_consensus.cc:491] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.411167 13837 raft_consensus.cc:513] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.411571 13837 leader_election.cc:290] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.411439 13914 tablet.cc:1722] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.412900 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58bd9c8a0eb43b5aeedcca452fa7a98" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.413079 11780 raft_consensus.cc:2391] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:05.413478 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "e58bd9c8a0eb43b5aeedcca452fa7a98" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.413970 12177 log.cc:1199] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/10c13ce2b79f4bb9bea6fb3fca4d40a6
I20250625 14:02:05.413991 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 5e4cdf8f78d14c7d8ba3bda009d33719 (table default.Table_5171599cd58f4906897a3e7da2c30d6e [id=416264ede8644650b07f6c60ffb3cc52]) successfully deleted
W20250625 14:02:05.414589 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 147dbf21a3d242b9a8d7d1389c7cecb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 147dbf21a3d242b9a8d7d1389c7cecb5 already in progress: creating tablet
I20250625 14:02:05.415071 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet d53e9ef9d5f64cb893a552ab0784c120 (table default.Table_06f52f09f53f4abf9d515f309f225205 [id=c3c11e126c464fdb8861f40571c798f2]) successfully deleted
I20250625 14:02:05.415511 12177 ts_tablet_manager.cc:1939] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:02:05.415729 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 25dd555e539f4278b9a04c4959a740f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25dd555e539f4278b9a04c4959a740f3 already in progress: creating tablet
I20250625 14:02:05.415840 12177 tablet_replica.cc:331] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:02:05.416110 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9cbe55597c0742c99750322cdca22289 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cbe55597c0742c99750322cdca22289 already in progress: creating tablet
W20250625 14:02:05.416245 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet f66aff43813a4455aca34d82e7a4c1a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f66aff43813a4455aca34d82e7a4c1a3 already in progress: creating tablet
I20250625 14:02:05.416504 12173 tablet_replica.cc:331] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.416689 12173 raft_consensus.cc:2241] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.416810 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7bcc674dc5e448c0871e4efe0c9100b8" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.416937 12173 raft_consensus.cc:2270] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.417477 13854 catalog_manager.cc:1604] T 00000000000000000000000000000000 P b569e7a9e38b4882a89092d98a2f1b9b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250625 14:02:05.417511 11855 leader_election.cc:304] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.417759 12173 ts_tablet_manager.cc:1905] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.417834 13837 raft_consensus.cc:3058] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.418068 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a753b44395994a4abaaa96fb9b6d594a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.418380 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b55487136b024aa788e31debeb1b2eca" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.418215 11784 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f26de29aebc46b49d863c02fe8b1776" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.418529 11784 raft_consensus.cc:2466] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:05.416895 12177 raft_consensus.cc:2241] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.418692 12177 raft_consensus.cc:2270] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.418965 13837 raft_consensus.cc:2747] T e58bd9c8a0eb43b5aeedcca452fa7a98 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.419238 13914 tablet.cc:1722] T dfbf6959677547a6a2582b73b2be4c03 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.419365 12177 ts_tablet_manager.cc:1905] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.421669 12172 tablet_bootstrap.cc:492] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.421766 12172 ts_tablet_manager.cc:1397] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250625 14:02:05.422268 12172 raft_consensus.cc:357] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.422403 12172 raft_consensus.cc:383] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.422451 12172 raft_consensus.cc:738] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
W20250625 14:02:05.422541 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f3555d6f5a14a25b9e96bf4f60eda6c already in progress: creating tablet
I20250625 14:02:05.422411 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet b215f2dc28604d1387e9847a5247564d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:05.422727 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 70a02be03e4f42929e3cd0c521a00859 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70a02be03e4f42929e3cd0c521a00859 already in progress: creating tablet
I20250625 14:02:05.422575 12172 consensus_queue.cc:260] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.423477 12177 ts_tablet_manager.cc:1918] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.424755 12175 ts_tablet_manager.cc:1905] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.424181 11762 tablet_service.cc:1515] Processing DeleteTablet for tablet b778a1b075794c0a86992066a14d5e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.424235 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet bf448c94caf447bd8ddbad9c6ace0712 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.424348 12172 ts_tablet_manager.cc:1428] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:05.425345 12172 tablet_bootstrap.cc:492] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.424542 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 17eee455777b4258a6d236c33ce10c0a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.424400 11747 tablet_service.cc:1515] Processing DeleteTablet for tablet 5ecae25fa8e74a25a3d99ff300c0394d with delete_type TABLET_DATA_DELETED (replaced by tablet 35f16657b4514c92b5d1a88db036b39e) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.426762 12172 tablet_bootstrap.cc:654] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.427001 11747 tablet_service.cc:1515] Processing DeleteTablet for tablet c06757067b3e465f8239b9ff38b68071 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.427596 13699 consensus_queue.cc:1035] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.427723 12173 ts_tablet_manager.cc:1918] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.427796 12173 log.cc:1199] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/3a5c9b1852a847188bb7e2f08a37fded
I20250625 14:02:05.427829 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 (table default.Table_a0513f1c1050428aafc99329d1115a93 [id=fdd8850d9bb54b189508d389454a1ef0]) successfully deleted
W20250625 14:02:05.428639 11993 leader_election.cc:343] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.428741 11993 leader_election.cc:304] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.429196 13908 raft_consensus.cc:2747] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.429397 13352 raft_consensus.cc:491] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.429466 13352 raft_consensus.cc:513] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.429834 13352 leader_election.cc:290] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.429958 13835 raft_consensus.cc:491] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.430052 13835 raft_consensus.cc:513] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.430641 13835 leader_election.cc:290] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:05.431092 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13a2c2f498e24f47a12181a89dcbd769" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.431434 11858 leader_election.cc:343] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 1fd261d824c34864a7b15e4736254062
W20250625 14:02:05.431452 11990 leader_election.cc:343] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:05.432163 11855 leader_election.cc:343] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 1fd261d824c34864a7b15e4736254062
I20250625 14:02:05.432233 11855 leader_election.cc:304] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.432499 13837 raft_consensus.cc:2747] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.432689 13836 tablet.cc:1722] T dfbf6959677547a6a2582b73b2be4c03 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.432806 11526 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet edc5b7cc92564ba4ad04f68e18b56dfe (table default.Table_0255a6753f1443abb6d5c32d77404997 [id=205b876e2e7a4f54bbddec9150d67e0a]). Expected version 2 got 0
I20250625 14:02:05.435896 12173 ts_tablet_manager.cc:1939] T 3a5c9b1852a847188bb7e2f08a37fded P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.436199 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 7160c6353e2d48d8a5d5a71563797051 (table default.Table_986e9f5739b448869ad00a6a519c2b3b [id=47d8fe69c6c74648951544929540413d]). Expected version 3 got 0
I20250625 14:02:05.436347 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet dfbf6959677547a6a2582b73b2be4c03 (table default.Table_ce207d86e10b457089caedc1452d8318 [id=70d3fc86e64847b9b7edd7945c195dc6]). Expected version 3 got 0
I20250625 14:02:05.436434 11529 catalog_manager.cc:5582] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:05.436617 11529 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet f325061ce4bb4468886cfe0a0d752596 (table default.Table_e3322169c32b4dd8af57a18e67156a86 [id=cd68b5ad9c1849298e961363e2e27608]). Expected version 1 got 0
I20250625 14:02:05.436779 12173 tablet_replica.cc:331] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.436925 12173 raft_consensus.cc:2241] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.437023 12173 raft_consensus.cc:2270] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.427603 12177 log.cc:1199] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7353ef647c3649d59fadbd240ccae7bb
I20250625 14:02:05.440534 12036 tablet_service.cc:1468] Processing CreateTablet for tablet fb8523c7b6764a21841888f2db59a063 (DEFAULT_TABLE table=default.Table_e08928012af340a280579da7de533f9a [id=45de3e54c2f74e32931cd0d05e793b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.440832 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8523c7b6764a21841888f2db59a063. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.441129 11899 tablet_service.cc:1468] Processing CreateTablet for tablet faa0dc0cffaa405a9b6ec8a0582c1cb1 (DEFAULT_TABLE table=default.Table_88f7a3f8dc4f4b6292359bfff07f591b [id=7f02412d849c452a9d17f1bb182254fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.441395 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa0dc0cffaa405a9b6ec8a0582c1cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.442600 11898 tablet_service.cc:1468] Processing CreateTablet for tablet fb8523c7b6764a21841888f2db59a063 (DEFAULT_TABLE table=default.Table_e08928012af340a280579da7de533f9a [id=45de3e54c2f74e32931cd0d05e793b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.442840 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8523c7b6764a21841888f2db59a063. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.443471 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 04799d7aa87e416ca5074e59323312df (DEFAULT_TABLE table=default.Table_65882e25be8d4c5f9997d5a89f31e88e [id=9bfca529ca4042e3beecab70d559e0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.443706 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04799d7aa87e416ca5074e59323312df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.444141 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]) successfully deleted
I20250625 14:02:05.445119 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 04799d7aa87e416ca5074e59323312df (DEFAULT_TABLE table=default.Table_65882e25be8d4c5f9997d5a89f31e88e [id=9bfca529ca4042e3beecab70d559e0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.445153 13908 consensus_queue.cc:1035] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.445364 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04799d7aa87e416ca5074e59323312df. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:05.445921 11993 leader_election.cc:343] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.446012 11993 leader_election.cc:304] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.446349 13908 raft_consensus.cc:2747] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:05.446646 11993 leader_election.cc:343] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.446709 11993 leader_election.cc:304] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.446930 13908 raft_consensus.cc:2747] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.447274 11993 leader_election.cc:304] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.447818 13908 raft_consensus.cc:2802] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.447955 13908 raft_consensus.cc:491] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.448055 13908 raft_consensus.cc:3058] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.449146 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 27a05814621446f0b40733de5ff51328 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.449589 13908 raft_consensus.cc:513] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.450166 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f46ef5ce088042ee89cb48170a0011f0" } modify_external_catalogs: true
I20250625 14:02:05.450397 13908 leader_election.cc:290] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.450467 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f26de29aebc46b49d863c02fe8b1776" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:05.450407 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f46ef5ce088042ee89cb48170a0011f0" } modify_external_catalogs: true
W20250625 14:02:05.450839 11990 leader_election.cc:343] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.452091 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_23431076f3204145a60c963da3d5d4da" } modify_external_catalogs: true
I20250625 14:02:05.452265 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_23431076f3204145a60c963da3d5d4da" } modify_external_catalogs: true
I20250625 14:02:05.453738 11919 raft_consensus.cc:3058] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.456257 13915 tablet.cc:1722] T dfbf6959677547a6a2582b73b2be4c03 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.455209 13855 consensus_queue.cc:1035] T 3ae093ced6ff4255b75f634701ed259b P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20250625 14:02:05.438282 12177 ts_tablet_manager.cc:1939] T 7353ef647c3649d59fadbd240ccae7bb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.463434 12177 tablet_replica.cc:331] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.463650 12177 raft_consensus.cc:2241] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.463860 12177 raft_consensus.cc:2270] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.464576 12177 ts_tablet_manager.cc:1905] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.465212 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_383c4209eda64f9aa6b96f37b69328b2 [id=54f14ba68b6e47c29e5e7e4d7a0675c4] alter complete (version 1)
I20250625 14:02:05.466606 12028 tablet_service.cc:1468] Processing CreateTablet for tablet faa0dc0cffaa405a9b6ec8a0582c1cb1 (DEFAULT_TABLE table=default.Table_88f7a3f8dc4f4b6292359bfff07f591b [id=7f02412d849c452a9d17f1bb182254fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.466914 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa0dc0cffaa405a9b6ec8a0582c1cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.466976 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 17cc5812711244b68377631dfe6797e0 (DEFAULT_TABLE table=default.Table_e6988886a56842e8a8a59aeae0d70913 [id=eb5220a2aa1a4a1eadbb492d93fdad84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.467243 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cc5812711244b68377631dfe6797e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.467788 11747 tablet_service.cc:1468] Processing CreateTablet for tablet fb8523c7b6764a21841888f2db59a063 (DEFAULT_TABLE table=default.Table_e08928012af340a280579da7de533f9a [id=45de3e54c2f74e32931cd0d05e793b2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.468294 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 04799d7aa87e416ca5074e59323312df (DEFAULT_TABLE table=default.Table_65882e25be8d4c5f9997d5a89f31e88e [id=9bfca529ca4042e3beecab70d559e0e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.471175 11745 tablet_service.cc:1468] Processing CreateTablet for tablet faa0dc0cffaa405a9b6ec8a0582c1cb1 (DEFAULT_TABLE table=default.Table_88f7a3f8dc4f4b6292359bfff07f591b [id=7f02412d849c452a9d17f1bb182254fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.471684 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 17cc5812711244b68377631dfe6797e0 (DEFAULT_TABLE table=default.Table_e6988886a56842e8a8a59aeae0d70913 [id=eb5220a2aa1a4a1eadbb492d93fdad84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.472705 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 17cc5812711244b68377631dfe6797e0 (DEFAULT_TABLE table=default.Table_e6988886a56842e8a8a59aeae0d70913 [id=eb5220a2aa1a4a1eadbb492d93fdad84]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.472977 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cc5812711244b68377631dfe6797e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.472931 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 23e821af1ae3476dbba467e45973cbbe (DEFAULT_TABLE table=default.Table_51796cf165e2492ebc3cdb05a3e84807 [id=ee66340128c949a2af12cf2ec81063b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.473178 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e821af1ae3476dbba467e45973cbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.473117 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 23e821af1ae3476dbba467e45973cbbe (DEFAULT_TABLE table=default.Table_51796cf165e2492ebc3cdb05a3e84807 [id=ee66340128c949a2af12cf2ec81063b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.473382 11779 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13a2c2f498e24f47a12181a89dcbd769" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.473425 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 616545b4e9f24f928f1b361d352014a3 (DEFAULT_TABLE table=default.Table_96c4b1885cd441048632e01c02fd2d86 [id=f4d76a369967460fb722a48d09328c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.473515 11779 raft_consensus.cc:2466] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:05.473618 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616545b4e9f24f928f1b361d352014a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.475422 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 23e821af1ae3476dbba467e45973cbbe (DEFAULT_TABLE table=default.Table_51796cf165e2492ebc3cdb05a3e84807 [id=ee66340128c949a2af12cf2ec81063b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.475661 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e821af1ae3476dbba467e45973cbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.476423 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c744b3d26efa42c0bf7fe30c561c692d (table default.Table_d2b2e6f3136e451cbb109d8f43d96682 [id=5d7d7235935340089195e54e50d9bc32]). Expected version 1 got 0
I20250625 14:02:05.476549 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (table default.Table_88e1a1caf12b4d52b97e8f08d34ffae6 [id=1f4a03c6bde742a581596005b19a818f]). Expected version 1 got 0
I20250625 14:02:05.476616 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c188bc758a4c4a71a5550fc11fe59b1a (table default.Table_cabcd06410bc4ee282294a6d0f1b2fe7 [id=8030abc171274e888b1dc6dd7b57b98d]). Expected version 1 got 0
I20250625 14:02:05.476673 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
W20250625 14:02:05.477732 11518 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet c744b3d26efa42c0bf7fe30c561c692d (table default.Table_d2b2e6f3136e451cbb109d8f43d96682 [id=5d7d7235935340089195e54e50d9bc32], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c744b3d26efa42c0bf7fe30c561c692d consensus state has no leader
I20250625 14:02:05.478646 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f26de29aebc46b49d863c02fe8b1776" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:05.478806 11778 raft_consensus.cc:3058] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.479051 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d600a46fc1c4a6194368f3cd8681364) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.479480 12173 ts_tablet_manager.cc:1905] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.479879 11778 raft_consensus.cc:2466] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:05.480445 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet e85f6b7b1f6a4966ad3c102dd8addea7
I20250625 14:02:05.480808 11532 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 329af8a46941453a9b6ffca7c5cf497f
I20250625 14:02:05.481021 11529 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 13a2c2f498e24f47a12181a89dcbd769 (table default.Table_c2fa6c9333664dedaedb249e523d7f55 [id=21a50fe75ad14d07b605f238ce89ca09]). Expected version 1 got 0
I20250625 14:02:05.481313 11526 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_ce207d86e10b457089caedc1452d8318 [id=70d3fc86e64847b9b7edd7945c195dc6] alter complete (version 3)
I20250625 14:02:05.481779 12173 ts_tablet_manager.cc:1918] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.481845 12173 log.cc:1199] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b215f2dc28604d1387e9847a5247564d
I20250625 14:02:05.482054 12173 ts_tablet_manager.cc:1939] T b215f2dc28604d1387e9847a5247564d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.482438 12175 ts_tablet_manager.cc:1918] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.483115 12175 log.cc:1199] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/84a1eb4471544de9afbb5b35d0071dcc
I20250625 14:02:05.484220 13121 consensus_queue.cc:1035] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.486855 12175 ts_tablet_manager.cc:1939] T 84a1eb4471544de9afbb5b35d0071dcc P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.488732 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8523c7b6764a21841888f2db59a063. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.488989 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cc5812711244b68377631dfe6797e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.489202 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04799d7aa87e416ca5074e59323312df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.490398 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e821af1ae3476dbba467e45973cbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.491062 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa0dc0cffaa405a9b6ec8a0582c1cb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.492420 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_162814545c1c4cfcaefb1d6723cbcf59" } new_table_name: "default.Table_7217911ba7ef4eba8746e21c68f61fa6" modify_external_catalogs: true
I20250625 14:02:05.492509 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_a31f4b7186034ee784a34fb1fde58e6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.492928 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a31f4b7186034ee784a34fb1fde58e6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.493793 12175 tablet_replica.cc:331] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.493978 12175 raft_consensus.cc:2241] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.494220 12175 raft_consensus.cc:2270] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.492434 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_15312d5be9fb45ecac5d4674baf86acf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.495195 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15312d5be9fb45ecac5d4674baf86acf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.496500 13121 raft_consensus.cc:491] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.496613 13121 raft_consensus.cc:513] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.497046 13121 leader_election.cc:290] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.498422 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "60ca3a1ea9b944a2a1830cad6cee3cff" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.498905 11990 leader_election.cc:343] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.499118 12173 tablet_replica.cc:331] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.499110 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7585e6fe176547eba15c659be34c394d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.499251 12173 raft_consensus.cc:2241] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.499353 12173 raft_consensus.cc:2270] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:05.499491 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7585e6fe176547eba15c659be34c394d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.499612 12177 ts_tablet_manager.cc:1918] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.499691 12177 log.cc:1199] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/3a5c9b1852a847188bb7e2f08a37fded
I20250625 14:02:05.499994 12177 ts_tablet_manager.cc:1939] T 3a5c9b1852a847188bb7e2f08a37fded P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.501119 12177 tablet_replica.cc:331] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.502224 12167 tablet_bootstrap.cc:492] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.502331 12167 ts_tablet_manager.cc:1397] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.093s user 0.002s sys 0.000s
I20250625 14:02:05.502362 12177 raft_consensus.cc:2241] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.502847 12167 raft_consensus.cc:357] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.502965 12167 raft_consensus.cc:383] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.503001 12167 raft_consensus.cc:738] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.503139 12167 consensus_queue.cc:260] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.503441 12167 ts_tablet_manager.cc:1428] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.503634 12167 tablet_bootstrap.cc:492] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.504168 11527 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_6b3c0774f6ad4c149a5d540c3c8d54e1" } new_table_name: "default.Table_502d9267273a438e86580748f49e7847" modify_external_catalogs: true
I20250625 14:02:05.504710 12167 tablet_bootstrap.cc:654] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.505625 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8cbd388e907b4ee4befb2cd3542c57a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.506172 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cbd388e907b4ee4befb2cd3542c57a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.508744 12173 ts_tablet_manager.cc:1905] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.511354 12173 ts_tablet_manager.cc:1918] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.511440 12173 log.cc:1199] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/60ca3a1ea9b944a2a1830cad6cee3cff
I20250625 14:02:05.511657 12173 ts_tablet_manager.cc:1939] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.514020 12177 raft_consensus.cc:2270] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.514703 12177 ts_tablet_manager.cc:1905] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.517746 12177 ts_tablet_manager.cc:1918] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.518040 12177 log.cc:1199] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b215f2dc28604d1387e9847a5247564d
I20250625 14:02:05.518483 12177 ts_tablet_manager.cc:1939] T b215f2dc28604d1387e9847a5247564d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.519182 12177 tablet_replica.cc:331] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.519382 12177 raft_consensus.cc:2241] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.519378 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 84a1eb4471544de9afbb5b35d0071dcc (table default.Table_89bc204107184f1aae8f924ca65ecd16 [id=f3af928f08964073b0314bfc509bf634]) successfully deleted
I20250625 14:02:05.519568 12177 raft_consensus.cc:2270] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.520092 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 616545b4e9f24f928f1b361d352014a3 (DEFAULT_TABLE table=default.Table_96c4b1885cd441048632e01c02fd2d86 [id=f4d76a369967460fb722a48d09328c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.520412 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616545b4e9f24f928f1b361d352014a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.521328 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 611afe6d28214382a538791e33a5ed78 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.521567 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet e85f6b7b1f6a4966ad3c102dd8addea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.522475 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet e85f6b7b1f6a4966ad3c102dd8addea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.523079 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b215f2dc28604d1387e9847a5247564d (table default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]) successfully deleted
I20250625 14:02:05.523299 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 60ca3a1ea9b944a2a1830cad6cee3cff (table default.Table_ba6488926235441ea0f1a8d78706f1d6 [id=8a0d72a771cc4aea88a1e400245cb1f8]) successfully deleted
I20250625 14:02:05.525300 12177 ts_tablet_manager.cc:1905] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:05.525599 11717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.39.131:34921, user_credentials={real_user=slave}} blocked reactor thread for 46936.8us
I20250625 14:02:05.527037 13914 tablet.cc:1722] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.527321 13334 consensus_queue.cc:1035] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.529651 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7353ef647c3649d59fadbd240ccae7bb (table default.Table_740cd4b264aa4d3baf5d5c296a06cd43 [id=7ccef3951cff4328a6ba48bd01587a5a]) successfully deleted
W20250625 14:02:05.530045 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f3555d6f5a14a25b9e96bf4f60eda6c already in progress: creating tablet
W20250625 14:02:05.530411 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 70a02be03e4f42929e3cd0c521a00859 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70a02be03e4f42929e3cd0c521a00859 already in progress: creating tablet
I20250625 14:02:05.530931 11993 leader_election.cc:304] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.531193 13121 raft_consensus.cc:2802] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.531244 13121 raft_consensus.cc:491] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.531281 13121 raft_consensus.cc:3058] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.532352 13121 raft_consensus.cc:513] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.532738 13121 leader_election.cc:290] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.532817 13121 raft_consensus.cc:491] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.532871 13121 raft_consensus.cc:513] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.533164 13121 leader_election.cc:290] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.533917 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13a2c2f498e24f47a12181a89dcbd769" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:05.534206 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a951fa8b0cab485f9c221367c029fa4a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.534421 11990 leader_election.cc:343] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:05.534710 11990 leader_election.cc:343] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.535130 11993 leader_election.cc:304] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.535389 13908 raft_consensus.cc:2802] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.535758 13908 raft_consensus.cc:695] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:05.535962 13908 consensus_queue.cc:237] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.539755 12177 ts_tablet_manager.cc:1918] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.541831 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9239bf59a7764cd1887acd145d055543" } modify_external_catalogs: true
I20250625 14:02:05.542012 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9239bf59a7764cd1887acd145d055543" } modify_external_catalogs: true
I20250625 14:02:05.546250 12167 tablet_bootstrap.cc:492] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.546389 12167 ts_tablet_manager.cc:1397] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.000s
I20250625 14:02:05.546818 12177 log.cc:1199] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c06757067b3e465f8239b9ff38b68071
I20250625 14:02:05.546904 12167 raft_consensus.cc:357] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.547031 12167 raft_consensus.cc:383] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.547072 12167 raft_consensus.cc:738] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.547107 12177 ts_tablet_manager.cc:1939] T c06757067b3e465f8239b9ff38b68071 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.547224 12167 consensus_queue.cc:260] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.547516 12167 ts_tablet_manager.cc:1428] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.547720 12167 tablet_bootstrap.cc:492] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.549311 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fa193e07de344ccdb0d6f6e45a201fe7" } modify_external_catalogs: true
I20250625 14:02:05.549438 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fa193e07de344ccdb0d6f6e45a201fe7" } modify_external_catalogs: true
I20250625 14:02:05.550242 12167 tablet_bootstrap.cc:654] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.554062 12175 ts_tablet_manager.cc:1905] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.556937 12175 ts_tablet_manager.cc:1918] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.557034 12175 log.cc:1199] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f9ed052ae88e4b679ac55177a3bbab88
I20250625 14:02:05.557318 12175 ts_tablet_manager.cc:1939] T f9ed052ae88e4b679ac55177a3bbab88 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.558790 12175 tablet_replica.cc:331] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.559059 12175 raft_consensus.cc:2241] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.559258 12175 raft_consensus.cc:2270] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.560489 12175 ts_tablet_manager.cc:1905] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.561780 12173 tablet_replica.cc:331] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.561955 12173 raft_consensus.cc:2241] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.562083 12173 raft_consensus.cc:2270] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.564798 12175 ts_tablet_manager.cc:1918] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.564978 12175 log.cc:1199] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0f6c287461864f6dba5f47711eb69fae
I20250625 14:02:05.565269 12175 ts_tablet_manager.cc:1939] T 0f6c287461864f6dba5f47711eb69fae P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.566629 12175 tablet_replica.cc:331] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.566840 12175 raft_consensus.cc:2241] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.567013 12175 raft_consensus.cc:2270] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.571593 12173 ts_tablet_manager.cc:1905] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.574395 12173 ts_tablet_manager.cc:1918] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.574494 12173 log.cc:1199] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/b55487136b024aa788e31debeb1b2eca
I20250625 14:02:05.574718 12173 ts_tablet_manager.cc:1939] T b55487136b024aa788e31debeb1b2eca P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.575352 12173 tablet_replica.cc:331] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.575495 12173 raft_consensus.cc:2241] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.575608 12173 raft_consensus.cc:2270] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.581121 12166 tablet_bootstrap.cc:492] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.581259 12166 ts_tablet_manager.cc:1397] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.225s user 0.003s sys 0.001s
I20250625 14:02:05.581282 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 30d9ae02b4804d638d831ddf40f4205d from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.581821 12166 raft_consensus.cc:357] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.581934 12166 raft_consensus.cc:383] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.581969 12166 raft_consensus.cc:738] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.582113 12166 consensus_queue.cc:260] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.582448 12166 ts_tablet_manager.cc:1428] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.582665 12166 tablet_bootstrap.cc:492] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.582741 12173 ts_tablet_manager.cc:1905] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.583173 12175 ts_tablet_manager.cc:1905] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.583715 12166 tablet_bootstrap.cc:654] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.585587 12175 ts_tablet_manager.cc:1918] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.585736 12175 log.cc:1199] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/1fd261d824c34864a7b15e4736254062
I20250625 14:02:05.585948 12175 ts_tablet_manager.cc:1939] T 1fd261d824c34864a7b15e4736254062 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.587904 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]) successfully deleted
W20250625 14:02:05.590725 11990 consensus_peers.cc:487] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed -> Peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Couldn't send request to peer bfff52620fea460d850827814b790c35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:05.593228 12173 ts_tablet_manager.cc:1918] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.593324 12173 log.cc:1199] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/c06757067b3e465f8239b9ff38b68071
I20250625 14:02:05.593545 12173 ts_tablet_manager.cc:1939] T c06757067b3e465f8239b9ff38b68071 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.597366 12173 tablet_replica.cc:331] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.597570 12173 raft_consensus.cc:2241] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.597715 12173 raft_consensus.cc:2270] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.598299 12173 ts_tablet_manager.cc:1905] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.598435 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 0dffa9aa4e5c4cbba7277cc988e1a4bb (DEFAULT_TABLE table=default.Table_ccba0555eb234e0fb2246d46b57d7fab [id=c4f0be767732471db9967af435187214]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.598580 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 0dffa9aa4e5c4cbba7277cc988e1a4bb (DEFAULT_TABLE table=default.Table_ccba0555eb234e0fb2246d46b57d7fab [id=c4f0be767732471db9967af435187214]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.598757 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dffa9aa4e5c4cbba7277cc988e1a4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.598810 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dffa9aa4e5c4cbba7277cc988e1a4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.599452 11899 tablet_service.cc:1468] Processing CreateTablet for tablet eb5e0b2ad1ea4d8abf8fcb6ac7769c57 (DEFAULT_TABLE table=default.Table_4d033eef3b9e4a4c97d4dbb39bd68006 [id=4efc600234e442d3b20422871e26e84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.599699 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5e0b2ad1ea4d8abf8fcb6ac7769c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.601187 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 6f0cc665cb164feaa1e52ee48796e22f (DEFAULT_TABLE table=default.Table_c359a7a3792d45e49f813d0a82ff0c48 [id=924bc897165a4a84990c6206b5136755]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.601243 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 6f0cc665cb164feaa1e52ee48796e22f (DEFAULT_TABLE table=default.Table_c359a7a3792d45e49f813d0a82ff0c48 [id=924bc897165a4a84990c6206b5136755]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.601428 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0cc665cb164feaa1e52ee48796e22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.601444 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0cc665cb164feaa1e52ee48796e22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.603087 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b215f2dc28604d1387e9847a5247564d (table default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]) successfully deleted
W20250625 14:02:05.603488 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet b778a1b075794c0a86992066a14d5e11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b778a1b075794c0a86992066a14d5e11 already in progress: creating tablet
W20250625 14:02:05.603950 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet bf448c94caf447bd8ddbad9c6ace0712 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf448c94caf447bd8ddbad9c6ace0712 already in progress: creating tablet
W20250625 14:02:05.604262 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 17eee455777b4258a6d236c33ce10c0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17eee455777b4258a6d236c33ce10c0a already in progress: creating tablet
W20250625 14:02:05.604590 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 5ecae25fa8e74a25a3d99ff300c0394d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ecae25fa8e74a25a3d99ff300c0394d already in progress: creating tablet
I20250625 14:02:05.605486 13915 tablet.cc:1722] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.612084 12172 tablet_bootstrap.cc:492] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.612221 12172 ts_tablet_manager.cc:1397] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.187s user 0.002s sys 0.000s
I20250625 14:02:05.612167 12028 tablet_service.cc:1468] Processing CreateTablet for tablet eb5e0b2ad1ea4d8abf8fcb6ac7769c57 (DEFAULT_TABLE table=default.Table_4d033eef3b9e4a4c97d4dbb39bd68006 [id=4efc600234e442d3b20422871e26e84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.612483 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5e0b2ad1ea4d8abf8fcb6ac7769c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.612751 12172 raft_consensus.cc:357] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.612865 12172 raft_consensus.cc:383] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.612896 12172 raft_consensus.cc:738] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.612838 11899 tablet_service.cc:1468] Processing CreateTablet for tablet e545771afabc4716a1c8a94877ff7e0b (DEFAULT_TABLE table=default.Table_a1264bda82fe4bc39be4dcb54ef7d41c [id=c6e9ce93c32f4d5ba20c47cbac7e37dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.613022 12172 consensus_queue.cc:260] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.613116 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e545771afabc4716a1c8a94877ff7e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.613343 12172 ts_tablet_manager.cc:1428] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:05.613543 12172 tablet_bootstrap.cc:492] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.614565 12172 tablet_bootstrap.cc:654] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.615173 12036 tablet_service.cc:1468] Processing CreateTablet for tablet 0afd4fac76cb4424af7bfc1c89add7f0 (DEFAULT_TABLE table=default.Table_1ad8bc8df53b47e8b766b570a08fbd82 [id=3fec5f1e588e4a72bf7f0d045b441397]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.615424 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afd4fac76cb4424af7bfc1c89add7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.616250 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 0afd4fac76cb4424af7bfc1c89add7f0 (DEFAULT_TABLE table=default.Table_1ad8bc8df53b47e8b766b570a08fbd82 [id=3fec5f1e588e4a72bf7f0d045b441397]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.616504 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afd4fac76cb4424af7bfc1c89add7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.616856 13121 raft_consensus.cc:491] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.616976 13121 raft_consensus.cc:513] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.617415 13121 leader_election.cc:290] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.617703 13121 raft_consensus.cc:491] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.617775 13121 raft_consensus.cc:513] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.618077 13232 raft_consensus.cc:491] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.618122 13121 leader_election.cc:290] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.618162 13232 raft_consensus.cc:513] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.618492 13232 leader_election.cc:290] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.619750 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c744b3d26efa42c0bf7fe30c561c692d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.619833 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55ede5e94e12449abbbec9146331deb5" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.620033 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c188bc758a4c4a71a5550fc11fe59b1a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.620363 11990 leader_election.cc:343] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:05.620478 11990 leader_election.cc:343] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:05.620571 11990 leader_election.cc:343] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.621110 12173 ts_tablet_manager.cc:1918] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.621186 12173 log.cc:1199] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/7bcc674dc5e448c0871e4efe0c9100b8
I20250625 14:02:05.621385 12173 ts_tablet_manager.cc:1939] T 7bcc674dc5e448c0871e4efe0c9100b8 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.625808 13837 raft_consensus.cc:491] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.625941 13837 raft_consensus.cc:513] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.626619 13837 leader_election.cc:290] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.627430 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86d1b58fd1a9483b9ead08a55e3b1e63" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.628005 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "86d1b58fd1a9483b9ead08a55e3b1e63" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.628288 12172 tablet_bootstrap.cc:492] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.628387 12172 ts_tablet_manager.cc:1397] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250625 14:02:05.628662 11855 leader_election.cc:304] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.628885 13837 raft_consensus.cc:2747] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250625 14:02:05.628974 12172 raft_consensus.cc:357] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.629113 12172 raft_consensus.cc:383] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.629168 12172 raft_consensus.cc:738] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.629302 12172 consensus_queue.cc:260] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.629629 12172 ts_tablet_manager.cc:1428] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.629834 12172 tablet_bootstrap.cc:492] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.630743 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 616545b4e9f24f928f1b361d352014a3 (DEFAULT_TABLE table=default.Table_96c4b1885cd441048632e01c02fd2d86 [id=f4d76a369967460fb722a48d09328c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.630971 13836 tablet.cc:1722] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.631055 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616545b4e9f24f928f1b361d352014a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.631834 12172 tablet_bootstrap.cc:654] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.640002 12036 tablet_service.cc:1468] Processing CreateTablet for tablet e545771afabc4716a1c8a94877ff7e0b (DEFAULT_TABLE table=default.Table_a1264bda82fe4bc39be4dcb54ef7d41c [id=c6e9ce93c32f4d5ba20c47cbac7e37dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.640236 11898 tablet_service.cc:1468] Processing CreateTablet for tablet 90585194e313433ab156cd04779eca49 (DEFAULT_TABLE table=default.Table_ab0e5c75bb46419a8f85de1bfa8a6c64 [id=deb8be092c824458835f6850ba169ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.640347 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e545771afabc4716a1c8a94877ff7e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.640481 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90585194e313433ab156cd04779eca49. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.640676 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f9ed052ae88e4b679ac55177a3bbab88 (table default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]) successfully deleted
I20250625 14:02:05.640857 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0f6c287461864f6dba5f47711eb69fae (table default.Table_8b6663de9f0f48ea92b610c69d981c0f [id=c3b9ed6331ef4f96b98d38c7d8bad3b1]) successfully deleted
I20250625 14:02:05.641865 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet b55487136b024aa788e31debeb1b2eca (table default.Table_418c3536c18d47b6ba687faf26494aec [id=2a1a9f6617b14b9791434d1474b48ea3]) successfully deleted
I20250625 14:02:05.641997 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet c06757067b3e465f8239b9ff38b68071 (table default.Table_f3a4b3350e8e41d7836f31c9067e19c1 [id=45e71fb25c9d4772b0a719a4211cbf37]) successfully deleted
W20250625 14:02:05.642114 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet b778a1b075794c0a86992066a14d5e11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b778a1b075794c0a86992066a14d5e11 already in progress: creating tablet
W20250625 14:02:05.642230 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet bf448c94caf447bd8ddbad9c6ace0712 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf448c94caf447bd8ddbad9c6ace0712 already in progress: creating tablet
W20250625 14:02:05.642493 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 5ecae25fa8e74a25a3d99ff300c0394d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ecae25fa8e74a25a3d99ff300c0394d already in progress: creating tablet
W20250625 14:02:05.642725 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 17eee455777b4258a6d236c33ce10c0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17eee455777b4258a6d236c33ce10c0a already in progress: creating tablet
I20250625 14:02:05.642804 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 90585194e313433ab156cd04779eca49 (DEFAULT_TABLE table=default.Table_ab0e5c75bb46419a8f85de1bfa8a6c64 [id=deb8be092c824458835f6850ba169ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.643049 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90585194e313433ab156cd04779eca49. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.643046 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 7bcc674dc5e448c0871e4efe0c9100b8 (table default.Table_6826e63ce5054cbea665e81b978621cf [id=0cc4d60231684c63a378ce32eadc8106]) successfully deleted
W20250625 14:02:05.643179 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet e85f6b7b1f6a4966ad3c102dd8addea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e85f6b7b1f6a4966ad3c102dd8addea7 already in progress: creating tablet
I20250625 14:02:05.645191 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet a753b44395994a4abaaa96fb9b6d594a with delete_type TABLET_DATA_DELETED (replaced by tablet bf421457ab6c481f9fd6e18a9572ba5f) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.646639 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet e85f6b7b1f6a4966ad3c102dd8addea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.647085 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 0dffa9aa4e5c4cbba7277cc988e1a4bb (DEFAULT_TABLE table=default.Table_ccba0555eb234e0fb2246d46b57d7fab [id=c4f0be767732471db9967af435187214]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.647370 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dffa9aa4e5c4cbba7277cc988e1a4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.648038 12173 tablet_replica.cc:331] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.648192 12173 raft_consensus.cc:2241] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.648316 12173 raft_consensus.cc:2270] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.648969 12173 ts_tablet_manager.cc:1905] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.650285 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 6f0cc665cb164feaa1e52ee48796e22f (DEFAULT_TABLE table=default.Table_c359a7a3792d45e49f813d0a82ff0c48 [id=924bc897165a4a84990c6206b5136755]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.650556 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0cc665cb164feaa1e52ee48796e22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.651314 12173 ts_tablet_manager.cc:1918] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.651372 12173 log.cc:1199] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a753b44395994a4abaaa96fb9b6d594a
I20250625 14:02:05.651566 12173 ts_tablet_manager.cc:1939] T a753b44395994a4abaaa96fb9b6d594a P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.652925 11747 tablet_service.cc:1468] Processing CreateTablet for tablet 0afd4fac76cb4424af7bfc1c89add7f0 (DEFAULT_TABLE table=default.Table_1ad8bc8df53b47e8b766b570a08fbd82 [id=3fec5f1e588e4a72bf7f0d045b441397]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.653172 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afd4fac76cb4424af7bfc1c89add7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.655627 11747 tablet_service.cc:1468] Processing CreateTablet for tablet e545771afabc4716a1c8a94877ff7e0b (DEFAULT_TABLE table=default.Table_a1264bda82fe4bc39be4dcb54ef7d41c [id=c6e9ce93c32f4d5ba20c47cbac7e37dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.655856 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e545771afabc4716a1c8a94877ff7e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.657995 11747 tablet_service.cc:1468] Processing CreateTablet for tablet 90585194e313433ab156cd04779eca49 (DEFAULT_TABLE table=default.Table_ab0e5c75bb46419a8f85de1bfa8a6c64 [id=deb8be092c824458835f6850ba169ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.658253 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90585194e313433ab156cd04779eca49. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.660687 11750 tablet_service.cc:1468] Processing CreateTablet for tablet eb5e0b2ad1ea4d8abf8fcb6ac7769c57 (DEFAULT_TABLE table=default.Table_4d033eef3b9e4a4c97d4dbb39bd68006 [id=4efc600234e442d3b20422871e26e84c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.661006 13942 raft_consensus.cc:491] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.661185 13942 raft_consensus.cc:513] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.662082 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "edc5b7cc92564ba4ad04f68e18b56dfe" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
W20250625 14:02:05.662168 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69561949c8b04a75a0bbdde9e9656e37 consensus state has no leader
I20250625 14:02:05.663059 13942 leader_election.cc:290] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.663350 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5e0b2ad1ea4d8abf8fcb6ac7769c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.664312 11532 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet edc5b7cc92564ba4ad04f68e18b56dfe (table default.Table_0255a6753f1443abb6d5c32d77404997 [id=205b876e2e7a4f54bbddec9150d67e0a]). Expected version 2 got 0
I20250625 14:02:05.664659 11532 master_service.cc:948] ReplaceTablet: received request to replace tablet 3a5c9b1852a847188bb7e2f08a37fded from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.664970 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d61308689da1423780a12d18efa767eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.665372 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d61308689da1423780a12d18efa767eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.666293 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_0590500722434353888627a48c4f2210"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.666675 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0590500722434353888627a48c4f2210 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.667441 12167 tablet_bootstrap.cc:492] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.667526 12167 ts_tablet_manager.cc:1397] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.120s user 0.000s sys 0.002s
I20250625 14:02:05.667502 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ec0754ea645c4de49bd5d5e6bef6ff7f" } new_table_name: "default.Table_b9cba62c46354ef39e9fdceab01cddf2" modify_external_catalogs: true
I20250625 14:02:05.668080 12167 raft_consensus.cc:357] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.668180 12167 raft_consensus.cc:383] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.668208 12167 raft_consensus.cc:738] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.668319 12167 consensus_queue.cc:260] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.668373 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a77f086339a047d5b0d22505879b5451" } new_table_name: "default.Table_9f1589ed18dd45a199241076e8bd9051" modify_external_catalogs: true
I20250625 14:02:05.668584 12167 ts_tablet_manager.cc:1428] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.668762 12167 tablet_bootstrap.cc:492] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.669266 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_43cee7a33f354877b24e72503adce005"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.669548 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43cee7a33f354877b24e72503adce005 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.669924 12167 tablet_bootstrap.cc:654] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.670176 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 611afe6d28214382a538791e33a5ed78
I20250625 14:02:05.670447 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 611afe6d28214382a538791e33a5ed78 deleted and replaced by tablet 20944adac32641b2b3196da6a0f57cda
I20250625 14:02:05.670631 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_71c4ad7aed244e6f8f7ab292aba8b124"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.670953 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71c4ad7aed244e6f8f7ab292aba8b124 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.671577 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 899b47cc4b9e4afc854dccac27d7fec0
I20250625 14:02:05.671917 11530 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_88e1a1caf12b4d52b97e8f08d34ffae6" } modify_external_catalogs: true
I20250625 14:02:05.672003 11530 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_88e1a1caf12b4d52b97e8f08d34ffae6" } modify_external_catalogs: true
I20250625 14:02:05.672641 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 00437d4f1cae420698471935887c2418
I20250625 14:02:05.672984 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ebe197591ad842be978efbf31a2f578c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.673290 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebe197591ad842be978efbf31a2f578c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.673938 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "edc5b7cc92564ba4ad04f68e18b56dfe" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.677695 11858 leader_election.cc:304] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.677956 13837 raft_consensus.cc:2747] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.680339 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13a2c2f498e24f47a12181a89dcbd769" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:05.680469 11783 raft_consensus.cc:3058] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.680574 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a951fa8b0cab485f9c221367c029fa4a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.680599 11777 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55ede5e94e12449abbbec9146331deb5" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.681134 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c744b3d26efa42c0bf7fe30c561c692d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.681185 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c188bc758a4c4a71a5550fc11fe59b1a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.681285 11780 raft_consensus.cc:2466] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:05.681603 11783 raft_consensus.cc:2466] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:05.685359 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0255a6753f1443abb6d5c32d77404997" } new_table_name: "default.Table_7af9a985084d4c85b876e1ffb004ce4a" modify_external_catalogs: true
I20250625 14:02:05.691588 11531 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 30d9ae02b4804d638d831ddf40f4205d
I20250625 14:02:05.691975 11531 catalog_manager.cc:6652] ReplaceTablet: tablet 30d9ae02b4804d638d831ddf40f4205d deleted and replaced by tablet 80c4e73025624d079cafac17c8715c13
I20250625 14:02:05.692255 11531 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dc817da16df74c95b995c3cbe79ba0cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.694350 11531 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc817da16df74c95b995c3cbe79ba0cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.700371 12166 tablet_bootstrap.cc:492] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.700485 12166 ts_tablet_manager.cc:1397] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.118s user 0.002s sys 0.000s
I20250625 14:02:05.700995 12166 raft_consensus.cc:357] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.701102 12166 raft_consensus.cc:383] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.701130 12166 raft_consensus.cc:738] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.701251 12166 consensus_queue.cc:260] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.701519 12166 ts_tablet_manager.cc:1428] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.701725 12166 tablet_bootstrap.cc:492] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.703022 12166 tablet_bootstrap.cc:654] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.705408 12167 tablet_bootstrap.cc:492] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.705915 12167 ts_tablet_manager.cc:1397] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20250625 14:02:05.706545 12167 raft_consensus.cc:357] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.706732 12167 raft_consensus.cc:383] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.706808 12167 raft_consensus.cc:738] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.707043 12167 consensus_queue.cc:260] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.708717 12167 ts_tablet_manager.cc:1428] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:05.708972 12167 tablet_bootstrap.cc:492] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.710041 12167 tablet_bootstrap.cc:654] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.711971 11993 leader_election.cc:343] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 60ca3a1ea9b944a2a1830cad6cee3cff
I20250625 14:02:05.712069 11993 leader_election.cc:304] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:02:05.712170 11993 raft_consensus.cc:2684] T 60ca3a1ea9b944a2a1830cad6cee3cff P 87a003e25dbf461ebec24a29ad7016ed: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250625 14:02:05.714752 12175 tablet_replica.cc:331] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.714955 12175 raft_consensus.cc:2241] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.715185 12175 raft_consensus.cc:2270] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.715655 12175 ts_tablet_manager.cc:1905] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.716025 12167 tablet_bootstrap.cc:492] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.716179 12167 ts_tablet_manager.cc:1397] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20250625 14:02:05.716773 12167 raft_consensus.cc:357] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.717017 12167 raft_consensus.cc:383] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.717113 12167 raft_consensus.cc:738] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.717387 12167 consensus_queue.cc:260] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.717782 12167 ts_tablet_manager.cc:1428] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.718187 12167 tablet_bootstrap.cc:492] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.719336 12167 tablet_bootstrap.cc:654] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.719724 11858 consensus_peers.cc:487] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7353ef647c3649d59fadbd240ccae7bb. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:05.721335 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c06757067b3e465f8239b9ff38b68071 (table default.Table_f3a4b3350e8e41d7836f31c9067e19c1 [id=45e71fb25c9d4772b0a719a4211cbf37]) successfully deleted
W20250625 14:02:05.721524 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet e85f6b7b1f6a4966ad3c102dd8addea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e85f6b7b1f6a4966ad3c102dd8addea7 already in progress: creating tablet
I20250625 14:02:05.723129 13352 raft_consensus.cc:491] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.723255 13352 raft_consensus.cc:513] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.723776 13352 leader_election.cc:290] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.724360 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6980c62d63b34c67ad095ad9ea18a3f1" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.724813 11990 leader_election.cc:343] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:05.726938 11993 leader_election.cc:343] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.727022 11993 leader_election.cc:304] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:02:05.727236 11993 leader_election.cc:343] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.727293 11993 leader_election.cc:304] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.727803 13121 raft_consensus.cc:2747] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.727952 13121 raft_consensus.cc:2747] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.727986 13232 consensus_queue.cc:1035] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.731925 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet 611afe6d28214382a538791e33a5ed78 with delete_type TABLET_DATA_DELETED (replaced by tablet 20944adac32641b2b3196da6a0f57cda) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.732136 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 00437d4f1cae420698471935887c2418 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:05.732278 11993 leader_election.cc:343] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.732322 12177 tablet_replica.cc:331] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.732355 11993 leader_election.cc:304] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.731957 11747 tablet_service.cc:1515] Processing DeleteTablet for tablet 899b47cc4b9e4afc854dccac27d7fec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.732504 12177 raft_consensus.cc:2241] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.732523 13908 raft_consensus.cc:2747] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.732628 12177 raft_consensus.cc:2270] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.732699 11993 leader_election.cc:304] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.732833 13908 raft_consensus.cc:2802] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.732918 13908 raft_consensus.cc:491] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.732975 13908 raft_consensus.cc:3058] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.733024 11993 leader_election.cc:304] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.733069 12177 ts_tablet_manager.cc:1905] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.734194 13908 raft_consensus.cc:513] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.734655 13908 leader_election.cc:290] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.734762 13908 raft_consensus.cc:2802] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.734822 13908 raft_consensus.cc:695] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:05.734975 13908 consensus_queue.cc:237] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.735692 12177 ts_tablet_manager.cc:1918] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:05.735780 12177 log.cc:1199] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/00437d4f1cae420698471935887c2418
I20250625 14:02:05.735905 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet 30d9ae02b4804d638d831ddf40f4205d with delete_type TABLET_DATA_DELETED (replaced by tablet 80c4e73025624d079cafac17c8715c13) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.735925 13908 consensus_queue.cc:1035] T e58bd9c8a0eb43b5aeedcca452fa7a98 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:05.736047 12177 ts_tablet_manager.cc:1939] T 00437d4f1cae420698471935887c2418 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.736490 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a753b44395994a4abaaa96fb9b6d594a (table default.Table_d61d2d203bec435bb70dc93c563fd08f [id=50267944f4e24298b94151d9f1a1563f]) successfully deleted
I20250625 14:02:05.736503 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 30d9ae02b4804d638d831ddf40f4205d with delete_type TABLET_DATA_DELETED (replaced by tablet 80c4e73025624d079cafac17c8715c13) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.736687 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 1fd261d824c34864a7b15e4736254062 (table default.Table_8641654309e1491691b376a5cb7b52cc [id=fbceaeb4130d4b74b6d1184fc9a76991]) successfully deleted
W20250625 14:02:05.736727 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4559bd9d44c54f3c9bed696716851a5e consensus state has no leader
I20250625 14:02:05.736903 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 1fafeeedcd2842f784e2096fc6a00c07 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.737210 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 611afe6d28214382a538791e33a5ed78 with delete_type TABLET_DATA_DELETED (replaced by tablet 20944adac32641b2b3196da6a0f57cda) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.737380 11897 tablet_service.cc:1515] Processing DeleteTablet for tablet 00437d4f1cae420698471935887c2418 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.737380 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ebcb19662b564c958aca93f4b956a713" } modify_external_catalogs: true
I20250625 14:02:05.737480 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ebcb19662b564c958aca93f4b956a713" } modify_external_catalogs: true
I20250625 14:02:05.737534 13915 tablet.cc:1722] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:05.738508 11527 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_383c4209eda64f9aa6b96f37b69328b2" } modify_external_catalogs: true
I20250625 14:02:05.738601 11527 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_383c4209eda64f9aa6b96f37b69328b2" } modify_external_catalogs: true
I20250625 14:02:05.739171 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 611afe6d28214382a538791e33a5ed78 with delete_type TABLET_DATA_DELETED (replaced by tablet 20944adac32641b2b3196da6a0f57cda) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.739323 12036 tablet_service.cc:1515] Processing DeleteTablet for tablet 899b47cc4b9e4afc854dccac27d7fec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.739423 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 00437d4f1cae420698471935887c2418 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.739522 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 30d9ae02b4804d638d831ddf40f4205d with delete_type TABLET_DATA_DELETED (replaced by tablet 80c4e73025624d079cafac17c8715c13) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.739810 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.739966 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 899b47cc4b9e4afc854dccac27d7fec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.740162 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c188bc758a4c4a71a5550fc11fe59b1a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:05.740370 12173 tablet_replica.cc:331] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.740505 12173 raft_consensus.cc:2241] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.740702 12173 raft_consensus.cc:2270] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:05.740737 11990 leader_election.cc:343] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.741120 12173 ts_tablet_manager.cc:1905] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.742995 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6980c62d63b34c67ad095ad9ea18a3f1" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.744916 12173 ts_tablet_manager.cc:1918] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:05.746274 12173 log.cc:1199] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/00437d4f1cae420698471935887c2418
I20250625 14:02:05.746554 13836 tablet.cc:1722] T 1cfcb08ddbdd43dd92472dcbdc772a2d P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.746729 12173 ts_tablet_manager.cc:1939] T 00437d4f1cae420698471935887c2418 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:05.747907 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 611afe6d28214382a538791e33a5ed78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 611afe6d28214382a538791e33a5ed78 already in progress: creating tablet
I20250625 14:02:05.748940 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet 617782664e1547288a3b361bf8471d12 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.749132 13915 tablet.cc:1722] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.750640 12166 tablet_bootstrap.cc:492] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.750723 12166 ts_tablet_manager.cc:1397] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20250625 14:02:05.751214 12166 raft_consensus.cc:357] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.751314 12166 raft_consensus.cc:383] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.751341 12166 raft_consensus.cc:738] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.751452 12166 consensus_queue.cc:260] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.751701 12166 ts_tablet_manager.cc:1428] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.751848 12166 tablet_bootstrap.cc:492] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.752883 12166 tablet_bootstrap.cc:654] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.753782 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet db5d2263ab724491a7049fb91b0d10fb
I20250625 14:02:05.754221 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a6fc582219ca44c7b59a06e8f10eacbd
I20250625 14:02:05.754966 12172 tablet_bootstrap.cc:492] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.755065 12172 ts_tablet_manager.cc:1397] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.125s user 0.001s sys 0.002s
I20250625 14:02:05.755542 12172 raft_consensus.cc:357] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.755649 12172 raft_consensus.cc:383] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.755681 12172 raft_consensus.cc:738] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.755812 12172 consensus_queue.cc:260] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.756125 12172 ts_tablet_manager.cc:1428] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.756331 12172 tablet_bootstrap.cc:492] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:05.761178 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 611afe6d28214382a538791e33a5ed78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 611afe6d28214382a538791e33a5ed78 already in progress: creating tablet
I20250625 14:02:05.761956 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet db5d2263ab724491a7049fb91b0d10fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.762181 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet a6fc582219ca44c7b59a06e8f10eacbd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.762840 12173 tablet_replica.cc:331] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.762884 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet a6fc582219ca44c7b59a06e8f10eacbd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.763017 12173 raft_consensus.cc:2241] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.763132 12173 raft_consensus.cc:2270] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.763779 12173 ts_tablet_manager.cc:1905] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:05.764134 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 899b47cc4b9e4afc854dccac27d7fec0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 899b47cc4b9e4afc854dccac27d7fec0 already in progress: creating tablet
I20250625 14:02:05.764276 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 00437d4f1cae420698471935887c2418 (table default.Table_fa193e07de344ccdb0d6f6e45a201fe7 [id=56373baba3584912bcff9379fed13ce9]) successfully deleted
W20250625 14:02:05.764397 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 30d9ae02b4804d638d831ddf40f4205d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30d9ae02b4804d638d831ddf40f4205d already in progress: creating tablet
I20250625 14:02:05.764483 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet db5d2263ab724491a7049fb91b0d10fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.764693 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 00437d4f1cae420698471935887c2418 (table default.Table_fa193e07de344ccdb0d6f6e45a201fe7 [id=56373baba3584912bcff9379fed13ce9]) successfully deleted
W20250625 14:02:05.764950 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 899b47cc4b9e4afc854dccac27d7fec0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 899b47cc4b9e4afc854dccac27d7fec0 already in progress: creating tablet
W20250625 14:02:05.765718 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 30d9ae02b4804d638d831ddf40f4205d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30d9ae02b4804d638d831ddf40f4205d already in progress: creating tablet
I20250625 14:02:05.766675 12175 ts_tablet_manager.cc:1918] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:05.766749 12175 log.cc:1199] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/a36ed3e126ef4edfa69fcffb098d0e4f
I20250625 14:02:05.766968 12175 ts_tablet_manager.cc:1939] T a36ed3e126ef4edfa69fcffb098d0e4f P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.767167 12173 ts_tablet_manager.cc:1918] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.767303 12173 log.cc:1199] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/db5d2263ab724491a7049fb91b0d10fb
I20250625 14:02:05.767629 12173 ts_tablet_manager.cc:1939] T db5d2263ab724491a7049fb91b0d10fb P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
W20250625 14:02:05.767818 11993 leader_election.cc:343] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.767937 11993 leader_election.cc:304] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.768031 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet a36ed3e126ef4edfa69fcffb098d0e4f (table default.Table_99867a76f7444c73b03daf2d410e0156 [id=249cebeb7f5b4990ad3776656f4586ab]) successfully deleted
I20250625 14:02:05.768275 13352 raft_consensus.cc:2747] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.768672 11747 tablet_service.cc:1515] Processing DeleteTablet for tablet a6fc582219ca44c7b59a06e8f10eacbd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.768994 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet db5d2263ab724491a7049fb91b0d10fb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.769289 12177 tablet_replica.cc:331] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:02:05.769464 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 3f3555d6f5a14a25b9e96bf4f60eda6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f3555d6f5a14a25b9e96bf4f60eda6c already in progress: creating tablet
I20250625 14:02:05.769474 12177 raft_consensus.cc:2241] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.770275 11915 raft_consensus.cc:3058] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.770354 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c188bc758a4c4a71a5550fc11fe59b1a" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:05.770416 12177 raft_consensus.cc:2270] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.770475 11783 raft_consensus.cc:3058] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.771148 13914 tablet.cc:1722] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:05.771327 12177 ts_tablet_manager.cc:1905] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.771497 11783 raft_consensus.cc:2466] T c188bc758a4c4a71a5550fc11fe59b1a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:05.772234 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet edc5b7cc92564ba4ad04f68e18b56dfe (table default.Table_7af9a985084d4c85b876e1ffb004ce4a [id=205b876e2e7a4f54bbddec9150d67e0a]). Expected version 3 got 0
I20250625 14:02:05.772449 13836 tablet.cc:1722] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:05.772536 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c188bc758a4c4a71a5550fc11fe59b1a (table default.Table_cabcd06410bc4ee282294a6d0f1b2fe7 [id=8030abc171274e888b1dc6dd7b57b98d]). Expected version 1 got 0
I20250625 14:02:05.773830 12177 ts_tablet_manager.cc:1918] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.773908 12177 log.cc:1199] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/db5d2263ab724491a7049fb91b0d10fb
I20250625 14:02:05.774191 12177 ts_tablet_manager.cc:1939] T db5d2263ab724491a7049fb91b0d10fb P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.775785 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet db5d2263ab724491a7049fb91b0d10fb (table default.Table_383c4209eda64f9aa6b96f37b69328b2 [id=54f14ba68b6e47c29e5e7e4d7a0675c4]) successfully deleted
W20250625 14:02:05.776567 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a6fc582219ca44c7b59a06e8f10eacbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6fc582219ca44c7b59a06e8f10eacbd already in progress: creating tablet
W20250625 14:02:05.777235 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a6fc582219ca44c7b59a06e8f10eacbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6fc582219ca44c7b59a06e8f10eacbd already in progress: creating tablet
I20250625 14:02:05.778244 12175 tablet_replica.cc:331] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.778504 11993 leader_election.cc:304] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.778772 13953 raft_consensus.cc:2802] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.778952 13953 raft_consensus.cc:695] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:05.779146 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet db5d2263ab724491a7049fb91b0d10fb (table default.Table_383c4209eda64f9aa6b96f37b69328b2 [id=54f14ba68b6e47c29e5e7e4d7a0675c4]) successfully deleted
I20250625 14:02:05.779467 12175 raft_consensus.cc:2241] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.779585 13953 consensus_queue.cc:237] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.780390 12175 raft_consensus.cc:2270] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.783311 13914 tablet.cc:1722] T 1cfcb08ddbdd43dd92472dcbdc772a2d P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.785693 12175 ts_tablet_manager.cc:1905] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.791226 13915 tablet.cc:1722] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.791594 13531 tablet.cc:1722] T edc5b7cc92564ba4ad04f68e18b56dfe P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.792407 12175 ts_tablet_manager.cc:1918] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.794251 13914 tablet.cc:1722] T edc5b7cc92564ba4ad04f68e18b56dfe P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250625 14:02:05.801681 12167 tablet_bootstrap.cc:492] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.801796 12167 ts_tablet_manager.cc:1397] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.000s
I20250625 14:02:05.802515 12167 raft_consensus.cc:357] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.802661 12167 raft_consensus.cc:383] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.802700 12167 raft_consensus.cc:738] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.802857 12167 consensus_queue.cc:260] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.803369 12167 ts_tablet_manager.cc:1428] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:05.803568 12167 tablet_bootstrap.cc:492] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.804639 12167 tablet_bootstrap.cc:654] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.806087 13915 tablet.cc:1722] T a4ca3d5203a64d99912765b83af97c09 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:05.809211 12172 tablet_bootstrap.cc:654] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.812536 13914 tablet.cc:1722] T a4ca3d5203a64d99912765b83af97c09 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250625 14:02:05.814055 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 70a02be03e4f42929e3cd0c521a00859 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70a02be03e4f42929e3cd0c521a00859 already in progress: creating tablet
I20250625 14:02:05.816707 12172 tablet_bootstrap.cc:492] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.816805 12172 ts_tablet_manager.cc:1397] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.001s
I20250625 14:02:05.817075 12167 tablet_bootstrap.cc:492] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.817170 12167 ts_tablet_manager.cc:1397] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:05.817309 12172 raft_consensus.cc:357] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.817442 12172 raft_consensus.cc:383] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.817477 12172 raft_consensus.cc:738] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.817595 12172 consensus_queue.cc:260] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.817915 12172 ts_tablet_manager.cc:1428] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.818107 12172 tablet_bootstrap.cc:492] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.818121 12167 raft_consensus.cc:357] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.818235 12167 raft_consensus.cc:383] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.818267 12167 raft_consensus.cc:738] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.818434 12167 consensus_queue.cc:260] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.818711 12167 ts_tablet_manager.cc:1428] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.818920 12167 tablet_bootstrap.cc:492] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.819053 12172 tablet_bootstrap.cc:654] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.819933 12167 tablet_bootstrap.cc:654] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.800989 11858 consensus_peers.cc:487] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db5d2263ab724491a7049fb91b0d10fb. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:05.824049 13837 raft_consensus.cc:491] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.824167 13837 raft_consensus.cc:513] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.824565 13837 leader_election.cc:290] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.825241 12172 tablet_bootstrap.cc:492] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.825347 12172 ts_tablet_manager.cc:1397] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
W20250625 14:02:05.825525 11858 leader_election.cc:343] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 10c13ce2b79f4bb9bea6fb3fca4d40a6
I20250625 14:02:05.825791 12172 raft_consensus.cc:357] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.825901 12172 raft_consensus.cc:383] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.825937 12172 raft_consensus.cc:738] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.826056 12172 consensus_queue.cc:260] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.826385 12172 ts_tablet_manager.cc:1428] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.826571 12172 tablet_bootstrap.cc:492] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.827498 12172 tablet_bootstrap.cc:654] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.832463 11855 leader_election.cc:343] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 10c13ce2b79f4bb9bea6fb3fca4d40a6
I20250625 14:02:05.832578 11855 leader_election.cc:304] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.832780 13837 raft_consensus.cc:2747] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.816524 12166 tablet_bootstrap.cc:492] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.832970 13914 tablet.cc:1722] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.833079 12166 ts_tablet_manager.cc:1397] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.081s user 0.000s sys 0.002s
I20250625 14:02:05.833588 12166 raft_consensus.cc:357] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.833689 12166 raft_consensus.cc:383] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.833717 12166 raft_consensus.cc:738] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.833827 12166 consensus_queue.cc:260] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.834103 12166 ts_tablet_manager.cc:1428] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.834283 12166 tablet_bootstrap.cc:492] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.835364 12166 tablet_bootstrap.cc:654] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.832737 13836 tablet.cc:1722] T edc5b7cc92564ba4ad04f68e18b56dfe P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20250625 14:02:05.838908 11855 consensus_peers.cc:487] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7353ef647c3649d59fadbd240ccae7bb. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:05.839006 12172 tablet_bootstrap.cc:492] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.839120 12172 ts_tablet_manager.cc:1397] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:05.839658 12172 raft_consensus.cc:357] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.839774 12172 raft_consensus.cc:383] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.839812 12172 raft_consensus.cc:738] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.839943 12172 consensus_queue.cc:260] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.840222 12172 ts_tablet_manager.cc:1428] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.840400 12172 tablet_bootstrap.cc:492] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.841604 12172 tablet_bootstrap.cc:654] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.844260 13836 tablet.cc:1722] T a4ca3d5203a64d99912765b83af97c09 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250625 14:02:05.815603 13966 tablet.cc:1722] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:05.847282 12175 log.cc:1199] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/3a5c9b1852a847188bb7e2f08a37fded
I20250625 14:02:05.847626 12175 ts_tablet_manager.cc:1939] T 3a5c9b1852a847188bb7e2f08a37fded P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:05.848402 12175 tablet_replica.cc:331] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:05.848564 12175 raft_consensus.cc:2241] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:05.848757 12175 pending_rounds.cc:70] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:02:05.848798 12175 pending_rounds.cc:77] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523073387433984 op_type: NO_OP noop_request { }
I20250625 14:02:05.848865 12175 raft_consensus.cc:2887] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:05.848927 12175 raft_consensus.cc:2270] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.849568 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 3a5c9b1852a847188bb7e2f08a37fded (table default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]) successfully deleted
I20250625 14:02:05.850782 12175 ts_tablet_manager.cc:1905] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.852065 12172 tablet_bootstrap.cc:492] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.852164 12172 ts_tablet_manager.cc:1397] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:05.852995 12172 raft_consensus.cc:357] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.853127 12172 raft_consensus.cc:383] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.853179 12172 raft_consensus.cc:738] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.853304 12172 consensus_queue.cc:260] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.853627 12172 ts_tablet_manager.cc:1428] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.853821 12172 tablet_bootstrap.cc:492] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.856170 12172 tablet_bootstrap.cc:654] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.858438 13334 raft_consensus.cc:491] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.858537 13334 raft_consensus.cc:513] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.858901 13334 leader_election.cc:290] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.861622 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed176205a65d4127b0ae23649187fba0" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.861625 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed176205a65d4127b0ae23649187fba0" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.861765 12044 raft_consensus.cc:2466] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:05.862203 11717 leader_election.cc:304] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:05.862471 13334 raft_consensus.cc:2802] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.862524 13334 raft_consensus.cc:491] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.862560 13334 raft_consensus.cc:3058] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.863766 13334 raft_consensus.cc:513] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.864171 13334 leader_election.cc:290] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.864599 12167 tablet_bootstrap.cc:492] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.864753 12167 ts_tablet_manager.cc:1397] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.002s
W20250625 14:02:05.864794 11717 leader_election.cc:343] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.865279 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed176205a65d4127b0ae23649187fba0" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:05.865311 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed176205a65d4127b0ae23649187fba0" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:05.865404 12044 raft_consensus.cc:3058] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:05.865667 11717 leader_election.cc:343] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.866587 12044 raft_consensus.cc:2466] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:05.867401 12167 raft_consensus.cc:357] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.867612 12167 raft_consensus.cc:383] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.867942 12167 raft_consensus.cc:738] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.868198 12167 consensus_queue.cc:260] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.868603 12167 ts_tablet_manager.cc:1428] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:05.870007 12167 tablet_bootstrap.cc:492] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.870743 11717 leader_election.cc:304] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.874763 13334 raft_consensus.cc:2802] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.874904 13334 raft_consensus.cc:695] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:05.875073 13334 consensus_queue.cc:237] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.876024 12167 tablet_bootstrap.cc:654] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.877300 12166 tablet_bootstrap.cc:492] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.877408 12166 ts_tablet_manager.cc:1397] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.002s
I20250625 14:02:05.877924 12166 raft_consensus.cc:357] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.878064 12166 raft_consensus.cc:383] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.878101 12166 raft_consensus.cc:738] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.878222 12166 consensus_queue.cc:260] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.878564 12166 ts_tablet_manager.cc:1428] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.878785 12166 tablet_bootstrap.cc:492] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.880297 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b1cc0648236f4feb88a93d12331667b3" } new_table_name: "default.Table_25182bee63aa44d9bc69bc3f274d6933" modify_external_catalogs: true
I20250625 14:02:05.881268 11527 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b1f81a550e014cb9a28f9ca4783d277d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.881752 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_e631bfe8479f4cc2b4db1747fc2332cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.882143 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_eec4990a3105440f92c6db1b571e2e97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.883428 12166 tablet_bootstrap.cc:654] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:05.890921 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a7f037177d848aea7d2944fc2a5542d consensus state has no leader
I20250625 14:02:05.891202 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e888412c9a454ef690a8c2a0ce33c075" } new_table_name: "default.Table_c77b876d985a44f89b39ad838a6173b0" modify_external_catalogs: true
W20250625 14:02:05.894977 11527 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1f81a550e014cb9a28f9ca4783d277d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:05.895725 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e631bfe8479f4cc2b4db1747fc2332cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:05.896380 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eec4990a3105440f92c6db1b571e2e97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.896678 12175 ts_tablet_manager.cc:1918] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:05.896766 12175 log.cc:1199] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/7353ef647c3649d59fadbd240ccae7bb
I20250625 14:02:05.897059 12175 ts_tablet_manager.cc:1939] T 7353ef647c3649d59fadbd240ccae7bb P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:02:05.901943 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40624157a77a4649b34a1d281f9fc8ca consensus state has no leader
I20250625 14:02:05.902205 11526 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b9cba62c46354ef39e9fdceab01cddf2" } modify_external_catalogs: true
I20250625 14:02:05.902336 11526 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b9cba62c46354ef39e9fdceab01cddf2" } modify_external_catalogs: true
I20250625 14:02:05.904691 12167 tablet_bootstrap.cc:492] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.904801 12167 ts_tablet_manager.cc:1397] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.000s
I20250625 14:02:05.905479 12167 raft_consensus.cc:357] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.905596 12167 raft_consensus.cc:383] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.905630 12167 raft_consensus.cc:738] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.906165 12167 consensus_queue.cc:260] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.906980 12166 tablet_bootstrap.cc:492] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.907074 12166 ts_tablet_manager.cc:1397] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.000s
I20250625 14:02:05.907511 12166 raft_consensus.cc:357] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.907613 12166 raft_consensus.cc:383] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.907646 12166 raft_consensus.cc:738] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.908169 12166 consensus_queue.cc:260] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.908597 12166 ts_tablet_manager.cc:1428] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.908782 12166 tablet_bootstrap.cc:492] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:05.908802 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f4efe8dfe3af443fbd60cac1679baa02" } modify_external_catalogs: true
I20250625 14:02:05.908921 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f4efe8dfe3af443fbd60cac1679baa02" } modify_external_catalogs: true
I20250625 14:02:05.909220 12167 ts_tablet_manager.cc:1428] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:02:05.909914 12166 tablet_bootstrap.cc:654] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.910584 12167 tablet_bootstrap.cc:492] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.913159 12167 tablet_bootstrap.cc:654] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.913820 12166 tablet_bootstrap.cc:492] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.913880 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 86d1b58fd1a9483b9ead08a55e3b1e63 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.913920 12166 ts_tablet_manager.cc:1397] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:05.914822 12166 raft_consensus.cc:357] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.914968 12166 raft_consensus.cc:383] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.915007 12166 raft_consensus.cc:738] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.915172 12166 consensus_queue.cc:260] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:05.919451 11855 consensus_peers.cc:487] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db5d2263ab724491a7049fb91b0d10fb. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:05.919747 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 714bb5a28ec648f990fa1525a1b50129
I20250625 14:02:05.920882 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 714bb5a28ec648f990fa1525a1b50129 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.921010 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 714bb5a28ec648f990fa1525a1b50129 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.921098 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 714bb5a28ec648f990fa1525a1b50129 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.921190 12173 tablet_replica.cc:331] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.921329 12173 raft_consensus.cc:2241] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.921452 12173 raft_consensus.cc:2270] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.921643 12177 tablet_replica.cc:331] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:05.921790 12177 raft_consensus.cc:2241] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.921908 12177 raft_consensus.cc:2270] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.923242 12173 ts_tablet_manager.cc:1905] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.923959 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_45af6d6dda5a431685c4a200f5cdbdab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.924386 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45af6d6dda5a431685c4a200f5cdbdab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.926028 12173 ts_tablet_manager.cc:1918] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.926101 12173 log.cc:1199] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/714bb5a28ec648f990fa1525a1b50129
I20250625 14:02:05.928462 12177 ts_tablet_manager.cc:1905] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.931200 12177 ts_tablet_manager.cc:1918] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:05.931278 12177 log.cc:1199] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/714bb5a28ec648f990fa1525a1b50129
I20250625 14:02:05.931545 12177 ts_tablet_manager.cc:1939] T 714bb5a28ec648f990fa1525a1b50129 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:05.932032 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 714bb5a28ec648f990fa1525a1b50129 (table default.Table_b9cba62c46354ef39e9fdceab01cddf2 [id=bdc2377687234802984c679833d91825]) successfully deleted
I20250625 14:02:05.932353 12173 ts_tablet_manager.cc:1939] T 714bb5a28ec648f990fa1525a1b50129 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:05.933492 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 714bb5a28ec648f990fa1525a1b50129 (table default.Table_b9cba62c46354ef39e9fdceab01cddf2 [id=bdc2377687234802984c679833d91825]) successfully deleted
I20250625 14:02:05.934108 12172 tablet_bootstrap.cc:492] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.934206 12172 ts_tablet_manager.cc:1397] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.080s user 0.000s sys 0.002s
I20250625 14:02:05.934736 12172 raft_consensus.cc:357] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.934839 12172 raft_consensus.cc:383] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.934870 12172 raft_consensus.cc:738] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.934990 12172 consensus_queue.cc:260] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.935271 12172 ts_tablet_manager.cc:1428] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.935434 12172 tablet_bootstrap.cc:492] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.936412 12172 tablet_bootstrap.cc:654] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.939594 12172 tablet_bootstrap.cc:492] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.939684 12172 ts_tablet_manager.cc:1397] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250625 14:02:05.940140 12172 raft_consensus.cc:357] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.940244 12172 raft_consensus.cc:383] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.940279 12172 raft_consensus.cc:738] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.940711 12172 consensus_queue.cc:260] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.941007 12172 ts_tablet_manager.cc:1428] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:05.941172 12172 tablet_bootstrap.cc:492] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.941329 11527 master_service.cc:948] ReplaceTablet: received request to replace tablet 063a910b914144938ffd7c6bac8c899b from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:05.942282 12172 tablet_bootstrap.cc:654] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.943667 12172 tablet_bootstrap.cc:492] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:05.943799 12172 ts_tablet_manager.cc:1397] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20250625 14:02:05.944265 12172 raft_consensus.cc:357] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.944432 12172 raft_consensus.cc:383] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.944502 12172 raft_consensus.cc:738] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.944849 12172 consensus_queue.cc:260] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.944900 13334 raft_consensus.cc:491] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.945152 13334 raft_consensus.cc:513] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.945200 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1fafeeedcd2842f784e2096fc6a00c07
I20250625 14:02:05.945348 12172 ts_tablet_manager.cc:1428] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:05.945458 11528 catalog_manager.cc:6652] ReplaceTablet: tablet 1fafeeedcd2842f784e2096fc6a00c07 deleted and replaced by tablet b6482fdd381349ab8e743c4222e0ac44
I20250625 14:02:05.945519 12172 tablet_bootstrap.cc:492] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:05.945523 13334 leader_election.cc:290] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:05.946467 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fafeeedcd2842f784e2096fc6a00c07 with delete_type TABLET_DATA_DELETED (replaced by tablet b6482fdd381349ab8e743c4222e0ac44) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.946511 12034 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fafeeedcd2842f784e2096fc6a00c07 with delete_type TABLET_DATA_DELETED (replaced by tablet b6482fdd381349ab8e743c4222e0ac44) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.946552 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6980c62d63b34c67ad095ad9ea18a3f1" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.946689 12172 tablet_bootstrap.cc:654] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.946704 12044 raft_consensus.cc:2466] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:05.946902 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 1fafeeedcd2842f784e2096fc6a00c07 with delete_type TABLET_DATA_DELETED (replaced by tablet b6482fdd381349ab8e743c4222e0ac44) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.947103 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6980c62d63b34c67ad095ad9ea18a3f1" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.948693 11717 leader_election.cc:343] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.948849 11717 leader_election.cc:304] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.949018 13334 raft_consensus.cc:2802] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.949074 13334 raft_consensus.cc:491] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.949112 13334 raft_consensus.cc:3058] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.950842 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_8193f9ee464a43c6be149812c4d05972"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.950816 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_622d35123f4842a881aba8df38eb071f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.951270 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_622d35123f4842a881aba8df38eb071f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.950285 13334 raft_consensus.cc:513] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.951851 13334 leader_election.cc:290] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:05.951270 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8193f9ee464a43c6be149812c4d05972 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.954279 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6980c62d63b34c67ad095ad9ea18a3f1" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:05.954344 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6980c62d63b34c67ad095ad9ea18a3f1" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:05.954443 12056 raft_consensus.cc:3058] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.954803 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d2fa079b72ec4a8ea1e84d16cf33ff53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.955288 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2fa079b72ec4a8ea1e84d16cf33ff53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.955518 12056 raft_consensus.cc:2466] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
W20250625 14:02:05.956656 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 1fafeeedcd2842f784e2096fc6a00c07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fafeeedcd2842f784e2096fc6a00c07 already in progress: creating tablet
I20250625 14:02:05.957284 11717 leader_election.cc:304] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
W20250625 14:02:05.957592 11717 leader_election.cc:343] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.957723 13855 raft_consensus.cc:2802] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:05.957816 13855 raft_consensus.cc:695] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:05.957967 13855 consensus_queue.cc:237] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.959847 11525 catalog_manager.cc:5582] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:05.960172 11525 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet edc5b7cc92564ba4ad04f68e18b56dfe (table default.Table_7af9a985084d4c85b876e1ffb004ce4a [id=205b876e2e7a4f54bbddec9150d67e0a]). Expected version 3 got 0
I20250625 14:02:05.960521 11530 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 86d1b58fd1a9483b9ead08a55e3b1e63
I20250625 14:02:05.960896 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_62f04d7043d84b3fb09e236e5edcdfe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:05.961437 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62f04d7043d84b3fb09e236e5edcdfe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.962535 12166 ts_tablet_manager.cc:1428] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.049s user 0.001s sys 0.000s
I20250625 14:02:05.962612 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_76e2745232164aeb8c602c3702e616cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:05.962795 12166 tablet_bootstrap.cc:492] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:02:05.962983 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76e2745232164aeb8c602c3702e616cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:05.963702 12166 tablet_bootstrap.cc:654] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.964207 11531 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_9ef72fe56e5d459bb24f90a1299137e8" } new_table_name: "default.Table_a6b8aaf79fa74adbb0b9320bae2a491a" modify_external_catalogs: true
I20250625 14:02:05.967046 13121 raft_consensus.cc:491] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.967160 13121 raft_consensus.cc:513] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.967581 13121 leader_election.cc:290] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.967972 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbe2dcd1fb924dcba5c12aaa8e141435" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.968360 11990 leader_election.cc:343] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.971985 13334 raft_consensus.cc:491] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.972095 13334 raft_consensus.cc:513] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.972443 13334 leader_election.cc:290] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:05.972445 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1fafeeedcd2842f784e2096fc6a00c07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fafeeedcd2842f784e2096fc6a00c07 already in progress: creating tablet
I20250625 14:02:05.972807 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 0090e93951b44e75aa3d63add19da6ad (DEFAULT_TABLE table=default.Table_5767d7ea96074056935ac13348cb9897 [id=880d8a40119d4693b34a5b2b877e3cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.973091 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0090e93951b44e75aa3d63add19da6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.975373 12167 tablet_bootstrap.cc:492] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:05.975458 12167 ts_tablet_manager.cc:1397] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.002s
I20250625 14:02:05.975466 13837 raft_consensus.cc:491] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.975556 13837 raft_consensus.cc:513] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.975911 12167 raft_consensus.cc:357] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.975957 13837 leader_election.cc:290] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:05.976006 12167 raft_consensus.cc:383] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.976037 12167 raft_consensus.cc:738] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.976150 12167 consensus_queue.cc:260] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.976279 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 0090e93951b44e75aa3d63add19da6ad (DEFAULT_TABLE table=default.Table_5767d7ea96074056935ac13348cb9897 [id=880d8a40119d4693b34a5b2b877e3cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.976334 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 0090e93951b44e75aa3d63add19da6ad (DEFAULT_TABLE table=default.Table_5767d7ea96074056935ac13348cb9897 [id=880d8a40119d4693b34a5b2b877e3cc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.976428 12167 ts_tablet_manager.cc:1428] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:05.976557 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0090e93951b44e75aa3d63add19da6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.976557 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0090e93951b44e75aa3d63add19da6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.977519 11747 tablet_service.cc:1468] Processing CreateTablet for tablet fc78172651f14843a13e5a7c4d938399 (DEFAULT_TABLE table=default.Table_d71a5103ec2b4d9c95e4858f89ef71a2 [id=e8cea2a138a64d16993eaa129cc28665]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.977773 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc78172651f14843a13e5a7c4d938399. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.977836 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f26de29aebc46b49d863c02fe8b1776" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.977962 11778 raft_consensus.cc:2391] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:05.978600 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6f26de29aebc46b49d863c02fe8b1776" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.979112 12167 tablet_bootstrap.cc:492] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:05.980132 12167 tablet_bootstrap.cc:654] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.980224 11855 leader_election.cc:304] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:05.980404 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 8a5b0a1080354013a8c79b0628ac5588 (DEFAULT_TABLE table=default.Table_dacc3719139549cfa4d64f7f306e611d [id=aacec8edaf96450a976291bb35f5c4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.980571 13837 raft_consensus.cc:3058] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.981503 13837 raft_consensus.cc:2747] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.980868 11762 tablet_service.cc:1468] Processing CreateTablet for tablet 20370c275b7741e8976a62e7c0aad2fe (DEFAULT_TABLE table=default.Table_b99ca2e1eafe4deb969626e446c95014 [id=e6200c40c79343b08f50f18db822bb14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.981863 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20370c275b7741e8976a62e7c0aad2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.981918 11745 tablet_service.cc:1515] Processing DeleteTablet for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.982172 11745 tablet_service.cc:1468] Processing CreateTablet for tablet 7fbbe860bf5548d98c78eeb16783e41e (DEFAULT_TABLE table=default.Table_bc8d9a93788f42a5b9d886f56e986983 [id=bce866847b0d4e0795e1a18d6aa7832e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.982234 11754 tablet_service.cc:1468] Processing CreateTablet for tablet bd10ae646ec245638494100a597a5bca (DEFAULT_TABLE table=default.Table_42741884e19b41859a14690aaff60e01 [id=dd566b2682604d5287127e25a76b362d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.982769 11748 tablet_service.cc:1468] Processing CreateTablet for tablet e2ef47aad24c4471bbe5d1e3b8c4c95f (DEFAULT_TABLE table=default.Table_c6c480793ece4dab9bc7cc716b1ff1d1 [id=eac8bee7384b4014b109ed96a1822607]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.981122 11761 tablet_service.cc:1468] Processing CreateTablet for tablet ab7cefe7389d447d9c6296b8cc89314d (DEFAULT_TABLE table=default.Table_946189ff0eea4624816248c3b21c198a [id=e7a47623e1bc42bea38c2ce9477fc76d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.982378 11755 tablet_service.cc:1515] Processing DeleteTablet for tablet ed176205a65d4127b0ae23649187fba0 with delete_type TABLET_DATA_DELETED (replaced by tablet f7808bed1b8f4103bf728b8a525dad5d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:05.983119 11763 tablet_service.cc:1468] Processing CreateTablet for tablet b370c58d1eb148be8134b5b23a7d4799 (DEFAULT_TABLE table=default.Table_3e425976b7b745edb5a456f581fc492c [id=b691c108a01a40f5b220d53448462c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.983232 11755 tablet_service.cc:1468] Processing CreateTablet for tablet f3710041e4844fc8b2d359a3a538df0e (DEFAULT_TABLE table=default.Table_2ee174970a064eb48f70813f12594d1e [id=c69d73677f38448da9948f50f121fb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.983453 11756 tablet_service.cc:1468] Processing CreateTablet for tablet 32204e9043da4817b459d705e5a95df5 (DEFAULT_TABLE table=default.Table_efff2a18e5ca4d60856266534e3d947b [id=dd03e29ef06d4146ab7df5963de9be9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.983778 11746 tablet_service.cc:1468] Processing CreateTablet for tablet c70551badfd54ab2b999920f2b389ae1 (DEFAULT_TABLE table=default.Table_e19c4f793b7d45c49084192e837f0570 [id=66e4c5c5b6224f5c988218826253834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.980916 11747 tablet_service.cc:1468] Processing CreateTablet for tablet 870e6f8079f7484898d70dc2d1ff1ea0 (DEFAULT_TABLE table=default.Table_1ca83fb6a17643d3a89aed2a88e32e1a [id=b0c418b03ff34a8aa4eb44379cec5d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.982534 11752 tablet_service.cc:1468] Processing CreateTablet for tablet dfdc4ba2ef6c4593a6e6d16255302818 (DEFAULT_TABLE table=default.Table_bb784063ba1248438e039c64715cb515 [id=dd9a8d7624744d5695c92d36fe99426f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.984149 11758 tablet_service.cc:1468] Processing CreateTablet for tablet 12284afa054544c59b54f66cccb4df66 (DEFAULT_TABLE table=default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.984246 12166 tablet_bootstrap.cc:492] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:05.984215 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "725a0db4c6374805903657f755ca1783" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:05.984336 12166 ts_tablet_manager.cc:1397] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20250625 14:02:05.984403 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 118b6c8065704ff883a05bbb07ab2f37 (DEFAULT_TABLE table=default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.984637 11760 tablet_service.cc:1468] Processing CreateTablet for tablet b7ec353d676349ad8f9561289e9c63ca (DEFAULT_TABLE table=default.Table_43faae0acc284124bd4fe83a4846d4f4 [id=6ef7a48b788949c782e607a791da6eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.984817 12166 raft_consensus.cc:357] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.984871 11751 tablet_service.cc:1468] Processing CreateTablet for tablet 2f2207d9f1574f6c98dd2571fd829016 (DEFAULT_TABLE table=default.Table_17a1621fab7d4e22a98e28d43c15c977 [id=8bfeb12f57da4d74996f1ee5642c2304]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.984933 12166 raft_consensus.cc:383] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:05.984967 12166 raft_consensus.cc:738] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:05.985082 12166 consensus_queue.cc:260] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:05.985121 11753 tablet_service.cc:1468] Processing CreateTablet for tablet a4b72d2e6e334ec793883082728a3ebf (DEFAULT_TABLE table=default.Table_aff1ab56a44d4fee9bb639374c2fc0bc [id=c8d2ddd719ba4a95abb202ed9983a117]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.985342 11757 tablet_service.cc:1468] Processing CreateTablet for tablet 54a6523e08474a93973ec631834a965b (DEFAULT_TABLE table=default.Table_a8bd0f5efe2744339aaa8f05f6bcffdb [id=4c32dbaaf43b4104bd024769816ecf4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.985378 12166 ts_tablet_manager.cc:1428] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:05.985500 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbe2dcd1fb924dcba5c12aaa8e141435" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.985564 12166 tablet_bootstrap.cc:492] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35: Bootstrap starting.
W20250625 14:02:05.985638 11717 leader_election.cc:343] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.985816 13121 raft_consensus.cc:491] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:05.985896 13121 raft_consensus.cc:513] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.985927 11527 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 063a910b914144938ffd7c6bac8c899b
I20250625 14:02:05.986243 11527 catalog_manager.cc:6652] ReplaceTablet: tablet 063a910b914144938ffd7c6bac8c899b deleted and replaced by tablet 8727d01c8f794ec1939846f4bfb9194a
I20250625 14:02:05.986264 13121 leader_election.cc:290] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:05.986511 12166 tablet_bootstrap.cc:654] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:05.986665 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "725a0db4c6374805903657f755ca1783" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:05.987108 11990 leader_election.cc:343] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.987191 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "725a0db4c6374805903657f755ca1783" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:05.987315 12056 raft_consensus.cc:2466] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:05.988268 11717 leader_election.cc:304] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:05.988471 13334 raft_consensus.cc:2802] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:05.988731 13334 raft_consensus.cc:491] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:05.988847 13334 raft_consensus.cc:3058] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:05.989907 13334 raft_consensus.cc:513] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:05.982578 11750 tablet_service.cc:1468] Processing CreateTablet for tablet a5259c893bb740ad83ff2051db1f2f33 (DEFAULT_TABLE table=default.Table_fc827ac37eab4719988b70aa93b1519e [id=0b71ecd2434d4958b372bdae8866729f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.982712 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 35f16657b4514c92b5d1a88db036b39e (DEFAULT_TABLE table=default.Table_a6544a9b408946abb14fab1114bee055 [id=9bffb66ff18349fe8112fff32e021fea]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:05.990550 11993 leader_election.cc:343] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:05.990523 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 8a5b0a1080354013a8c79b0628ac5588 (DEFAULT_TABLE table=default.Table_dacc3719139549cfa4d64f7f306e611d [id=aacec8edaf96450a976291bb35f5c4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.990619 11993 leader_election.cc:304] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:05.990819 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5b0a1080354013a8c79b0628ac5588. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.991012 13908 raft_consensus.cc:2747] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:05.991222 11898 tablet_service.cc:1468] Processing CreateTablet for tablet fc78172651f14843a13e5a7c4d938399 (DEFAULT_TABLE table=default.Table_d71a5103ec2b4d9c95e4858f89ef71a2 [id=e8cea2a138a64d16993eaa129cc28665]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.991441 12033 tablet_service.cc:1468] Processing CreateTablet for tablet fc78172651f14843a13e5a7c4d938399 (DEFAULT_TABLE table=default.Table_d71a5103ec2b4d9c95e4858f89ef71a2 [id=e8cea2a138a64d16993eaa129cc28665]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.982411 11745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fbbe860bf5548d98c78eeb16783e41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.991680 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc78172651f14843a13e5a7c4d938399. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.991680 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc78172651f14843a13e5a7c4d938399. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.993007 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "725a0db4c6374805903657f755ca1783" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:05.993238 11756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32204e9043da4817b459d705e5a95df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.994602 12033 tablet_service.cc:1515] Processing DeleteTablet for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:05.994810 12173 tablet_replica.cc:331] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:05.994938 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 8a5b0a1080354013a8c79b0628ac5588 (DEFAULT_TABLE table=default.Table_dacc3719139549cfa4d64f7f306e611d [id=aacec8edaf96450a976291bb35f5c4bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.994956 12173 raft_consensus.cc:2241] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:05.995152 12173 raft_consensus.cc:2270] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:05.995188 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5b0a1080354013a8c79b0628ac5588. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.995296 11748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef47aad24c4471bbe5d1e3b8c4c95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.995673 12173 ts_tablet_manager.cc:1905] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:05.997251 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b370c58d1eb148be8134b5b23a7d4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.998207 11898 tablet_service.cc:1515] Processing DeleteTablet for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:05.998451 11897 tablet_service.cc:1468] Processing CreateTablet for tablet a5259c893bb740ad83ff2051db1f2f33 (DEFAULT_TABLE table=default.Table_fc827ac37eab4719988b70aa93b1519e [id=0b71ecd2434d4958b372bdae8866729f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:05.998555 11746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c70551badfd54ab2b999920f2b389ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:05.998715 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5259c893bb740ad83ff2051db1f2f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.000301 12173 ts_tablet_manager.cc:1918] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:06.000370 12173 log.cc:1199] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/86d1b58fd1a9483b9ead08a55e3b1e63
I20250625 14:02:06.000620 12173 ts_tablet_manager.cc:1939] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:06.000741 11755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3710041e4844fc8b2d359a3a538df0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.001852 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870e6f8079f7484898d70dc2d1ff1ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.002029 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdc4ba2ef6c4593a6e6d16255302818. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.002245 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7cefe7389d447d9c6296b8cc89314d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.003289 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 870e6f8079f7484898d70dc2d1ff1ea0 (DEFAULT_TABLE table=default.Table_1ca83fb6a17643d3a89aed2a88e32e1a [id=b0c418b03ff34a8aa4eb44379cec5d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.003553 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870e6f8079f7484898d70dc2d1ff1ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.004007 11758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12284afa054544c59b54f66cccb4df66. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.004321 12033 tablet_service.cc:1468] Processing CreateTablet for tablet a5259c893bb740ad83ff2051db1f2f33 (DEFAULT_TABLE table=default.Table_fc827ac37eab4719988b70aa93b1519e [id=0b71ecd2434d4958b372bdae8866729f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.004559 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5259c893bb740ad83ff2051db1f2f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.006402 11754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd10ae646ec245638494100a597a5bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.007012 11761 tablet_service.cc:1515] Processing DeleteTablet for tablet 063a910b914144938ffd7c6bac8c899b with delete_type TABLET_DATA_DELETED (replaced by tablet 8727d01c8f794ec1939846f4bfb9194a) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.010538 12167 tablet_bootstrap.cc:492] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.010635 12167 ts_tablet_manager.cc:1397] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250625 14:02:06.010613 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 870e6f8079f7484898d70dc2d1ff1ea0 (DEFAULT_TABLE table=default.Table_1ca83fb6a17643d3a89aed2a88e32e1a [id=b0c418b03ff34a8aa4eb44379cec5d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.010850 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870e6f8079f7484898d70dc2d1ff1ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.011130 12167 raft_consensus.cc:357] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.011216 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 617782664e1547288a3b361bf8471d12
I20250625 14:02:06.011251 12167 raft_consensus.cc:383] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.011305 12167 raft_consensus.cc:738] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.011418 12167 consensus_queue.cc:260] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.011583 11529 catalog_manager.cc:6652] ReplaceTablet: tablet 617782664e1547288a3b361bf8471d12 deleted and replaced by tablet 3da18e1a390c4f198340af55217ef9cb
I20250625 14:02:06.011662 12167 ts_tablet_manager.cc:1428] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.011847 12167 tablet_bootstrap.cc:492] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.011827 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_b5bb34897dbe408eb18a7210d5178009" } new_table_name: "default.Table_208a448bb1364aabb108effff5aa2200" modify_external_catalogs: true
I20250625 14:02:06.012878 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_52857dc21ea84f03a4a21340cb0c9991" } new_table_name: "default.Table_8a414318bb6346b6b0531d537ba386ef" modify_external_catalogs: true
I20250625 14:02:06.013082 12167 tablet_bootstrap.cc:654] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.013597 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "725a0db4c6374805903657f755ca1783" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.013712 12056 raft_consensus.cc:3058] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.014921 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (table default.Table_88e1a1caf12b4d52b97e8f08d34ffae6 [id=1f4a03c6bde742a581596005b19a818f]) successfully deleted
I20250625 14:02:06.015594 12167 tablet_bootstrap.cc:492] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.015688 12167 ts_tablet_manager.cc:1397] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:06.016655 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet f325061ce4bb4468886cfe0a0d752596 (table default.Table_e3322169c32b4dd8af57a18e67156a86 [id=cd68b5ad9c1849298e961363e2e27608]). Expected version 1 got 0
I20250625 14:02:06.016949 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_70ef26dd935f494d9b67e97499efd65c" } modify_external_catalogs: true
I20250625 14:02:06.017055 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_70ef26dd935f494d9b67e97499efd65c" } modify_external_catalogs: true
I20250625 14:02:06.018225 12033 tablet_service.cc:1468] Processing CreateTablet for tablet ab7cefe7389d447d9c6296b8cc89314d (DEFAULT_TABLE table=default.Table_946189ff0eea4624816248c3b21c198a [id=e7a47623e1bc42bea38c2ce9477fc76d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.018472 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "725a0db4c6374805903657f755ca1783" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.018520 12021 tablet_service.cc:1468] Processing CreateTablet for tablet 32204e9043da4817b459d705e5a95df5 (DEFAULT_TABLE table=default.Table_efff2a18e5ca4d60856266534e3d947b [id=dd03e29ef06d4146ab7df5963de9be9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.018762 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32204e9043da4817b459d705e5a95df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.019038 13121 raft_consensus.cc:491] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.019124 13121 raft_consensus.cc:513] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.019315 12022 tablet_service.cc:1468] Processing CreateTablet for tablet b7ec353d676349ad8f9561289e9c63ca (DEFAULT_TABLE table=default.Table_43faae0acc284124bd4fe83a4846d4f4 [id=6ef7a48b788949c782e607a791da6eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.019488 13121 leader_election.cc:290] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.019547 12022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ec353d676349ad8f9561289e9c63ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.020151 12024 tablet_service.cc:1468] Processing CreateTablet for tablet bd10ae646ec245638494100a597a5bca (DEFAULT_TABLE table=default.Table_42741884e19b41859a14690aaff60e01 [id=dd566b2682604d5287127e25a76b362d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.020403 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd10ae646ec245638494100a597a5bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.021126 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7cefe7389d447d9c6296b8cc89314d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.021612 12018 tablet_service.cc:1468] Processing CreateTablet for tablet a4b72d2e6e334ec793883082728a3ebf (DEFAULT_TABLE table=default.Table_aff1ab56a44d4fee9bb639374c2fc0bc [id=c8d2ddd719ba4a95abb202ed9983a117]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.021818 12018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b72d2e6e334ec793883082728a3ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.022481 12036 tablet_service.cc:1468] Processing CreateTablet for tablet e2ef47aad24c4471bbe5d1e3b8c4c95f (DEFAULT_TABLE table=default.Table_c6c480793ece4dab9bc7cc716b1ff1d1 [id=eac8bee7384b4014b109ed96a1822607]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.022699 12036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef47aad24c4471bbe5d1e3b8c4c95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.023496 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 20370c275b7741e8976a62e7c0aad2fe (DEFAULT_TABLE table=default.Table_b99ca2e1eafe4deb969626e446c95014 [id=e6200c40c79343b08f50f18db822bb14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.024674 12028 tablet_service.cc:1468] Processing CreateTablet for tablet b370c58d1eb148be8134b5b23a7d4799 (DEFAULT_TABLE table=default.Table_3e425976b7b745edb5a456f581fc492c [id=b691c108a01a40f5b220d53448462c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.024981 12019 tablet_service.cc:1468] Processing CreateTablet for tablet dfdc4ba2ef6c4593a6e6d16255302818 (DEFAULT_TABLE table=default.Table_bb784063ba1248438e039c64715cb515 [id=dd9a8d7624744d5695c92d36fe99426f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.025199 12037 tablet_service.cc:1468] Processing CreateTablet for tablet 35f16657b4514c92b5d1a88db036b39e (DEFAULT_TABLE table=default.Table_a6544a9b408946abb14fab1114bee055 [id=9bffb66ff18349fe8112fff32e021fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.025449 12026 tablet_service.cc:1468] Processing CreateTablet for tablet c70551badfd54ab2b999920f2b389ae1 (DEFAULT_TABLE table=default.Table_e19c4f793b7d45c49084192e837f0570 [id=66e4c5c5b6224f5c988218826253834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.025696 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 12284afa054544c59b54f66cccb4df66 (DEFAULT_TABLE table=default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.025980 12032 tablet_service.cc:1468] Processing CreateTablet for tablet 118b6c8065704ff883a05bbb07ab2f37 (DEFAULT_TABLE table=default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.026350 12020 tablet_service.cc:1468] Processing CreateTablet for tablet 2f2207d9f1574f6c98dd2571fd829016 (DEFAULT_TABLE table=default.Table_17a1621fab7d4e22a98e28d43c15c977 [id=8bfeb12f57da4d74996f1ee5642c2304]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.026664 12030 tablet_service.cc:1468] Processing CreateTablet for tablet 54a6523e08474a93973ec631834a965b (DEFAULT_TABLE table=default.Table_a8bd0f5efe2744339aaa8f05f6bcffdb [id=4c32dbaaf43b4104bd024769816ecf4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.026743 12167 raft_consensus.cc:357] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.026854 12167 raft_consensus.cc:383] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.026887 12167 raft_consensus.cc:738] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.027004 12025 tablet_service.cc:1468] Processing CreateTablet for tablet 7fbbe860bf5548d98c78eeb16783e41e (DEFAULT_TABLE table=default.Table_bc8d9a93788f42a5b9d886f56e986983 [id=bce866847b0d4e0795e1a18d6aa7832e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.027351 12031 tablet_service.cc:1468] Processing CreateTablet for tablet f3710041e4844fc8b2d359a3a538df0e (DEFAULT_TABLE table=default.Table_2ee174970a064eb48f70813f12594d1e [id=c69d73677f38448da9948f50f121fb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.027602 12029 tablet_service.cc:1515] Processing DeleteTablet for tablet 063a910b914144938ffd7c6bac8c899b with delete_type TABLET_DATA_DELETED (replaced by tablet 8727d01c8f794ec1939846f4bfb9194a) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.027729 12035 tablet_service.cc:1515] Processing DeleteTablet for tablet 617782664e1547288a3b361bf8471d12 with delete_type TABLET_DATA_DELETED (replaced by tablet 3da18e1a390c4f198340af55217ef9cb) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.030282 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "185a1a5f14344caa89473baa57f0b02d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.030478 12175 tablet_replica.cc:331] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.025987 12037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f16657b4514c92b5d1a88db036b39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.030632 12175 raft_consensus.cc:2241] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.030742 12175 raft_consensus.cc:2270] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.031164 12175 ts_tablet_manager.cc:1905] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.027004 12167 consensus_queue.cc:260] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.031644 12167 ts_tablet_manager.cc:1428] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20250625 14:02:06.031904 12167 tablet_bootstrap.cc:492] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.033119 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a6523e08474a93973ec631834a965b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.033402 12167 tablet_bootstrap.cc:654] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.035323 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118b6c8065704ff883a05bbb07ab2f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.036677 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20370c275b7741e8976a62e7c0aad2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.037304 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3710041e4844fc8b2d359a3a538df0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.039108 12020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2207d9f1574f6c98dd2571fd829016. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.040190 12167 tablet_bootstrap.cc:492] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.040282 12167 ts_tablet_manager.cc:1397] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s
I20250625 14:02:06.040722 12167 raft_consensus.cc:357] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.040827 12167 raft_consensus.cc:383] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.040864 12167 raft_consensus.cc:738] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.041134 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fbbe860bf5548d98c78eeb16783e41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.041126 12167 consensus_queue.cc:260] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.042919 12167 ts_tablet_manager.cc:1428] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:06.042990 12175 ts_tablet_manager.cc:1918] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.043062 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b370c58d1eb148be8134b5b23a7d4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.043080 12175 log.cc:1199] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/00437d4f1cae420698471935887c2418
I20250625 14:02:06.043316 12167 tablet_bootstrap.cc:492] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.043349 12175 ts_tablet_manager.cc:1939] T 00437d4f1cae420698471935887c2418 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.043951 12175 tablet_replica.cc:331] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.044111 12175 raft_consensus.cc:2241] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.044237 12175 raft_consensus.cc:2270] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.044560 12167 tablet_bootstrap.cc:654] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.044950 12166 tablet_bootstrap.cc:492] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.045043 12166 ts_tablet_manager.cc:1397] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.000s
I20250625 14:02:06.045251 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdc4ba2ef6c4593a6e6d16255302818. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.045558 12166 raft_consensus.cc:357] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.045682 12166 raft_consensus.cc:383] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.045722 12166 raft_consensus.cc:738] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.045872 12166 consensus_queue.cc:260] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.046175 12166 ts_tablet_manager.cc:1428] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.046420 12166 tablet_bootstrap.cc:492] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.047227 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c70551badfd54ab2b999920f2b389ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.047506 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12284afa054544c59b54f66cccb4df66. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.047799 12166 tablet_bootstrap.cc:654] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.049787 12025 tablet_service.cc:1515] Processing DeleteTablet for tablet 55ede5e94e12449abbbec9146331deb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73f64982ad194dfe9dcbf6b77e047db2) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:06.050381 11990 leader_election.cc:343] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.050386 13121 consensus_queue.cc:1035] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.051887 12175 ts_tablet_manager.cc:1905] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.054257 12175 ts_tablet_manager.cc:1918] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.054450 12175 log.cc:1199] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/10c13ce2b79f4bb9bea6fb3fca4d40a6
I20250625 14:02:06.054709 12175 ts_tablet_manager.cc:1939] T 10c13ce2b79f4bb9bea6fb3fca4d40a6 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.055459 12175 tablet_replica.cc:331] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.055660 12175 raft_consensus.cc:2241] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.055884 12175 raft_consensus.cc:2270] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.056420 12175 ts_tablet_manager.cc:1905] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.058791 12175 ts_tablet_manager.cc:1918] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:06.058872 12175 log.cc:1199] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/db5d2263ab724491a7049fb91b0d10fb
I20250625 14:02:06.059124 12175 ts_tablet_manager.cc:1939] T db5d2263ab724491a7049fb91b0d10fb P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.061282 12175 tablet_replica.cc:331] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.061498 12175 raft_consensus.cc:2241] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.061730 12175 raft_consensus.cc:2270] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.062835 12175 ts_tablet_manager.cc:1905] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.062986 12056 raft_consensus.cc:2466] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.063537 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.063699 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 725a0db4c6374805903657f755ca1783 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.064157 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4faa1262ecb3411c80b52f71f6418114" } modify_external_catalogs: true
I20250625 14:02:06.064283 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4faa1262ecb3411c80b52f71f6418114" } modify_external_catalogs: true
I20250625 14:02:06.065459 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d4df400c852740fbaf7dbb91497de8d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:06.067302 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 7353ef647c3649d59fadbd240ccae7bb (table default.Table_740cd4b264aa4d3baf5d5c296a06cd43 [id=7ccef3951cff4328a6ba48bd01587a5a]) successfully deleted
W20250625 14:02:06.067451 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet b778a1b075794c0a86992066a14d5e11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b778a1b075794c0a86992066a14d5e11 already in progress: creating tablet
W20250625 14:02:06.067548 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet bf448c94caf447bd8ddbad9c6ace0712 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf448c94caf447bd8ddbad9c6ace0712 already in progress: creating tablet
W20250625 14:02:06.067641 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 5ecae25fa8e74a25a3d99ff300c0394d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ecae25fa8e74a25a3d99ff300c0394d already in progress: creating tablet
W20250625 14:02:06.067725 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 17eee455777b4258a6d236c33ce10c0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17eee455777b4258a6d236c33ce10c0a already in progress: creating tablet
W20250625 14:02:06.067806 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet e85f6b7b1f6a4966ad3c102dd8addea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e85f6b7b1f6a4966ad3c102dd8addea7 already in progress: creating tablet
W20250625 14:02:06.067916 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 30d9ae02b4804d638d831ddf40f4205d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30d9ae02b4804d638d831ddf40f4205d already in progress: creating tablet
W20250625 14:02:06.068020 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 611afe6d28214382a538791e33a5ed78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 611afe6d28214382a538791e33a5ed78 already in progress: creating tablet
I20250625 14:02:06.068113 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 00437d4f1cae420698471935887c2418 (table default.Table_fa193e07de344ccdb0d6f6e45a201fe7 [id=56373baba3584912bcff9379fed13ce9]) successfully deleted
I20250625 14:02:06.068199 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 10c13ce2b79f4bb9bea6fb3fca4d40a6 (table default.Table_a0513f1c1050428aafc99329d1115a93 [id=fdd8850d9bb54b189508d389454a1ef0]) successfully deleted
W20250625 14:02:06.068288 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 899b47cc4b9e4afc854dccac27d7fec0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 899b47cc4b9e4afc854dccac27d7fec0 already in progress: creating tablet
I20250625 14:02:06.068282 11900 tablet_service.cc:1515] Processing DeleteTablet for tablet d53e9ef9d5f64cb893a552ab0784c120 with delete_type TABLET_DATA_DELETED (replaced by tablet 680b915f4d574d419a611d05ca2ddcfe) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:06.068382 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a6fc582219ca44c7b59a06e8f10eacbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6fc582219ca44c7b59a06e8f10eacbd already in progress: creating tablet
I20250625 14:02:06.068435 11898 tablet_service.cc:1468] Processing CreateTablet for tablet bd10ae646ec245638494100a597a5bca (DEFAULT_TABLE table=default.Table_42741884e19b41859a14690aaff60e01 [id=dd566b2682604d5287127e25a76b362d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.068498 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet db5d2263ab724491a7049fb91b0d10fb (table default.Table_383c4209eda64f9aa6b96f37b69328b2 [id=54f14ba68b6e47c29e5e7e4d7a0675c4]) successfully deleted
I20250625 14:02:06.068579 11900 tablet_service.cc:1468] Processing CreateTablet for tablet 32204e9043da4817b459d705e5a95df5 (DEFAULT_TABLE table=default.Table_efff2a18e5ca4d60856266534e3d947b [id=dd03e29ef06d4146ab7df5963de9be9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.068781 11898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd10ae646ec245638494100a597a5bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.068822 11897 tablet_service.cc:1468] Processing CreateTablet for tablet ab7cefe7389d447d9c6296b8cc89314d (DEFAULT_TABLE table=default.Table_946189ff0eea4624816248c3b21c198a [id=e7a47623e1bc42bea38c2ce9477fc76d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.068920 11892 tablet_service.cc:1468] Processing CreateTablet for tablet b7ec353d676349ad8f9561289e9c63ca (DEFAULT_TABLE table=default.Table_43faae0acc284124bd4fe83a4846d4f4 [id=6ef7a48b788949c782e607a791da6eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.068939 11896 tablet_service.cc:1468] Processing CreateTablet for tablet 118b6c8065704ff883a05bbb07ab2f37 (DEFAULT_TABLE table=default.Table_e8cdfa18fef245548571944b984ac01f [id=5a145d86c3f740b2ab6d415ecddf5c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.069146 11899 tablet_service.cc:1468] Processing CreateTablet for tablet e2ef47aad24c4471bbe5d1e3b8c4c95f (DEFAULT_TABLE table=default.Table_c6c480793ece4dab9bc7cc716b1ff1d1 [id=eac8bee7384b4014b109ed96a1822607]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.069456 11894 tablet_service.cc:1468] Processing CreateTablet for tablet 35f16657b4514c92b5d1a88db036b39e (DEFAULT_TABLE table=default.Table_a6544a9b408946abb14fab1114bee055 [id=9bffb66ff18349fe8112fff32e021fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.069519 11893 tablet_service.cc:1468] Processing CreateTablet for tablet 2f2207d9f1574f6c98dd2571fd829016 (DEFAULT_TABLE table=default.Table_17a1621fab7d4e22a98e28d43c15c977 [id=8bfeb12f57da4d74996f1ee5642c2304]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.069748 11901 tablet_service.cc:1468] Processing CreateTablet for tablet c70551badfd54ab2b999920f2b389ae1 (DEFAULT_TABLE table=default.Table_e19c4f793b7d45c49084192e837f0570 [id=66e4c5c5b6224f5c988218826253834b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.070053 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 12284afa054544c59b54f66cccb4df66 (DEFAULT_TABLE table=default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe [id=314875c052534d13abab06e5c163c974]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.070072 11895 tablet_service.cc:1468] Processing CreateTablet for tablet a4b72d2e6e334ec793883082728a3ebf (DEFAULT_TABLE table=default.Table_aff1ab56a44d4fee9bb639374c2fc0bc [id=c8d2ddd719ba4a95abb202ed9983a117]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.070582 11888 tablet_service.cc:1468] Processing CreateTablet for tablet 54a6523e08474a93973ec631834a965b (DEFAULT_TABLE table=default.Table_a8bd0f5efe2744339aaa8f05f6bcffdb [id=4c32dbaaf43b4104bd024769816ecf4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.070829 11887 tablet_service.cc:1468] Processing CreateTablet for tablet 7fbbe860bf5548d98c78eeb16783e41e (DEFAULT_TABLE table=default.Table_bc8d9a93788f42a5b9d886f56e986983 [id=bce866847b0d4e0795e1a18d6aa7832e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.070878 11886 tablet_service.cc:1468] Processing CreateTablet for tablet f3710041e4844fc8b2d359a3a538df0e (DEFAULT_TABLE table=default.Table_2ee174970a064eb48f70813f12594d1e [id=c69d73677f38448da9948f50f121fb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.071007 11885 tablet_service.cc:1515] Processing DeleteTablet for tablet 063a910b914144938ffd7c6bac8c899b with delete_type TABLET_DATA_DELETED (replaced by tablet 8727d01c8f794ec1939846f4bfb9194a) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.071040 11884 tablet_service.cc:1515] Processing DeleteTablet for tablet 617782664e1547288a3b361bf8471d12 with delete_type TABLET_DATA_DELETED (replaced by tablet 3da18e1a390c4f198340af55217ef9cb) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:06.071331 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4df400c852740fbaf7dbb91497de8d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.071485 11889 tablet_service.cc:1468] Processing CreateTablet for tablet b370c58d1eb148be8134b5b23a7d4799 (DEFAULT_TABLE table=default.Table_3e425976b7b745edb5a456f581fc492c [id=b691c108a01a40f5b220d53448462c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.071833 11902 tablet_service.cc:1468] Processing CreateTablet for tablet dfdc4ba2ef6c4593a6e6d16255302818 (DEFAULT_TABLE table=default.Table_bb784063ba1248438e039c64715cb515 [id=dd9a8d7624744d5695c92d36fe99426f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.072635 11897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7cefe7389d447d9c6296b8cc89314d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.072767 11900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32204e9043da4817b459d705e5a95df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.073056 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b370c58d1eb148be8134b5b23a7d4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.073191 11887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fbbe860bf5548d98c78eeb16783e41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.073309 11896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118b6c8065704ff883a05bbb07ab2f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.073804 11902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdc4ba2ef6c4593a6e6d16255302818. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.075034 11901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c70551badfd54ab2b999920f2b389ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.075409 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ec353d676349ad8f9561289e9c63ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.075556 11886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3710041e4844fc8b2d359a3a538df0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.075692 11893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2207d9f1574f6c98dd2571fd829016. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.077023 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f16657b4514c92b5d1a88db036b39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.077662 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a6523e08474a93973ec631834a965b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.079118 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef47aad24c4471bbe5d1e3b8c4c95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.081138 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12284afa054544c59b54f66cccb4df66. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.084519 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b72d2e6e334ec793883082728a3ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.086884 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 20370c275b7741e8976a62e7c0aad2fe (DEFAULT_TABLE table=default.Table_b99ca2e1eafe4deb969626e446c95014 [id=e6200c40c79343b08f50f18db822bb14]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.087177 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20370c275b7741e8976a62e7c0aad2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.009297 12177 tablet_replica.cc:331] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.091356 12177 raft_consensus.cc:2241] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.091609 12177 raft_consensus.cc:2270] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.009860 11778 raft_consensus.cc:2391] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:06.092312 12177 ts_tablet_manager.cc:1905] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.007288 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5b0a1080354013a8c79b0628ac5588. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.093909 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5259c893bb740ad83ff2051db1f2f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.093911 12175 ts_tablet_manager.cc:1918] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:06.093988 12175 log.cc:1199] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/714bb5a28ec648f990fa1525a1b50129
I20250625 14:02:06.094245 12175 ts_tablet_manager.cc:1939] T 714bb5a28ec648f990fa1525a1b50129 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.010069 13334 leader_election.cc:290] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.095023 12175 tablet_replica.cc:331] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.095165 12175 raft_consensus.cc:2241] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.095175 12177 ts_tablet_manager.cc:1918] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:06.095245 12177 log.cc:1199] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/86d1b58fd1a9483b9ead08a55e3b1e63
I20250625 14:02:06.095268 12175 raft_consensus.cc:2270] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.095503 12177 ts_tablet_manager.cc:1939] T 86d1b58fd1a9483b9ead08a55e3b1e63 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.095824 12175 ts_tablet_manager.cc:1905] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.096756 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2207d9f1574f6c98dd2571fd829016. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.098052 12175 ts_tablet_manager.cc:1918] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250625 14:02:06.098135 12175 log.cc:1199] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/86d1b58fd1a9483b9ead08a55e3b1e63
I20250625 14:02:06.039023 12172 tablet_bootstrap.cc:492] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.098244 12172 ts_tablet_manager.cc:1397] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.000s
I20250625 14:02:06.098425 12175 ts_tablet_manager.cc:1939] T 86d1b58fd1a9483b9ead08a55e3b1e63 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.098587 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f16657b4514c92b5d1a88db036b39e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.098835 12172 raft_consensus.cc:357] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.098966 12172 raft_consensus.cc:383] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.098999 12172 raft_consensus.cc:738] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.099124 12175 tablet_replica.cc:331] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.099123 12172 consensus_queue.cc:260] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.099251 12175 raft_consensus.cc:2241] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.099334 12175 raft_consensus.cc:2270] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.099435 12172 ts_tablet_manager.cc:1428] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.046054 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "185a1a5f14344caa89473baa57f0b02d" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.099829 12175 ts_tablet_manager.cc:1905] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.099912 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 714bb5a28ec648f990fa1525a1b50129 (table default.Table_b9cba62c46354ef39e9fdceab01cddf2 [id=bdc2377687234802984c679833d91825]) successfully deleted
W20250625 14:02:06.100355 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1fafeeedcd2842f784e2096fc6a00c07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fafeeedcd2842f784e2096fc6a00c07 already in progress: creating tablet
I20250625 14:02:06.100494 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (table default.Table_88e1a1caf12b4d52b97e8f08d34ffae6 [id=1f4a03c6bde742a581596005b19a818f]) successfully deleted
I20250625 14:02:06.100977 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a6523e08474a93973ec631834a965b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.089710 13699 raft_consensus.cc:491] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250625 14:02:06.049691 11717 leader_election.cc:343] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:06.101150 11717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.39.130:45381, user_credentials={real_user=slave}} blocked reactor thread for 51633.3us
I20250625 14:02:06.101140 13699 raft_consensus.cc:513] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.101488 13699 leader_election.cc:290] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.101692 11717 leader_election.cc:304] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.101915 13856 raft_consensus.cc:2802] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.101994 13856 raft_consensus.cc:695] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.102124 13856 consensus_queue.cc:237] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.102689 11993 leader_election.cc:304] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
W20250625 14:02:06.102957 11993 leader_election.cc:343] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.103026 11993 leader_election.cc:304] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.103269 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ec353d676349ad8f9561289e9c63ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.103350 13908 raft_consensus.cc:2747] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.103446 13908 raft_consensus.cc:2747] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.103595 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31f843108ecf440090c05255afa1687e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.103688 12044 raft_consensus.cc:2466] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.104082 11717 leader_election.cc:304] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.104259 13334 raft_consensus.cc:2802] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.104313 13334 raft_consensus.cc:491] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.104352 13334 raft_consensus.cc:3058] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.105306 13334 raft_consensus.cc:513] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.105592 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b72d2e6e334ec793883082728a3ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.105646 13334 leader_election.cc:290] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.105967 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31f843108ecf440090c05255afa1687e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.106076 12044 raft_consensus.cc:3058] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.106410 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118b6c8065704ff883a05bbb07ab2f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.107123 12044 raft_consensus.cc:2466] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.108736 11717 leader_election.cc:304] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.109141 13953 consensus_queue.cc:1035] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.110231 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31f843108ecf440090c05255afa1687e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.110325 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "31f843108ecf440090c05255afa1687e" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.110546 13856 raft_consensus.cc:2802] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.110642 13856 raft_consensus.cc:695] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.110780 13856 consensus_queue.cc:237] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.111145 12175 ts_tablet_manager.cc:1918] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250625 14:02:06.111169 11717 leader_election.cc:343] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.111253 13835 raft_consensus.cc:491] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.111310 12175 log.cc:1199] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/d53e9ef9d5f64cb893a552ab0784c120
I20250625 14:02:06.111332 13835 raft_consensus.cc:513] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:06.111414 11717 leader_election.cc:343] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.111542 12175 ts_tablet_manager.cc:1939] T d53e9ef9d5f64cb893a552ab0784c120 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.111687 13835 leader_election.cc:290] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.113081 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet d53e9ef9d5f64cb893a552ab0784c120 (table default.Table_06f52f09f53f4abf9d515f309f225205 [id=c3c11e126c464fdb8861f40571c798f2]) successfully deleted
W20250625 14:02:06.113268 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 063a910b914144938ffd7c6bac8c899b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 063a910b914144938ffd7c6bac8c899b already in progress: creating tablet
W20250625 14:02:06.113402 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 617782664e1547288a3b361bf8471d12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 617782664e1547288a3b361bf8471d12 already in progress: creating tablet
W20250625 14:02:06.113579 11855 leader_election.cc:343] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 292e9c27637d410ea487761f50bdee88
W20250625 14:02:06.118527 11858 leader_election.cc:343] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 292e9c27637d410ea487761f50bdee88
I20250625 14:02:06.118639 11858 leader_election.cc:304] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.119216 13835 raft_consensus.cc:2747] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.123203 13232 raft_consensus.cc:491] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.123317 13232 raft_consensus.cc:513] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.123713 13232 leader_election.cc:290] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:06.124233 11531 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b20ed857212042a090eef437eea0fe15 consensus state has no leader
I20250625 14:02:06.124320 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 70aadb0035014e32bfba240e4d6d0951
I20250625 14:02:06.124408 12172 tablet_bootstrap.cc:492] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.124614 11533 master_service.cc:948] ReplaceTablet: received request to replace tablet 2f7a157ebffa48d9b67fba29bb3ccb1e from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.125576 12172 tablet_bootstrap.cc:654] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.126400 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 70aadb0035014e32bfba240e4d6d0951 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.128463 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6
W20250625 14:02:06.128484 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d7bd3487d954aeab0053b755d8ffe09 consensus state has no leader
I20250625 14:02:06.129732 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.133294 11889 tablet_service.cc:1515] Processing DeleteTablet for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.134431 13334 raft_consensus.cc:491] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.134532 13334 raft_consensus.cc:513] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.134842 13334 leader_election.cc:290] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.134987 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a70afbc1a02a457c9099532e16eaac48" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.135072 11783 raft_consensus.cc:2466] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.136427 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c744b3d26efa42c0bf7fe30c561c692d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.136579 12044 raft_consensus.cc:2466] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.136452 11993 leader_election.cc:304] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.136988 13908 raft_consensus.cc:2802] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.137058 13908 raft_consensus.cc:491] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.137113 13908 raft_consensus.cc:3058] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.137781 11918 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a70afbc1a02a457c9099532e16eaac48" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.138269 13908 raft_consensus.cc:513] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.138633 13908 leader_election.cc:290] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.138885 11916 raft_consensus.cc:3058] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.141275 11990 leader_election.cc:343] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.141484 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c744b3d26efa42c0bf7fe30c561c692d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.141870 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a70afbc1a02a457c9099532e16eaac48" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.142165 12173 tablet_replica.cc:331] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:06.142352 12173 raft_consensus.cc:2241] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.142470 12173 raft_consensus.cc:2270] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.142915 12173 ts_tablet_manager.cc:1905] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.145502 13915 tablet.cc:1722] T 674b6cd0ec374505a340cfefb6df63bb P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:02:06.145545 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 063a910b914144938ffd7c6bac8c899b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 063a910b914144938ffd7c6bac8c899b already in progress: creating tablet
W20250625 14:02:06.145738 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 617782664e1547288a3b361bf8471d12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 617782664e1547288a3b361bf8471d12 already in progress: creating tablet
I20250625 14:02:06.146201 13334 raft_consensus.cc:491] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.146330 13334 raft_consensus.cc:513] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.146720 13334 leader_election.cc:290] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.147482 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a70afbc1a02a457c9099532e16eaac48" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.147603 11780 raft_consensus.cc:3058] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.147930 13914 tablet.cc:1722] T 674b6cd0ec374505a340cfefb6df63bb P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:06.148640 11780 raft_consensus.cc:2466] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
W20250625 14:02:06.149427 11717 leader_election.cc:343] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.149845 11717 leader_election.cc:304] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.150851 12173 ts_tablet_manager.cc:1918] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.150959 12173 log.cc:1199] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/55ede5e94e12449abbbec9146331deb5
I20250625 14:02:06.151203 12173 ts_tablet_manager.cc:1939] T 55ede5e94e12449abbbec9146331deb5 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:06.151592 13334 raft_consensus.cc:2802] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.151650 13334 raft_consensus.cc:491] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.151690 13334 raft_consensus.cc:3058] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.151857 12173 tablet_replica.cc:331] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:06.152029 12173 raft_consensus.cc:2241] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.152127 12173 raft_consensus.cc:2270] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.152479 12173 ts_tablet_manager.cc:1905] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.152583 13334 raft_consensus.cc:513] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.150928 11993 leader_election.cc:304] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.152962 13334 leader_election.cc:290] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.153168 13232 raft_consensus.cc:2802] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.153256 13232 raft_consensus.cc:695] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:06.153378 13232 consensus_queue.cc:237] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:06.155011 11990 leader_election.cc:343] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.155040 12173 ts_tablet_manager.cc:1918] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.155107 12173 log.cc:1199] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/725a0db4c6374805903657f755ca1783
I20250625 14:02:06.155310 12173 ts_tablet_manager.cc:1939] T 725a0db4c6374805903657f755ca1783 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:06.155277 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 55ede5e94e12449abbbec9146331deb5 (table default.Table_85edeb4b51284604b988da8b6dbd6a34 [id=0954c7104a6243169519805ca7369806]) successfully deleted
W20250625 14:02:06.155447 11517 catalog_manager.cc:4895] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 because the tablet was not found. No further retry: Not found: Tablet not found: 86d1b58fd1a9483b9ead08a55e3b1e63
I20250625 14:02:06.156250 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 725a0db4c6374805903657f755ca1783 (table default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]) successfully deleted
W20250625 14:02:06.156414 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 70aadb0035014e32bfba240e4d6d0951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70aadb0035014e32bfba240e4d6d0951 already in progress: creating tablet
W20250625 14:02:06.156538 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 already in progress: creating tablet
I20250625 14:02:06.157569 12166 tablet_bootstrap.cc:492] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.157663 12166 ts_tablet_manager.cc:1397] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.111s user 0.002s sys 0.000s
I20250625 14:02:06.158361 12166 raft_consensus.cc:357] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.158471 12166 raft_consensus.cc:383] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.158500 12166 raft_consensus.cc:738] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.158607 12166 consensus_queue.cc:260] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.158901 12166 ts_tablet_manager.cc:1428] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.159735 12167 tablet_bootstrap.cc:492] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.159881 12167 ts_tablet_manager.cc:1397] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.117s user 0.002s sys 0.001s
I20250625 14:02:06.160439 12167 raft_consensus.cc:357] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.160616 12167 raft_consensus.cc:383] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.160687 12167 raft_consensus.cc:738] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.160854 12167 consensus_queue.cc:260] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.161296 12167 ts_tablet_manager.cc:1428] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.161517 12167 tablet_bootstrap.cc:492] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.161664 12166 tablet_bootstrap.cc:492] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.163268 12166 tablet_bootstrap.cc:654] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.164579 12177 tablet_replica.cc:331] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.164743 12177 raft_consensus.cc:2241] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.164973 12177 pending_rounds.cc:70] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:06.165015 12177 pending_rounds.cc:77] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523075585847296 op_type: NO_OP noop_request { }
I20250625 14:02:06.165089 12177 raft_consensus.cc:2887] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:06.165148 12177 raft_consensus.cc:2270] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:06.165685 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 already in progress: creating tablet
I20250625 14:02:06.165786 12177 ts_tablet_manager.cc:1905] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.168272 12177 ts_tablet_manager.cc:1918] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.168354 12177 log.cc:1199] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/ed176205a65d4127b0ae23649187fba0
I20250625 14:02:06.168612 12177 ts_tablet_manager.cc:1939] T ed176205a65d4127b0ae23649187fba0 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:02:06.168816 11717 leader_election.cc:343] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 7bcc674dc5e448c0871e4efe0c9100b8
I20250625 14:02:06.169301 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c744b3d26efa42c0bf7fe30c561c692d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.169417 12044 raft_consensus.cc:3058] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.170429 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a637b1b8c18a4d4a8fff61533730f0bd" } new_table_name: "default.Table_91be44cf034e4c08aabe0284c916d21f" modify_external_catalogs: true
I20250625 14:02:06.171636 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3c4fe503497f42e7aafa2f6d65f8e47f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:06.171805 12044 raft_consensus.cc:2466] T c744b3d26efa42c0bf7fe30c561c692d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
W20250625 14:02:06.172053 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c4fe503497f42e7aafa2f6d65f8e47f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.172825 11528 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_dc817da16df74c95b995c3cbe79ba0cc" } new_table_name: "default.Table_713d4c80dcad4efd9009e16e704d5f4a" modify_external_catalogs: true
I20250625 14:02:06.174190 13908 raft_consensus.cc:491] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.174351 13908 raft_consensus.cc:513] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.174794 13908 leader_election.cc:290] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.175197 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4777298e57934c8ab996cfecc9626fc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.175549 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4777298e57934c8ab996cfecc9626fc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.177742 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_337b4d633c9645dca88b5b53c38f21dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.178185 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_337b4d633c9645dca88b5b53c38f21dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:06.183662 11528 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33c783d3f46d459fa02933dbd63623f1 has no consensus state
I20250625 14:02:06.183934 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_40002fc3ebb64224b030b871c7a3dd5f" } modify_external_catalogs: true
I20250625 14:02:06.184060 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_40002fc3ebb64224b030b871c7a3dd5f" } modify_external_catalogs: true
W20250625 14:02:06.186550 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1b9e127f181474fa1571efd76a99536 consensus state has no leader
I20250625 14:02:06.186866 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_bc5a26df1c7e4b1789e21dd84d5cfa6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.187318 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc5a26df1c7e4b1789e21dd84d5cfa6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.187420 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "7bcc674dc5e448c0871e4efe0c9100b8" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.187490 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "32e39d974af9439c873ba8ec6523c428" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.187793 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c744b3d26efa42c0bf7fe30c561c692d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:06.187996 11990 leader_election.cc:343] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.188287 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 70aadb0035014e32bfba240e4d6d0951 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.188529 13974 tablet.cc:1722] T 674b6cd0ec374505a340cfefb6df63bb P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:06.188596 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 185a1a5f14344caa89473baa57f0b02d from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.188704 13837 raft_consensus.cc:491] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.188793 13837 raft_consensus.cc:513] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.188968 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0590500722434353888627a48c4f2210" } modify_external_catalogs: true
I20250625 14:02:06.189064 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_0590500722434353888627a48c4f2210" } modify_external_catalogs: true
I20250625 14:02:06.189515 13837 leader_election.cc:290] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:06.189989 11858 leader_election.cc:343] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: b215f2dc28604d1387e9847a5247564d
W20250625 14:02:06.190261 11855 leader_election.cc:343] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: b215f2dc28604d1387e9847a5247564d
I20250625 14:02:06.190412 13121 raft_consensus.cc:491] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.190508 13121 raft_consensus.cc:513] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.190871 13121 leader_election.cc:290] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:06.191798 11717 leader_election.cc:343] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.191905 11717 leader_election.cc:304] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:06.192062 13699 raft_consensus.cc:2747] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:06.192679 11717 leader_election.cc:343] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.192953 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "32e39d974af9439c873ba8ec6523c428" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.193502 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 70aadb0035014e32bfba240e4d6d0951 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.194145 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.194538 11717 leader_election.cc:304] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.194684 13699 raft_consensus.cc:2802] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.194778 13699 raft_consensus.cc:695] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
W20250625 14:02:06.194857 11993 leader_election.cc:343] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.194921 11993 leader_election.cc:304] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.194927 13699 consensus_queue.cc:237] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.195055 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fddd9a629d984649ad92c8f4fe52e114" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.195245 13232 raft_consensus.cc:2747] T 32e39d974af9439c873ba8ec6523c428 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:06.195588 11993 leader_election.cc:343] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.195609 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 617782664e1547288a3b361bf8471d12 with delete_type TABLET_DATA_DELETED (replaced by tablet 3da18e1a390c4f198340af55217ef9cb) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.193908 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fddd9a629d984649ad92c8f4fe52e114" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.194384 13835 raft_consensus.cc:491] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.199113 13835 raft_consensus.cc:513] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:06.199187 11990 leader_election.cc:343] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.199262 11990 leader_election.cc:304] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.199512 13835 leader_election.cc:290] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:06.194906 13942 raft_consensus.cc:491] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.199762 13942 raft_consensus.cc:513] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.200073 13942 leader_election.cc:290] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:06.200750 12172 tablet_bootstrap.cc:492] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.200874 12172 ts_tablet_manager.cc:1397] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.000s
I20250625 14:02:06.201203 12166 tablet_bootstrap.cc:492] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.201283 12166 ts_tablet_manager.cc:1397] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250625 14:02:06.201434 11524 catalog_manager.cc:5864] Not sending DeleteTablet requests; no consensus state for tablet 9392c649f198476b9c05ec48cca5222b
I20250625 14:02:06.201413 12172 raft_consensus.cc:357] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.201512 12172 raft_consensus.cc:383] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.201543 12172 raft_consensus.cc:738] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.201658 12172 consensus_queue.cc:260] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.201774 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 86d1b58fd1a9483b9ead08a55e3b1e63 (table default.Table_88e1a1caf12b4d52b97e8f08d34ffae6 [id=1f4a03c6bde742a581596005b19a818f]) successfully deleted
I20250625 14:02:06.201761 12166 raft_consensus.cc:357] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.201840 12166 raft_consensus.cc:383] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.201870 12166 raft_consensus.cc:738] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.201987 12172 ts_tablet_manager.cc:1428] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.201988 12166 consensus_queue.cc:260] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.202014 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet ed176205a65d4127b0ae23649187fba0 (table default.Table_9bcb6255870b4c80b484ff12bcfdca06 [id=6010f3f552cf4773a1beb3d3686fdd31]) successfully deleted
W20250625 14:02:06.202123 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 063a910b914144938ffd7c6bac8c899b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 063a910b914144938ffd7c6bac8c899b already in progress: creating tablet
I20250625 14:02:06.202171 12172 tablet_bootstrap.cc:492] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:06.202208 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 70aadb0035014e32bfba240e4d6d0951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70aadb0035014e32bfba240e4d6d0951 already in progress: creating tablet
I20250625 14:02:06.202262 12166 ts_tablet_manager.cc:1428] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:06.202292 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 already in progress: creating tablet
W20250625 14:02:06.202432 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 617782664e1547288a3b361bf8471d12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 617782664e1547288a3b361bf8471d12 already in progress: creating tablet
I20250625 14:02:06.202481 12166 tablet_bootstrap.cc:492] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.203275 12172 tablet_bootstrap.cc:654] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.203472 12166 tablet_bootstrap.cc:654] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.203776 11855 leader_election.cc:304] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.204102 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 6f26de29aebc46b49d863c02fe8b1776 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:06.204083 11858 leader_election.cc:343] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: f2f25aaee07242329014de1834ca881d
I20250625 14:02:06.204303 13835 raft_consensus.cc:2747] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:06.204675 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 70aadb0035014e32bfba240e4d6d0951 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70aadb0035014e32bfba240e4d6d0951 already in progress: creating tablet
I20250625 14:02:06.200704 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13a2c2f498e24f47a12181a89dcbd769" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.205667 11778 raft_consensus.cc:2391] T 13a2c2f498e24f47a12181a89dcbd769 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:06.207705 13232 raft_consensus.cc:2747] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.208453 12166 tablet_bootstrap.cc:492] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.208616 12166 ts_tablet_manager.cc:1397] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250625 14:02:06.209182 12166 raft_consensus.cc:357] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.209348 12166 raft_consensus.cc:383] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.209437 12166 raft_consensus.cc:738] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.209429 13334 raft_consensus.cc:491] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.209512 13334 raft_consensus.cc:513] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.209620 12166 consensus_queue.cc:260] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.209849 13334 leader_election.cc:290] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.209982 12166 ts_tablet_manager.cc:1428] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.210126 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6f26de29aebc46b49d863c02fe8b1776
I20250625 14:02:06.210347 12166 tablet_bootstrap.cc:492] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.210469 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 6f26de29aebc46b49d863c02fe8b1776 deleted and replaced by tablet c49831cb52414e419481c1b30162e4e2
I20250625 14:02:06.210767 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f26de29aebc46b49d863c02fe8b1776 with delete_type TABLET_DATA_DELETED (replaced by tablet c49831cb52414e419481c1b30162e4e2) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.211622 12166 tablet_bootstrap.cc:654] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.212078 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "13a2c2f498e24f47a12181a89dcbd769" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.211918 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f26de29aebc46b49d863c02fe8b1776 with delete_type TABLET_DATA_DELETED (replaced by tablet c49831cb52414e419481c1b30162e4e2) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.212414 12175 tablet_replica.cc:331] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.212414 12173 tablet_replica.cc:331] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:06.212543 12173 raft_consensus.cc:2241] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.212543 12175 raft_consensus.cc:2241] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.212639 12175 raft_consensus.cc:2270] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.212729 12173 raft_consensus.cc:2270] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.213680 12175 ts_tablet_manager.cc:1905] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.214022 12172 tablet_bootstrap.cc:492] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.214113 12172 ts_tablet_manager.cc:1397] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:06.214582 12172 raft_consensus.cc:357] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.215473 12172 raft_consensus.cc:383] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.215517 12172 raft_consensus.cc:738] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.215621 12172 consensus_queue.cc:260] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.216010 12172 ts_tablet_manager.cc:1428] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:06.215680 11855 leader_election.cc:304] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.216252 12175 ts_tablet_manager.cc:1918] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.216313 12175 log.cc:1199] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/6f26de29aebc46b49d863c02fe8b1776
I20250625 14:02:06.216416 12172 tablet_bootstrap.cc:492] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:06.216426 11855 leader_election.cc:343] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: f2f25aaee07242329014de1834ca881d
I20250625 14:02:06.216567 12175 ts_tablet_manager.cc:1939] T 6f26de29aebc46b49d863c02fe8b1776 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.216492 11855 leader_election.cc:304] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.217428 12172 tablet_bootstrap.cc:654] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.218003 13942 raft_consensus.cc:3058] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.218959 13942 raft_consensus.cc:2747] T 13a2c2f498e24f47a12181a89dcbd769 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.219074 13942 raft_consensus.cc:2747] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.221931 13837 raft_consensus.cc:491] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.222009 13837 raft_consensus.cc:513] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.222393 13837 leader_election.cc:290] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:06.222838 11855 leader_election.cc:343] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: c06757067b3e465f8239b9ff38b68071
I20250625 14:02:06.223317 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 6f26de29aebc46b49d863c02fe8b1776 (table default.Table_21815747326f4c0dbb326f558f1c7618 [id=498afd05db2b4afa913dbd8dcf00b245]) successfully deleted
W20250625 14:02:06.223352 11858 leader_election.cc:343] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: c06757067b3e465f8239b9ff38b68071
I20250625 14:02:06.223409 11858 leader_election.cc:304] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.223584 13837 raft_consensus.cc:2747] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.224356 12166 tablet_bootstrap.cc:492] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.224436 12166 ts_tablet_manager.cc:1397] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:06.224890 12166 raft_consensus.cc:357] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.224977 12166 raft_consensus.cc:383] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.225004 12166 raft_consensus.cc:738] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.225119 12166 consensus_queue.cc:260] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.225376 12166 ts_tablet_manager.cc:1428] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.225548 12166 tablet_bootstrap.cc:492] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.226891 12166 tablet_bootstrap.cc:654] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.229453 12172 tablet_bootstrap.cc:492] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.229542 12172 ts_tablet_manager.cc:1397] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:06.230242 12172 raft_consensus.cc:357] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.230386 12172 raft_consensus.cc:383] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.230420 12172 raft_consensus.cc:738] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.230535 12172 consensus_queue.cc:260] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.230834 12172 ts_tablet_manager.cc:1428] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.231020 12172 tablet_bootstrap.cc:492] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.232056 12172 tablet_bootstrap.cc:654] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.216997 13232 raft_consensus.cc:491] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.240026 13232 raft_consensus.cc:513] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.240422 13232 leader_election.cc:290] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.223078 13908 consensus_queue.cc:1035] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:06.234247 11990 consensus_peers.cc:487] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed -> Peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Couldn't send request to peer bfff52620fea460d850827814b790c35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:06.242388 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55ede5e94e12449abbbec9146331deb5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.242529 11919 raft_consensus.cc:2466] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.242980 12173 ts_tablet_manager.cc:1905] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:06.244230 11717 leader_election.cc:343] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 55ede5e94e12449abbbec9146331deb5
I20250625 14:02:06.244279 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c767ef4cab694e09866524f84a429da7" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.244741 11990 leader_election.cc:343] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.247061 11717 leader_election.cc:304] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.247231 13856 raft_consensus.cc:2802] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.247273 13856 raft_consensus.cc:491] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.247309 13856 raft_consensus.cc:3058] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.248348 13856 raft_consensus.cc:513] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.248696 13856 leader_election.cc:290] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.249289 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "55ede5e94e12449abbbec9146331deb5" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.249414 11915 raft_consensus.cc:3058] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.250463 13121 consensus_queue.cc:1035] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.250525 11915 raft_consensus.cc:2466] T 55ede5e94e12449abbbec9146331deb5 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.250770 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c767ef4cab694e09866524f84a429da7" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.252038 12167 tablet_bootstrap.cc:654] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.252046 13352 raft_consensus.cc:491] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.252158 13352 raft_consensus.cc:513] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.252480 13352 leader_election.cc:290] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.252830 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b345695e57a24b09aff2b8e00bf0fbdf" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.253444 11990 leader_election.cc:343] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.253893 12173 ts_tablet_manager.cc:1918] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.254006 12173 log.cc:1199] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6f26de29aebc46b49d863c02fe8b1776
I20250625 14:02:06.254727 12173 ts_tablet_manager.cc:1939] T 6f26de29aebc46b49d863c02fe8b1776 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:06.254906 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 8ef6745366054d0dbdda7c0ffa2313c4 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.255918 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6f26de29aebc46b49d863c02fe8b1776 (table default.Table_21815747326f4c0dbb326f558f1c7618 [id=498afd05db2b4afa913dbd8dcf00b245]) successfully deleted
I20250625 14:02:06.258656 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 8ef6745366054d0dbdda7c0ffa2313c4
I20250625 14:02:06.258983 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 8ef6745366054d0dbdda7c0ffa2313c4 deleted and replaced by tablet 0898428022824d62a7d97583c747ff72
I20250625 14:02:06.260687 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ef6745366054d0dbdda7c0ffa2313c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0898428022824d62a7d97583c747ff72) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:06.261224 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 8ef6745366054d0dbdda7c0ffa2313c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ef6745366054d0dbdda7c0ffa2313c4 already in progress: creating tablet
I20250625 14:02:06.261837 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ef6745366054d0dbdda7c0ffa2313c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0898428022824d62a7d97583c747ff72) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:06.262763 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 8ef6745366054d0dbdda7c0ffa2313c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ef6745366054d0dbdda7c0ffa2313c4 already in progress: creating tablet
W20250625 14:02:06.266495 11993 leader_election.cc:343] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.266602 11993 leader_election.cc:304] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.266736 13232 raft_consensus.cc:2747] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.267238 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 6f26de29aebc46b49d863c02fe8b1776 with delete_type TABLET_DATA_DELETED (replaced by tablet c49831cb52414e419481c1b30162e4e2) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.267398 13856 raft_consensus.cc:491] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.267683 13856 raft_consensus.cc:513] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.268087 13856 leader_election.cc:290] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.268420 12177 tablet_replica.cc:331] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.268577 12177 raft_consensus.cc:2241] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.268699 12177 raft_consensus.cc:2270] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.269373 12177 ts_tablet_manager.cc:1905] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.271124 12172 tablet_bootstrap.cc:492] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.271202 12172 ts_tablet_manager.cc:1397] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250625 14:02:06.271692 12172 raft_consensus.cc:357] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.271806 12172 raft_consensus.cc:383] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.271838 12172 raft_consensus.cc:738] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.271889 12177 ts_tablet_manager.cc:1918] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.271945 12177 log.cc:1199] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6f26de29aebc46b49d863c02fe8b1776
I20250625 14:02:06.271970 12172 consensus_queue.cc:260] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.272195 12177 ts_tablet_manager.cc:1939] T 6f26de29aebc46b49d863c02fe8b1776 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.272336 12172 ts_tablet_manager.cc:1428] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:06.272847 12172 tablet_bootstrap.cc:492] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.275008 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 8ef6745366054d0dbdda7c0ffa2313c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 0898428022824d62a7d97583c747ff72) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.275344 12172 tablet_bootstrap.cc:654] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.277439 12167 tablet_bootstrap.cc:492] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.277596 12167 ts_tablet_manager.cc:1397] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.116s user 0.002s sys 0.001s
I20250625 14:02:06.278676 12166 tablet_bootstrap.cc:492] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.278769 12166 ts_tablet_manager.cc:1397] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20250625 14:02:06.279273 12166 raft_consensus.cc:357] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.279390 12166 raft_consensus.cc:383] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.279428 12166 raft_consensus.cc:738] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.279564 12166 consensus_queue.cc:260] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.279874 12166 ts_tablet_manager.cc:1428] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.280232 12166 tablet_bootstrap.cc:492] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.281255 12166 tablet_bootstrap.cc:654] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.288753 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b345695e57a24b09aff2b8e00bf0fbdf" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.291981 12167 raft_consensus.cc:357] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.293143 12166 tablet_bootstrap.cc:492] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.293252 12166 ts_tablet_manager.cc:1397] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:06.293756 12166 raft_consensus.cc:357] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.293857 12166 raft_consensus.cc:383] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.293880 13974 tablet.cc:1722] T f325061ce4bb4468886cfe0a0d752596 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:06.294353 11717 leader_election.cc:304] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:06.294504 12167 raft_consensus.cc:383] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.294554 12167 raft_consensus.cc:738] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.294677 12167 consensus_queue.cc:260] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.294015 13915 tablet.cc:1722] T f325061ce4bb4468886cfe0a0d752596 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250625 14:02:06.294997 12167 ts_tablet_manager.cc:1428] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.017s user 0.001s sys 0.000s
I20250625 14:02:06.295181 12167 tablet_bootstrap.cc:492] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.296105 12167 tablet_bootstrap.cc:654] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.293889 12166 raft_consensus.cc:738] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.300110 12166 consensus_queue.cc:260] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.300453 12166 ts_tablet_manager.cc:1428] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250625 14:02:06.300630 12166 tablet_bootstrap.cc:492] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.301921 12166 tablet_bootstrap.cc:654] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.302529 13856 raft_consensus.cc:2802] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.302639 13856 raft_consensus.cc:695] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.302757 13352 raft_consensus.cc:491] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.302814 13856 consensus_queue.cc:237] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.302852 13352 raft_consensus.cc:513] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.303231 13352 leader_election.cc:290] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.303224 13334 raft_consensus.cc:491] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.303300 13334 raft_consensus.cc:513] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.303588 13334 leader_election.cc:290] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.303640 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f49508e87b5416db9f123df898eaada" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.303761 11915 raft_consensus.cc:2466] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.304039 11990 leader_election.cc:304] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:06.304207 13352 raft_consensus.cc:2802] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.304247 13352 raft_consensus.cc:491] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.304283 13352 raft_consensus.cc:3058] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.305325 13352 raft_consensus.cc:513] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.305678 13352 leader_election.cc:290] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:06.305841 11717 leader_election.cc:343] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 55ede5e94e12449abbbec9146331deb5
I20250625 14:02:06.306216 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f49508e87b5416db9f123df898eaada" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.306347 11915 raft_consensus.cc:3058] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.307348 11915 raft_consensus.cc:2466] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
W20250625 14:02:06.307992 11993 leader_election.cc:343] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.308048 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f49508e87b5416db9f123df898eaada" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.308072 11993 leader_election.cc:304] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.308182 11915 raft_consensus.cc:2391] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56419e38d8e34f6985d4d970c1ce76e5 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:06.308163 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f49508e87b5416db9f123df898eaada" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.308291 12044 raft_consensus.cc:2391] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56419e38d8e34f6985d4d970c1ce76e5 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:06.308665 11990 leader_election.cc:304] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:06.308728 13953 raft_consensus.cc:2747] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.308815 13121 consensus_queue.cc:1035] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.308867 13232 raft_consensus.cc:2802] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.309274 13232 raft_consensus.cc:695] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:06.309419 13232 consensus_queue.cc:237] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.310420 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a951fa8b0cab485f9c221367c029fa4a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.310546 12056 raft_consensus.cc:2466] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.311786 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a951fa8b0cab485f9c221367c029fa4a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.312350 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f49508e87b5416db9f123df898eaada" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.312474 11780 raft_consensus.cc:2466] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.312743 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6f26de29aebc46b49d863c02fe8b1776 (table default.Table_21815747326f4c0dbb326f558f1c7618 [id=498afd05db2b4afa913dbd8dcf00b245]) successfully deleted
I20250625 14:02:06.312743 13914 tablet.cc:1722] T f325061ce4bb4468886cfe0a0d752596 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250625 14:02:06.312952 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 8ef6745366054d0dbdda7c0ffa2313c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ef6745366054d0dbdda7c0ffa2313c4 already in progress: creating tablet
I20250625 14:02:06.313134 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "0f49508e87b5416db9f123df898eaada" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.313236 11778 raft_consensus.cc:3058] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.314190 11778 raft_consensus.cc:2466] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:06.315860 12172 tablet_bootstrap.cc:492] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.315899 13837 raft_consensus.cc:491] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.315963 12172 ts_tablet_manager.cc:1397] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.000s
I20250625 14:02:06.315976 13837 raft_consensus.cc:513] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.316380 13837 leader_election.cc:290] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:06.316466 12172 raft_consensus.cc:357] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.316586 12172 raft_consensus.cc:383] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.316624 12172 raft_consensus.cc:738] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.316745 12172 consensus_queue.cc:260] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.317101 12172 ts_tablet_manager.cc:1428] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:06.317260 11858 leader_election.cc:343] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 60ca3a1ea9b944a2a1830cad6cee3cff
I20250625 14:02:06.317308 12172 tablet_bootstrap.cc:492] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:06.317576 11855 leader_election.cc:343] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 60ca3a1ea9b944a2a1830cad6cee3cff
I20250625 14:02:06.317647 11855 leader_election.cc:304] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.317884 13837 raft_consensus.cc:2747] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.318835 12172 tablet_bootstrap.cc:654] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:06.322672 11717 leader_election.cc:343] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.323268 11717 leader_election.cc:304] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:06.323910 13334 raft_consensus.cc:2747] T 0f49508e87b5416db9f123df898eaada P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.324683 11717 leader_election.cc:304] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.324942 13334 raft_consensus.cc:2802] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.324991 13334 raft_consensus.cc:491] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.325028 13334 raft_consensus.cc:3058] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.328886 12167 tablet_bootstrap.cc:492] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.329092 12167 ts_tablet_manager.cc:1397] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20250625 14:02:06.329739 12166 tablet_bootstrap.cc:492] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.329847 12166 ts_tablet_manager.cc:1397] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250625 14:02:06.330480 12166 raft_consensus.cc:357] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.330596 12166 raft_consensus.cc:383] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.330627 12166 raft_consensus.cc:738] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.330757 12166 consensus_queue.cc:260] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.331091 12166 ts_tablet_manager.cc:1428] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.331316 12166 tablet_bootstrap.cc:492] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.331315 12167 raft_consensus.cc:357] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.331421 12167 raft_consensus.cc:383] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.331452 12167 raft_consensus.cc:738] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.331578 12167 consensus_queue.cc:260] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.332002 12167 ts_tablet_manager.cc:1428] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:06.332165 13856 raft_consensus.cc:491] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.332268 13856 raft_consensus.cc:513] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.332465 12166 tablet_bootstrap.cc:654] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.332646 13856 leader_election.cc:290] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.334978 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a753b44395994a4abaaa96fb9b6d594a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.337360 11717 leader_election.cc:343] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: a753b44395994a4abaaa96fb9b6d594a
W20250625 14:02:06.337618 11717 leader_election.cc:343] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.337728 11717 leader_election.cc:304] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:06.338050 13856 raft_consensus.cc:2747] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.339439 13334 raft_consensus.cc:513] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.339787 13334 leader_election.cc:290] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.340058 12167 tablet_bootstrap.cc:492] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.341145 12172 tablet_bootstrap.cc:492] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.341279 12172 ts_tablet_manager.cc:1397] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.003s
I20250625 14:02:06.341800 12172 raft_consensus.cc:357] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.341897 12172 raft_consensus.cc:383] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.341928 12172 raft_consensus.cc:738] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.341953 12167 tablet_bootstrap.cc:654] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.342033 12172 consensus_queue.cc:260] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.342391 12172 ts_tablet_manager.cc:1428] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:06.342610 12172 tablet_bootstrap.cc:492] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.343600 12172 tablet_bootstrap.cc:654] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.344555 12172 tablet_bootstrap.cc:492] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.344630 12172 ts_tablet_manager.cc:1397] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:06.345242 12172 raft_consensus.cc:357] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.345400 12172 raft_consensus.cc:383] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.345479 12172 raft_consensus.cc:738] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.345678 12172 consensus_queue.cc:260] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.346169 12172 ts_tablet_manager.cc:1428] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:06.346542 12172 tablet_bootstrap.cc:492] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.348312 12172 tablet_bootstrap.cc:654] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.350696 13953 raft_consensus.cc:491] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.350793 13953 raft_consensus.cc:513] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.351181 13953 leader_election.cc:290] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.351231 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a951fa8b0cab485f9c221367c029fa4a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.351537 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a951fa8b0cab485f9c221367c029fa4a" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.351626 12056 raft_consensus.cc:3058] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.352635 12056 raft_consensus.cc:2466] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.353637 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4ed7734f171f4692ba7900844100c878" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.355332 11990 leader_election.cc:343] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.355836 12172 tablet_bootstrap.cc:492] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.355957 12172 ts_tablet_manager.cc:1397] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20250625 14:02:06.355710 12167 tablet_bootstrap.cc:492] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.356245 12167 ts_tablet_manager.cc:1397] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20250625 14:02:06.356452 12172 raft_consensus.cc:357] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.356575 12172 raft_consensus.cc:383] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.356603 12172 raft_consensus.cc:738] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.356684 12167 raft_consensus.cc:357] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.356775 12167 raft_consensus.cc:383] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.356810 12167 raft_consensus.cc:738] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.356997 12167 consensus_queue.cc:260] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.357034 12172 consensus_queue.cc:260] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.356473 11717 leader_election.cc:304] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.360016 13856 raft_consensus.cc:2802] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
W20250625 14:02:06.360114 11717 leader_election.cc:343] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.360311 12167 ts_tablet_manager.cc:1428] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250625 14:02:06.360134 13856 raft_consensus.cc:695] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.360474 13856 consensus_queue.cc:237] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.360702 12172 ts_tablet_manager.cc:1428] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250625 14:02:06.360833 13855 raft_consensus.cc:491] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.360896 13855 raft_consensus.cc:513] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.361184 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4ed7734f171f4692ba7900844100c878" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.361300 11783 raft_consensus.cc:2466] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.361202 13855 leader_election.cc:290] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.361594 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4c32692666047fe9a18a75e66365e16" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.360899 12172 tablet_bootstrap.cc:492] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.362031 11993 leader_election.cc:304] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.362412 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c4c32692666047fe9a18a75e66365e16" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.362445 13953 raft_consensus.cc:2802] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.362512 13953 raft_consensus.cc:491] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.362560 13953 raft_consensus.cc:3058] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.363742 13953 raft_consensus.cc:513] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.364106 13953 leader_election.cc:290] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.364742 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4ed7734f171f4692ba7900844100c878" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:06.365221 11990 leader_election.cc:343] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.365332 12167 tablet_bootstrap.cc:492] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.366645 12167 tablet_bootstrap.cc:654] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:06.366859 11717 leader_election.cc:343] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:06.367573 11717 leader_election.cc:343] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.367586 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "4ed7734f171f4692ba7900844100c878" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.367705 11717 leader_election.cc:304] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:06.367798 11783 raft_consensus.cc:3058] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.368854 12166 tablet_bootstrap.cc:492] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.368878 12172 tablet_bootstrap.cc:654] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.368957 12166 ts_tablet_manager.cc:1397] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20250625 14:02:06.369506 11783 raft_consensus.cc:2466] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:06.369504 12166 raft_consensus.cc:357] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.369611 12166 raft_consensus.cc:383] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.369639 12166 raft_consensus.cc:738] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.369719 13855 raft_consensus.cc:2747] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.369800 13855 raft_consensus.cc:491] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.369777 12166 consensus_queue.cc:260] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.369865 13855 raft_consensus.cc:513] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.370069 12166 ts_tablet_manager.cc:1428] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.370219 13855 leader_election.cc:290] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.370326 12166 tablet_bootstrap.cc:492] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.371338 12166 tablet_bootstrap.cc:654] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.372037 12172 tablet_bootstrap.cc:492] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.372124 12172 ts_tablet_manager.cc:1397] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20250625 14:02:06.372591 12172 raft_consensus.cc:357] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.372717 12172 raft_consensus.cc:383] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.372751 12172 raft_consensus.cc:738] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.372874 12172 consensus_queue.cc:260] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.373175 12172 ts_tablet_manager.cc:1428] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.373379 12172 tablet_bootstrap.cc:492] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.376515 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c4645bbf5a5d493793ce383e37bcf7aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.376995 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4645bbf5a5d493793ce383e37bcf7aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.377868 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_aab93ae1bcc240568c20e53d049f3e90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.378216 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aab93ae1bcc240568c20e53d049f3e90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.378975 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_713ac1345be94c6e9bcd65b568a18c56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.379287 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_713ac1345be94c6e9bcd65b568a18c56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.379940 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_51796cf165e2492ebc3cdb05a3e84807" } modify_external_catalogs: true
I20250625 14:02:06.380034 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_51796cf165e2492ebc3cdb05a3e84807" } modify_external_catalogs: true
I20250625 14:02:06.380213 12172 tablet_bootstrap.cc:654] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.381752 12166 tablet_bootstrap.cc:492] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.381860 12166 ts_tablet_manager.cc:1397] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:06.382498 12166 raft_consensus.cc:357] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.382673 12166 raft_consensus.cc:383] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.382743 12166 raft_consensus.cc:738] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.382949 12166 consensus_queue.cc:260] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.383445 12166 ts_tablet_manager.cc:1428] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250625 14:02:06.383723 12166 tablet_bootstrap.cc:492] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.385416 12166 tablet_bootstrap.cc:654] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.391727 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_9916a22393ea44d38bdf1d5d9cca4ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.392218 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9916a22393ea44d38bdf1d5d9cca4ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.392745 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_d5f252305fb045d08824135e0eeb0e98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.393100 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5f252305fb045d08824135e0eeb0e98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.395016 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a3abe4bcfef84e699da5c76f2ea31feb" } new_table_name: "default.Table_0300c9b210c04f289f6de8541ba9614e" modify_external_catalogs: true
I20250625 14:02:06.396088 12166 tablet_bootstrap.cc:492] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.396198 12166 ts_tablet_manager.cc:1397] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:06.397154 12166 raft_consensus.cc:357] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.397357 12166 raft_consensus.cc:383] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.397431 12166 raft_consensus.cc:738] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.397629 12166 consensus_queue.cc:260] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.397965 12166 ts_tablet_manager.cc:1428] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:06.398200 12166 tablet_bootstrap.cc:492] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.399343 12166 tablet_bootstrap.cc:654] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.406982 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ba804838cfbe40f1a000c4769352cad0" } modify_external_catalogs: true
I20250625 14:02:06.407132 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ba804838cfbe40f1a000c4769352cad0" } modify_external_catalogs: true
W20250625 14:02:06.407644 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 93a420268757402b8cd0609b79187e8b consensus state has no leader
I20250625 14:02:06.407931 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8d26d05c61514ef9b0546647f4587999" } new_table_name: "default.Table_37e47144a50949d1ae9f3da28563711b" modify_external_catalogs: true
I20250625 14:02:06.410075 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_de98c1c0806d421cb2c70a122a7a54e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.410712 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de98c1c0806d421cb2c70a122a7a54e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.411252 12166 tablet_bootstrap.cc:492] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.411401 12166 ts_tablet_manager.cc:1397] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:06.411927 12166 raft_consensus.cc:357] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.412113 12166 raft_consensus.cc:383] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.412190 12166 raft_consensus.cc:738] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.412387 12166 consensus_queue.cc:260] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.412793 12166 ts_tablet_manager.cc:1428] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.413005 12166 tablet_bootstrap.cc:492] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.414149 12166 tablet_bootstrap.cc:654] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:06.430981 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d73b0124af54007b4e16a3f653836af consensus state has no leader
I20250625 14:02:06.431300 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_d71a5103ec2b4d9c95e4858f89ef71a2" } new_table_name: "default.Table_1179cb60a5024fa08eea50216a5b97be" modify_external_catalogs: true
I20250625 14:02:06.434091 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet a1e761e5f9a14fb9b92fdb2bf11c2ca6 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.435139 11993 leader_election.cc:304] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.436087 13953 raft_consensus.cc:2802] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.436199 13953 raft_consensus.cc:695] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:06.436349 13953 consensus_queue.cc:237] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.436944 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fddd9a629d984649ad92c8f4fe52e114" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.438608 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fddd9a629d984649ad92c8f4fe52e114" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.438731 12056 raft_consensus.cc:2466] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.440224 11717 leader_election.cc:304] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.440455 13334 raft_consensus.cc:2802] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250625 14:02:06.440510 11717 leader_election.cc:343] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.440517 13334 raft_consensus.cc:491] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.440881 13334 raft_consensus.cc:3058] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.442020 13334 raft_consensus.cc:513] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.442406 13334 leader_election.cc:290] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.446107 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fddd9a629d984649ad92c8f4fe52e114" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.446197 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "fddd9a629d984649ad92c8f4fe52e114" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.446262 12044 raft_consensus.cc:3058] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.450771 11717 leader_election.cc:343] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:06.452216 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc78172651f14843a13e5a7c4d938399 consensus state has no leader
I20250625 14:02:06.453022 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_dd9f76fe70dd4403bc15dcb256596676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.453661 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd9f76fe70dd4403bc15dcb256596676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.456279 12172 tablet_bootstrap.cc:492] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.456390 12172 ts_tablet_manager.cc:1397] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.083s user 0.000s sys 0.002s
I20250625 14:02:06.456961 12172 raft_consensus.cc:357] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.457120 12172 raft_consensus.cc:383] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.457159 12172 raft_consensus.cc:738] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.457312 12172 consensus_queue.cc:260] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.457666 12172 ts_tablet_manager.cc:1428] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:06.457896 12172 tablet_bootstrap.cc:492] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.463442 12044 raft_consensus.cc:2466] T fddd9a629d984649ad92c8f4fe52e114 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.463439 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_b2c9411bee8241a3b0751c8d4e076c4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.463855 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2c9411bee8241a3b0751c8d4e076c4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.465198 12172 tablet_bootstrap.cc:654] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.467507 11717 leader_election.cc:304] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.467700 13334 raft_consensus.cc:2802] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.467788 13334 raft_consensus.cc:695] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.467958 13334 consensus_queue.cc:237] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.469347 12172 tablet_bootstrap.cc:492] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.469485 12172 ts_tablet_manager.cc:1397] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:06.469962 12172 raft_consensus.cc:357] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.470148 12172 raft_consensus.cc:383] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.470214 12172 raft_consensus.cc:738] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.470400 12172 consensus_queue.cc:260] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.471241 12167 tablet_bootstrap.cc:492] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.471342 12167 ts_tablet_manager.cc:1397] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.000s
I20250625 14:02:06.471834 12167 raft_consensus.cc:357] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.471944 12167 raft_consensus.cc:383] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.471975 12167 raft_consensus.cc:738] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.472106 12167 consensus_queue.cc:260] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.472419 12167 ts_tablet_manager.cc:1428] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.472654 12167 tablet_bootstrap.cc:492] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.475845 12172 ts_tablet_manager.cc:1428] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250625 14:02:06.476188 12172 tablet_bootstrap.cc:492] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.478910 12167 tablet_bootstrap.cc:654] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:06.479468 11519 catalog_manager.cc:4726] Async tablet task AlterTable RPC for tablet 1d73b0124af54007b4e16a3f653836af (table default.Table_37e47144a50949d1ae9f3da28563711b [id=db9eb49b2b2d49bb8dc446545f82064b], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1d73b0124af54007b4e16a3f653836af consensus state has no leader
I20250625 14:02:06.480747 13837 raft_consensus.cc:491] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.480870 13837 raft_consensus.cc:513] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.481005 12167 tablet_bootstrap.cc:492] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.481094 12167 ts_tablet_manager.cc:1397] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250625 14:02:06.481323 13837 leader_election.cc:290] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.481535 12167 raft_consensus.cc:357] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.481638 12167 raft_consensus.cc:383] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.481666 12167 raft_consensus.cc:738] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.481791 12167 consensus_queue.cc:260] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.482051 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "ed176205a65d4127b0ae23649187fba0" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.482221 12044 raft_consensus.cc:2391] T ed176205a65d4127b0ae23649187fba0 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:06.482060 12167 ts_tablet_manager.cc:1428] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.483675 12167 tablet_bootstrap.cc:492] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.484539 12167 tablet_bootstrap.cc:654] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:06.485373 11858 leader_election.cc:343] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: ed176205a65d4127b0ae23649187fba0
I20250625 14:02:06.485477 11858 leader_election.cc:304] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.485709 13837 raft_consensus.cc:3058] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.485795 12167 tablet_bootstrap.cc:492] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.485899 12167 ts_tablet_manager.cc:1397] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250625 14:02:06.486496 12167 raft_consensus.cc:357] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.486613 12167 raft_consensus.cc:383] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.486644 12167 raft_consensus.cc:738] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.486781 12167 consensus_queue.cc:260] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.486865 13837 raft_consensus.cc:2747] T ed176205a65d4127b0ae23649187fba0 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.487069 12172 tablet_bootstrap.cc:654] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.487130 12167 ts_tablet_manager.cc:1428] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:06.487330 12167 tablet_bootstrap.cc:492] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.488358 12167 tablet_bootstrap.cc:654] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.489152 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 23e821af1ae3476dbba467e45973cbbe
I20250625 14:02:06.490392 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 2f7a157ebffa48d9b67fba29bb3ccb1e
I20250625 14:02:06.490613 11533 catalog_manager.cc:6652] ReplaceTablet: tablet 2f7a157ebffa48d9b67fba29bb3ccb1e deleted and replaced by tablet af800eaa7c2e4b7dbcba3006a72cb814
I20250625 14:02:06.490638 12167 tablet_bootstrap.cc:492] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.490718 12167 ts_tablet_manager.cc:1397] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:06.490767 12172 tablet_bootstrap.cc:492] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.490852 12172 ts_tablet_manager.cc:1397] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20250625 14:02:06.491197 12167 raft_consensus.cc:357] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.491261 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 30c1a61739e84e4aab5cc553bb3c6575
I20250625 14:02:06.491302 12167 raft_consensus.cc:383] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.491250 12172 raft_consensus.cc:357] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.491334 12167 raft_consensus.cc:738] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.491341 12172 raft_consensus.cc:383] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.491375 12172 raft_consensus.cc:738] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.491484 12172 consensus_queue.cc:260] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.491477 12167 consensus_queue.cc:260] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.491499 11529 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_ba3f2489c8d84b9ab06776e6446dd316" } new_table_name: "default.Table_096fd965cf7a4960810766e5f5fe0f7a" modify_external_catalogs: true
I20250625 14:02:06.491686 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_7219d7aef9984944ba97308394ad0557"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:06.491911 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8b6663de9f0f48ea92b610c69d981c0f" } modify_external_catalogs: true
I20250625 14:02:06.491988 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_8b6663de9f0f48ea92b610c69d981c0f" } modify_external_catalogs: true
I20250625 14:02:06.492110 12167 ts_tablet_manager.cc:1428] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250625 14:02:06.492141 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7219d7aef9984944ba97308394ad0557 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.492283 12167 tablet_bootstrap.cc:492] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.493268 12167 tablet_bootstrap.cc:654] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.493413 11528 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 357d05c539144e9c8bafe6819f8ee39b
I20250625 14:02:06.493786 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4e6e33ce5e544dd7a2ba8ea5cabcf426"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:06.493899 12172 ts_tablet_manager.cc:1428] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:06.494051 12172 tablet_bootstrap.cc:492] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
W20250625 14:02:06.494107 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e6e33ce5e544dd7a2ba8ea5cabcf426 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.494858 12172 tablet_bootstrap.cc:654] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.495061 13334 consensus_queue.cc:1035] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.495489 12166 tablet_bootstrap.cc:492] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.495589 12166 ts_tablet_manager.cc:1397] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.000s
I20250625 14:02:06.496012 11751 tablet_service.cc:1515] Processing DeleteTablet for tablet 23e821af1ae3476dbba467e45973cbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.496176 11749 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e with delete_type TABLET_DATA_DELETED (replaced by tablet af800eaa7c2e4b7dbcba3006a72cb814) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.496093 12166 raft_consensus.cc:357] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.496235 12166 raft_consensus.cc:383] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.496273 12166 raft_consensus.cc:738] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.496399 12166 consensus_queue.cc:260] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.496691 12166 ts_tablet_manager.cc:1428] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.496874 12166 tablet_bootstrap.cc:492] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.497606 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet 23e821af1ae3476dbba467e45973cbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.497732 11889 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e with delete_type TABLET_DATA_DELETED (replaced by tablet af800eaa7c2e4b7dbcba3006a72cb814) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.497972 12166 tablet_bootstrap.cc:654] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.498464 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 30c1a61739e84e4aab5cc553bb3c6575 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.498613 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e with delete_type TABLET_DATA_DELETED (replaced by tablet af800eaa7c2e4b7dbcba3006a72cb814) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.499528 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 357d05c539144e9c8bafe6819f8ee39b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.500113 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 23e821af1ae3476dbba467e45973cbbe with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.500268 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 30c1a61739e84e4aab5cc553bb3c6575 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.500377 12020 tablet_service.cc:1515] Processing DeleteTablet for tablet 357d05c539144e9c8bafe6819f8ee39b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:06.500414 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 23e821af1ae3476dbba467e45973cbbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23e821af1ae3476dbba467e45973cbbe already in progress: creating tablet
W20250625 14:02:06.500581 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f7a157ebffa48d9b67fba29bb3ccb1e already in progress: creating tablet
W20250625 14:02:06.500685 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 30c1a61739e84e4aab5cc553bb3c6575 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c1a61739e84e4aab5cc553bb3c6575 already in progress: creating tablet
W20250625 14:02:06.500761 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f7a157ebffa48d9b67fba29bb3ccb1e already in progress: creating tablet
W20250625 14:02:06.501101 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 23e821af1ae3476dbba467e45973cbbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23e821af1ae3476dbba467e45973cbbe already in progress: creating tablet
I20250625 14:02:06.501398 12026 tablet_service.cc:1468] Processing CreateTablet for tablet c99c1cea626e43009997bf4d8dd9f6db (DEFAULT_TABLE table=default.Table_15312d5be9fb45ecac5d4674baf86acf [id=6b5044b028144aadaf2f476933c59def]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.501683 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99c1cea626e43009997bf4d8dd9f6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.502064 11889 tablet_service.cc:1468] Processing CreateTablet for tablet dcb22b6b0fcf4da1aeab8a3b614b5f34 (DEFAULT_TABLE table=default.Table_8cbd388e907b4ee4befb2cd3542c57a6 [id=7501d2dbee194729a42fd2fba88b3359]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.502341 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb22b6b0fcf4da1aeab8a3b614b5f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.504329 11890 tablet_service.cc:1468] Processing CreateTablet for tablet b6482fdd381349ab8e743c4222e0ac44 (DEFAULT_TABLE table=default.Table_4bbb7716799d4e6ba7c3a2d874b9ffe3 [id=2f262744ab7443d1b477b5df3e0cc23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.504467 11891 tablet_service.cc:1468] Processing CreateTablet for tablet c99c1cea626e43009997bf4d8dd9f6db (DEFAULT_TABLE table=default.Table_15312d5be9fb45ecac5d4674baf86acf [id=6b5044b028144aadaf2f476933c59def]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.504561 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6482fdd381349ab8e743c4222e0ac44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.504670 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99c1cea626e43009997bf4d8dd9f6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.504874 11899 tablet_service.cc:1468] Processing CreateTablet for tablet b41032ff46444966b53467d2c6362589 (DEFAULT_TABLE table=default.Table_43cee7a33f354877b24e72503adce005 [id=6f7bc36ca1f549ebbbe0d2490f11e9ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.505069 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41032ff46444966b53467d2c6362589. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.505054 12019 tablet_service.cc:1468] Processing CreateTablet for tablet b6482fdd381349ab8e743c4222e0ac44 (DEFAULT_TABLE table=default.Table_4bbb7716799d4e6ba7c3a2d874b9ffe3 [id=2f262744ab7443d1b477b5df3e0cc23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.505288 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6482fdd381349ab8e743c4222e0ac44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.496012 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 30c1a61739e84e4aab5cc553bb3c6575 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.496048 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 357d05c539144e9c8bafe6819f8ee39b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.507232 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 48911ef822f84219b3755a803ee12e76 (DEFAULT_TABLE table=default.Table_eec4990a3105440f92c6db1b571e2e97 [id=10638b30e60d486bb0249ac2502f01d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.507545 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48911ef822f84219b3755a803ee12e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.507583 12020 tablet_service.cc:1468] Processing CreateTablet for tablet dcb22b6b0fcf4da1aeab8a3b614b5f34 (DEFAULT_TABLE table=default.Table_8cbd388e907b4ee4befb2cd3542c57a6 [id=7501d2dbee194729a42fd2fba88b3359]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.507808 12020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb22b6b0fcf4da1aeab8a3b614b5f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.501396 12025 tablet_service.cc:1468] Processing CreateTablet for tablet c0f913db227247199ffd154339e61e11 (DEFAULT_TABLE table=default.Table_d61308689da1423780a12d18efa767eb [id=a1d73b7f8e264dad9185c4ff79cddf13]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.509838 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 48911ef822f84219b3755a803ee12e76 (DEFAULT_TABLE table=default.Table_eec4990a3105440f92c6db1b571e2e97 [id=10638b30e60d486bb0249ac2502f01d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.502060 11888 tablet_service.cc:1468] Processing CreateTablet for tablet c0f913db227247199ffd154339e61e11 (DEFAULT_TABLE table=default.Table_d61308689da1423780a12d18efa767eb [id=a1d73b7f8e264dad9185c4ff79cddf13]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.510061 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48911ef822f84219b3755a803ee12e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.510162 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f913db227247199ffd154339e61e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.510712 11892 tablet_service.cc:1468] Processing CreateTablet for tablet d5ab04269d86402d978a7dad4aa0342e (DEFAULT_TABLE table=default.Table_e631bfe8479f4cc2b4db1747fc2332cb [id=2f46e26fd26a4105bd19c2e726c9eb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.510859 12027 tablet_service.cc:1468] Processing CreateTablet for tablet d5ab04269d86402d978a7dad4aa0342e (DEFAULT_TABLE table=default.Table_e631bfe8479f4cc2b4db1747fc2332cb [id=2f46e26fd26a4105bd19c2e726c9eb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.510960 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ab04269d86402d978a7dad4aa0342e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.511087 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ab04269d86402d978a7dad4aa0342e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.512343 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f913db227247199ffd154339e61e11. 1 dirs total, 0 dirs full, 0 dirs failed
W20250625 14:02:06.512719 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 30c1a61739e84e4aab5cc553bb3c6575 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c1a61739e84e4aab5cc553bb3c6575 already in progress: creating tablet
W20250625 14:02:06.512887 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 357d05c539144e9c8bafe6819f8ee39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 357d05c539144e9c8bafe6819f8ee39b already in progress: creating tablet
I20250625 14:02:06.513681 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet cbe2dcd1fb924dcba5c12aaa8e141435 (table default.Table_d0b3e2e69d20402f990444c966a8f3c0 [id=2e114a17eddf47f4b5522bcdad81bd16]). Expected version 2 got 0
I20250625 14:02:06.513871 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet f325061ce4bb4468886cfe0a0d752596 (table default.Table_e3322169c32b4dd8af57a18e67156a86 [id=cd68b5ad9c1849298e961363e2e27608]). Expected version 1 got 0
I20250625 14:02:06.514003 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet fddd9a629d984649ad92c8f4fe52e114 (table default.Table_6ddf39e5d36e4f2dbae8115326df5d33 [id=db2d7f8c45ba4676b4fa1da5714279df]). Expected version 1 got 0
I20250625 14:02:06.514113 11530 catalog_manager.cc:5582] T c188bc758a4c4a71a5550fc11fe59b1a P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:06.514343 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c188bc758a4c4a71a5550fc11fe59b1a (table default.Table_cabcd06410bc4ee282294a6d0f1b2fe7 [id=8030abc171274e888b1dc6dd7b57b98d]). Expected version 1 got 0
I20250625 14:02:06.514374 11892 tablet_service.cc:1468] Processing CreateTablet for tablet e3e8744b2b9c4bb5ac11f4f7cb197b1c (DEFAULT_TABLE table=default.Table_ebe197591ad842be978efbf31a2f578c [id=ae6ae7df06074acd9760ccbd222f97b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.514468 11530 catalog_manager.cc:5582] T 13a2c2f498e24f47a12181a89dcbd769 P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:06.514606 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e8744b2b9c4bb5ac11f4f7cb197b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.514632 11530 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 13a2c2f498e24f47a12181a89dcbd769 (table default.Table_c2fa6c9333664dedaedb249e523d7f55 [id=21a50fe75ad14d07b605f238ce89ca09]). Expected version 1 got 0
I20250625 14:02:06.515050 11888 tablet_service.cc:1468] Processing CreateTablet for tablet 06d26edd8f1a470dbcf235215131b675 (DEFAULT_TABLE table=default.Table_b1f81a550e014cb9a28f9ca4783d277d [id=4304fc8102c046aba4f8572387b41d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.515313 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d26edd8f1a470dbcf235215131b675. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.516672 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 20944adac32641b2b3196da6a0f57cda (DEFAULT_TABLE table=default.Table_a1eacb4021394ce184aa2cfdcee46a7d [id=e4358ce6e208481fba4cea7f6d210dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.517095 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20944adac32641b2b3196da6a0f57cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.517668 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 5dff66705f2f4867a7a3ae505bca8ef4 (DEFAULT_TABLE table=default.Table_7585e6fe176547eba15c659be34c394d [id=ec54471658a14a4b9954f31566bae663]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.519203 11891 tablet_service.cc:1468] Processing CreateTablet for tablet 33c783d3f46d459fa02933dbd63623f1 (DEFAULT_TABLE table=default.Table_713d4c80dcad4efd9009e16e704d5f4a [id=23e8fecb925646c4afc33407866304f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.519541 11891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c783d3f46d459fa02933dbd63623f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.519599 11899 tablet_service.cc:1468] Processing CreateTablet for tablet aeb95dd87954475484a29bc13268bfb4 (DEFAULT_TABLE table=default.Table_a31f4b7186034ee784a34fb1fde58e6f [id=9536f2195514475e9caf1fc34087c787]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.520092 12025 tablet_service.cc:1468] Processing CreateTablet for tablet e3e8744b2b9c4bb5ac11f4f7cb197b1c (DEFAULT_TABLE table=default.Table_ebe197591ad842be978efbf31a2f578c [id=ae6ae7df06074acd9760ccbd222f97b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.520306 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 06d26edd8f1a470dbcf235215131b675 (DEFAULT_TABLE table=default.Table_b1f81a550e014cb9a28f9ca4783d277d [id=4304fc8102c046aba4f8572387b41d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.520438 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e8744b2b9c4bb5ac11f4f7cb197b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.520386 12031 tablet_service.cc:1468] Processing CreateTablet for tablet aeb95dd87954475484a29bc13268bfb4 (DEFAULT_TABLE table=default.Table_a31f4b7186034ee784a34fb1fde58e6f [id=9536f2195514475e9caf1fc34087c787]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.520648 12019 tablet_service.cc:1468] Processing CreateTablet for tablet b41032ff46444966b53467d2c6362589 (DEFAULT_TABLE table=default.Table_43cee7a33f354877b24e72503adce005 [id=6f7bc36ca1f549ebbbe0d2490f11e9ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.520735 12020 tablet_service.cc:1468] Processing CreateTablet for tablet 5dff66705f2f4867a7a3ae505bca8ef4 (DEFAULT_TABLE table=default.Table_7585e6fe176547eba15c659be34c394d [id=ec54471658a14a4b9954f31566bae663]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.520996 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 20944adac32641b2b3196da6a0f57cda (DEFAULT_TABLE table=default.Table_a1eacb4021394ce184aa2cfdcee46a7d [id=e4358ce6e208481fba4cea7f6d210dc5]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:06.521318 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 23e821af1ae3476dbba467e45973cbbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23e821af1ae3476dbba467e45973cbbe already in progress: creating tablet
I20250625 14:02:06.521741 11760 tablet_service.cc:1468] Processing CreateTablet for tablet d5ab04269d86402d978a7dad4aa0342e (DEFAULT_TABLE table=default.Table_e631bfe8479f4cc2b4db1747fc2332cb [id=2f46e26fd26a4105bd19c2e726c9eb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.521991 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ab04269d86402d978a7dad4aa0342e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.522054 11750 tablet_service.cc:1468] Processing CreateTablet for tablet b41032ff46444966b53467d2c6362589 (DEFAULT_TABLE table=default.Table_43cee7a33f354877b24e72503adce005 [id=6f7bc36ca1f549ebbbe0d2490f11e9ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.522382 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41032ff46444966b53467d2c6362589. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.522507 11757 tablet_service.cc:1468] Processing CreateTablet for tablet b6482fdd381349ab8e743c4222e0ac44 (DEFAULT_TABLE table=default.Table_4bbb7716799d4e6ba7c3a2d874b9ffe3 [id=2f262744ab7443d1b477b5df3e0cc23b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.522709 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6482fdd381349ab8e743c4222e0ac44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.523010 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb95dd87954475484a29bc13268bfb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.524888 11764 tablet_service.cc:1468] Processing CreateTablet for tablet c0f913db227247199ffd154339e61e11 (DEFAULT_TABLE table=default.Table_d61308689da1423780a12d18efa767eb [id=a1d73b7f8e264dad9185c4ff79cddf13]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.525086 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f913db227247199ffd154339e61e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.525271 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d26edd8f1a470dbcf235215131b675. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.525437 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 20944adac32641b2b3196da6a0f57cda (DEFAULT_TABLE table=default.Table_a1eacb4021394ce184aa2cfdcee46a7d [id=e4358ce6e208481fba4cea7f6d210dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.525460 11750 tablet_service.cc:1468] Processing CreateTablet for tablet 06d26edd8f1a470dbcf235215131b675 (DEFAULT_TABLE table=default.Table_b1f81a550e014cb9a28f9ca4783d277d [id=4304fc8102c046aba4f8572387b41d41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.525641 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20944adac32641b2b3196da6a0f57cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.525800 11752 tablet_service.cc:1468] Processing CreateTablet for tablet 5dff66705f2f4867a7a3ae505bca8ef4 (DEFAULT_TABLE table=default.Table_7585e6fe176547eba15c659be34c394d [id=ec54471658a14a4b9954f31566bae663]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.526006 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dff66705f2f4867a7a3ae505bca8ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.527559 11749 tablet_service.cc:1468] Processing CreateTablet for tablet dcb22b6b0fcf4da1aeab8a3b614b5f34 (DEFAULT_TABLE table=default.Table_8cbd388e907b4ee4befb2cd3542c57a6 [id=7501d2dbee194729a42fd2fba88b3359]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.527715 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb95dd87954475484a29bc13268bfb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.527769 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb22b6b0fcf4da1aeab8a3b614b5f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.528381 11750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d26edd8f1a470dbcf235215131b675. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.529711 11751 tablet_service.cc:1468] Processing CreateTablet for tablet c99c1cea626e43009997bf4d8dd9f6db (DEFAULT_TABLE table=default.Table_15312d5be9fb45ecac5d4674baf86acf [id=6b5044b028144aadaf2f476933c59def]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.529945 11751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99c1cea626e43009997bf4d8dd9f6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.530043 13837 raft_consensus.cc:491] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.530180 13837 raft_consensus.cc:513] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.530429 11749 tablet_service.cc:1468] Processing CreateTablet for tablet 80c4e73025624d079cafac17c8715c13 (DEFAULT_TABLE table=default.Table_b31fb502c0004e95875019216e579ded [id=38d8778302d44f8b8d1ecdcde9516677]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.530629 11749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c4e73025624d079cafac17c8715c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.530680 13837 leader_election.cc:290] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.530936 11747 tablet_service.cc:1468] Processing CreateTablet for tablet 50a5c99f9637423fafcfac852913abda (DEFAULT_TABLE table=default.Table_45af6d6dda5a431685c4a200f5cdbdab [id=54749ae711604efd9045478150df48bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.531080 11752 tablet_service.cc:1468] Processing CreateTablet for tablet aeb95dd87954475484a29bc13268bfb4 (DEFAULT_TABLE table=default.Table_a31f4b7186034ee784a34fb1fde58e6f [id=9536f2195514475e9caf1fc34087c787]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.531172 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a5c99f9637423fafcfac852913abda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.531258 11752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb95dd87954475484a29bc13268bfb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.532377 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 48911ef822f84219b3755a803ee12e76 (DEFAULT_TABLE table=default.Table_eec4990a3105440f92c6db1b571e2e97 [id=10638b30e60d486bb0249ac2502f01d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.532598 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48911ef822f84219b3755a803ee12e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.533013 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 33c783d3f46d459fa02933dbd63623f1 (DEFAULT_TABLE table=default.Table_713d4c80dcad4efd9009e16e704d5f4a [id=23e8fecb925646c4afc33407866304f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.533208 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c783d3f46d459fa02933dbd63623f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.533947 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 80c4e73025624d079cafac17c8715c13 (DEFAULT_TABLE table=default.Table_b31fb502c0004e95875019216e579ded [id=38d8778302d44f8b8d1ecdcde9516677]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.534220 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c4e73025624d079cafac17c8715c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.534677 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a951fa8b0cab485f9c221367c029fa4a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.534816 12056 raft_consensus.cc:2391] T a951fa8b0cab485f9c221367c029fa4a P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
W20250625 14:02:06.521514 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 2f7a157ebffa48d9b67fba29bb3ccb1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f7a157ebffa48d9b67fba29bb3ccb1e already in progress: creating tablet
I20250625 14:02:06.535022 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a951fa8b0cab485f9c221367c029fa4a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.535159 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41032ff46444966b53467d2c6362589. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.535636 13334 raft_consensus.cc:491] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.535733 13334 raft_consensus.cc:513] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.536100 13334 leader_election.cc:290] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.536340 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b345695e57a24b09aff2b8e00bf0fbdf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.536420 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b345695e57a24b09aff2b8e00bf0fbdf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.536455 12056 raft_consensus.cc:2466] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:02:06.537015 11717 leader_election.cc:343] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.537142 11717 leader_election.cc:304] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
W20250625 14:02:06.538033 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 30c1a61739e84e4aab5cc553bb3c6575 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c1a61739e84e4aab5cc553bb3c6575 already in progress: creating tablet
W20250625 14:02:06.538198 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 357d05c539144e9c8bafe6819f8ee39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 357d05c539144e9c8bafe6819f8ee39b already in progress: creating tablet
I20250625 14:02:06.538595 13334 raft_consensus.cc:2802] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.538661 13334 raft_consensus.cc:491] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.538678 12020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dff66705f2f4867a7a3ae505bca8ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.538704 13334 raft_consensus.cc:3058] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.539167 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20944adac32641b2b3196da6a0f57cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.539747 13334 raft_consensus.cc:513] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.540189 13334 leader_election.cc:290] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.540504 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b345695e57a24b09aff2b8e00bf0fbdf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.540555 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b345695e57a24b09aff2b8e00bf0fbdf" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.540627 12056 raft_consensus.cc:3058] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.541050 11717 leader_election.cc:343] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.541399 11757 tablet_service.cc:1468] Processing CreateTablet for tablet e3e8744b2b9c4bb5ac11f4f7cb197b1c (DEFAULT_TABLE table=default.Table_ebe197591ad842be978efbf31a2f578c [id=ae6ae7df06074acd9760ccbd222f97b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.541608 12056 raft_consensus.cc:2466] T b345695e57a24b09aff2b8e00bf0fbdf P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.541676 11757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3e8744b2b9c4bb5ac11f4f7cb197b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.541894 11764 tablet_service.cc:1468] Processing CreateTablet for tablet 226bc25fc21446bab5f29697dbf076ff (DEFAULT_TABLE table=default.Table_71c4ad7aed244e6f8f7ab292aba8b124 [id=37fe215d2f524716a0239918959fe339]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.542148 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226bc25fc21446bab5f29697dbf076ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.542515 11717 leader_election.cc:304] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.542726 13855 raft_consensus.cc:491] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.542829 13699 raft_consensus.cc:2802] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.542936 13699 raft_consensus.cc:695] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.542807 13855 raft_consensus.cc:513] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.542984 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dff66705f2f4867a7a3ae505bca8ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.543067 13699 consensus_queue.cc:237] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.543298 13855 leader_election.cc:290] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.545569 11855 leader_election.cc:304] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.546052 13835 raft_consensus.cc:3058] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.546200 11888 tablet_service.cc:1468] Processing CreateTablet for tablet 80c4e73025624d079cafac17c8715c13 (DEFAULT_TABLE table=default.Table_b31fb502c0004e95875019216e579ded [id=38d8778302d44f8b8d1ecdcde9516677]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.546494 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c4e73025624d079cafac17c8715c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.547134 13835 raft_consensus.cc:2747] T a951fa8b0cab485f9c221367c029fa4a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.548151 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c767ef4cab694e09866524f84a429da7" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.548486 11922 raft_consensus.cc:3058] T 31f843108ecf440090c05255afa1687e P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.548694 11717 leader_election.cc:343] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.549052 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c767ef4cab694e09866524f84a429da7" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.549202 12056 raft_consensus.cc:2466] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.550643 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 226bc25fc21446bab5f29697dbf076ff (DEFAULT_TABLE table=default.Table_71c4ad7aed244e6f8f7ab292aba8b124 [id=37fe215d2f524716a0239918959fe339]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:06.550714 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 357d05c539144e9c8bafe6819f8ee39b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 357d05c539144e9c8bafe6819f8ee39b already in progress: creating tablet
I20250625 14:02:06.551158 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226bc25fc21446bab5f29697dbf076ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.552592 12025 tablet_service.cc:1468] Processing CreateTablet for tablet 33c783d3f46d459fa02933dbd63623f1 (DEFAULT_TABLE table=default.Table_713d4c80dcad4efd9009e16e704d5f4a [id=23e8fecb925646c4afc33407866304f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.552853 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c783d3f46d459fa02933dbd63623f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.553720 12167 tablet_bootstrap.cc:492] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.553812 12167 ts_tablet_manager.cc:1397] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.000s
I20250625 14:02:06.554293 12167 raft_consensus.cc:357] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.554435 12167 raft_consensus.cc:383] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.554410 13334 raft_consensus.cc:491] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.554466 12167 raft_consensus.cc:738] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.554522 13334 raft_consensus.cc:513] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.554603 12167 consensus_queue.cc:260] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.554886 12167 ts_tablet_manager.cc:1428] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:06.554909 13334 leader_election.cc:290] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.555056 12167 tablet_bootstrap.cc:492] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.555366 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_fc827ac37eab4719988b70aa93b1519e" } new_table_name: "default.Table_e3c6c6c985224cacb57def5227af6556" modify_external_catalogs: true
I20250625 14:02:06.556064 12167 tablet_bootstrap.cc:654] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.558087 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "185a1a5f14344caa89473baa57f0b02d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.558239 12042 raft_consensus.cc:2466] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.558374 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "185a1a5f14344caa89473baa57f0b02d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.558751 11717 leader_election.cc:304] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.558728 13699 consensus_queue.cc:1035] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.559123 11717 leader_election.cc:304] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.559175 13699 raft_consensus.cc:2802] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.559228 13699 raft_consensus.cc:491] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.559264 13699 raft_consensus.cc:3058] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.560094 11717 leader_election.cc:343] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.560369 13699 raft_consensus.cc:513] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:06.560668 11717 consensus_peers.cc:487] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Couldn't send request to peer bfff52620fea460d850827814b790c35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:06.560729 13699 leader_election.cc:290] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.560899 13699 raft_consensus.cc:2802] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.560945 13699 raft_consensus.cc:491] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.560979 13699 raft_consensus.cc:3058] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.562075 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c767ef4cab694e09866524f84a429da7" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.562217 13856 consensus_queue.cc:1035] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.562239 12042 raft_consensus.cc:3058] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.561868 13699 raft_consensus.cc:513] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.562546 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c767ef4cab694e09866524f84a429da7" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.562791 13699 leader_election.cc:290] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.565137 11895 tablet_service.cc:1468] Processing CreateTablet for tablet 50a5c99f9637423fafcfac852913abda (DEFAULT_TABLE table=default.Table_45af6d6dda5a431685c4a200f5cdbdab [id=54749ae711604efd9045478150df48bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.565444 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a5c99f9637423fafcfac852913abda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.567927 12019 tablet_service.cc:1468] Processing CreateTablet for tablet 50a5c99f9637423fafcfac852913abda (DEFAULT_TABLE table=default.Table_45af6d6dda5a431685c4a200f5cdbdab [id=54749ae711604efd9045478150df48bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.568311 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a5c99f9637423fafcfac852913abda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.571197 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "185a1a5f14344caa89473baa57f0b02d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.571331 12047 raft_consensus.cc:3058] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.571925 11717 leader_election.cc:343] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.574741 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "185a1a5f14344caa89473baa57f0b02d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:06.575152 11717 leader_election.cc:343] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.576480 13837 raft_consensus.cc:491] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.576581 13837 raft_consensus.cc:513] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.576956 13837 leader_election.cc:290] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.577284 13837 raft_consensus.cc:491] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.577332 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b55487136b024aa788e31debeb1b2eca" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.577369 13837 raft_consensus.cc:513] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.577469 11783 raft_consensus.cc:2466] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:06.577678 13837 leader_election.cc:290] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.577786 11858 leader_election.cc:304] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:06.577883 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "725a0db4c6374805903657f755ca1783" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.577936 13837 raft_consensus.cc:2802] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.577979 13837 raft_consensus.cc:491] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.578015 13837 raft_consensus.cc:3058] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.579285 13837 raft_consensus.cc:513] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:06.579384 11855 leader_election.cc:343] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 725a0db4c6374805903657f755ca1783
I20250625 14:02:06.579461 11855 leader_election.cc:304] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.579586 13835 raft_consensus.cc:2747] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250625 14:02:06.579663 11855 leader_election.cc:343] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: b55487136b024aa788e31debeb1b2eca
I20250625 14:02:06.580866 13334 raft_consensus.cc:491] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.580983 13334 raft_consensus.cc:513] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.581357 13334 leader_election.cc:290] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.583614 12056 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a3b7cbb8e624e9da3b12a63a710710d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.583755 12056 raft_consensus.cc:2466] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.583930 12042 raft_consensus.cc:2466] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.584087 11717 leader_election.cc:304] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.584394 11717 leader_election.cc:304] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.584437 13334 raft_consensus.cc:2802] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.584523 13855 raft_consensus.cc:2802] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.584614 13855 raft_consensus.cc:695] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.584753 13855 consensus_queue.cc:237] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.585530 13334 raft_consensus.cc:491] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.585620 13334 raft_consensus.cc:3058] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.586704 13334 raft_consensus.cc:513] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.587097 13334 leader_election.cc:290] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.592476 11526 master_service.cc:948] ReplaceTablet: received request to replace tablet 12aeec6dd27b4807864685ebdf9bfdf5 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.593909 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet 9613ce45d22240bb971fcced3e58a60b from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.596998 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet d687605912a544fc945eb45e30ce0f1d
I20250625 14:02:06.597496 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_3be037de15bb44f6a79428be9bc9064b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.597908 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3be037de15bb44f6a79428be9bc9064b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.597954 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet d687605912a544fc945eb45e30ce0f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.598738 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet f325061ce4bb4468886cfe0a0d752596 (table default.Table_e3322169c32b4dd8af57a18e67156a86 [id=cd68b5ad9c1849298e961363e2e27608]). Expected version 1 got 0
W20250625 14:02:06.598814 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet d687605912a544fc945eb45e30ce0f1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d687605912a544fc945eb45e30ce0f1d already in progress: creating tablet
I20250625 14:02:06.598903 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c744b3d26efa42c0bf7fe30c561c692d (table default.Table_d2b2e6f3136e451cbb109d8f43d96682 [id=5d7d7235935340089195e54e50d9bc32]). Expected version 1 got 0
I20250625 14:02:06.599231 13953 raft_consensus.cc:491] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.599327 13953 raft_consensus.cc:513] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.599736 13953 leader_election.cc:290] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.599956 11527 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_400fd728d70f41feace7aff4f4d49c4b [id=e7ebeba1d0f34f71a4ef5a47014496fb] alter complete (version 3)
I20250625 14:02:06.600471 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d8227e0205bb4b9fa9b8047558cf9a1c" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:02:06.600838 11993 leader_election.cc:343] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.602088 11533 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 59556a6da95144f88aa806a7febd6a58
I20250625 14:02:06.602602 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_ba2ba3d828314f528dea4e84139b3d29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.602988 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba2ba3d828314f528dea4e84139b3d29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.603195 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 59556a6da95144f88aa806a7febd6a58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
W20250625 14:02:06.603675 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 59556a6da95144f88aa806a7febd6a58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59556a6da95144f88aa806a7febd6a58 already in progress: creating tablet
I20250625 14:02:06.603854 12167 tablet_bootstrap.cc:492] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.603967 12167 ts_tablet_manager.cc:1397] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.002s
I20250625 14:02:06.603996 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_187b2ece2dd04826878b900cf78f1548"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.604346 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_187b2ece2dd04826878b900cf78f1548 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.604512 12167 raft_consensus.cc:357] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.604609 12167 raft_consensus.cc:383] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.604645 12167 raft_consensus.cc:738] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.604780 12167 consensus_queue.cc:260] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.605089 12167 ts_tablet_manager.cc:1428] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20250625 14:02:06.605212 11529 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4dabfb8d01ef4177878d8748b536b1cc consensus state has no leader
I20250625 14:02:06.605310 12167 tablet_bootstrap.cc:492] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.606998 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a3b7cbb8e624e9da3b12a63a710710d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.607028 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "b55487136b024aa788e31debeb1b2eca" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.607112 12042 raft_consensus.cc:3058] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.607156 11783 raft_consensus.cc:3058] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.608079 12167 tablet_bootstrap.cc:654] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.608192 11783 raft_consensus.cc:2466] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:06.608217 12042 raft_consensus.cc:2466] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.608582 11717 leader_election.cc:304] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.608989 13855 raft_consensus.cc:2802] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.609073 13855 raft_consensus.cc:695] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.609205 13855 consensus_queue.cc:237] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.613893 12167 tablet_bootstrap.cc:492] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.613996 12167 ts_tablet_manager.cc:1397] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250625 14:02:06.614229 12172 tablet_bootstrap.cc:492] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.614356 12172 ts_tablet_manager.cc:1397] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.120s user 0.002s sys 0.000s
I20250625 14:02:06.614503 11529 master_service.cc:948] ReplaceTablet: received request to replace tablet be019f453cab42fa88936c587ca623fa from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.614583 12167 raft_consensus.cc:357] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.614689 12167 raft_consensus.cc:383] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.614717 12167 raft_consensus.cc:738] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.614825 12167 consensus_queue.cc:260] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.614851 12172 raft_consensus.cc:357] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.614984 12172 raft_consensus.cc:383] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.615017 12172 raft_consensus.cc:738] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.615126 12167 ts_tablet_manager.cc:1428] T ee86afd7088e48ab86a2f82fbd799905 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:06.615139 12172 consensus_queue.cc:260] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.615433 12172 ts_tablet_manager.cc:1428] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.615662 12172 tablet_bootstrap.cc:492] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.616729 12172 tablet_bootstrap.cc:654] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.617442 12167 tablet_bootstrap.cc:492] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.619513 12167 tablet_bootstrap.cc:654] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.620523 13334 consensus_queue.cc:1035] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.579914 13837 leader_election.cc:290] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:06.580498 11855 leader_election.cc:343] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: b55487136b024aa788e31debeb1b2eca
I20250625 14:02:06.582957 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a3b7cbb8e624e9da3b12a63a710710d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.584374 11888 tablet_service.cc:1468] Processing CreateTablet for tablet 226bc25fc21446bab5f29697dbf076ff (DEFAULT_TABLE table=default.Table_71c4ad7aed244e6f8f7ab292aba8b124 [id=37fe215d2f524716a0239918959fe339]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.621345 11888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226bc25fc21446bab5f29697dbf076ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.621325 11858 leader_election.cc:304] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:02:06.621500 11717 leader_election.cc:343] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.621577 13837 raft_consensus.cc:2802] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.621670 13953 raft_consensus.cc:491] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.621737 13837 raft_consensus.cc:695] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:06.621742 13953 raft_consensus.cc:513] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.621865 13837 consensus_queue.cc:237] T b55487136b024aa788e31debeb1b2eca P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.622067 13953 leader_election.cc:290] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.599387 13835 raft_consensus.cc:491] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.622433 13835 raft_consensus.cc:513] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.622457 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "16b68e0df99d4a1b8744b52d175b2eb2" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.622746 13835 leader_election.cc:290] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:06.622749 11990 leader_election.cc:343] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.600153 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d8227e0205bb4b9fa9b8047558cf9a1c" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.624465 11990 leader_election.cc:343] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.624531 11990 leader_election.cc:304] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.624963 13953 raft_consensus.cc:2747] T d8227e0205bb4b9fa9b8047558cf9a1c P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.624995 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "16b68e0df99d4a1b8744b52d175b2eb2" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
W20250625 14:02:06.625455 11993 leader_election.cc:343] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:06.625476 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5259c893bb740ad83ff2051db1f2f33 consensus state has no leader
I20250625 14:02:06.625519 11993 leader_election.cc:304] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.625682 13953 raft_consensus.cc:2747] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.626451 11919 raft_consensus.cc:3058] T 725a0db4c6374805903657f755ca1783 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.627944 13334 consensus_queue.cc:1035] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.630887 12047 raft_consensus.cc:2466] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.631171 11915 raft_consensus.cc:3058] T c744b3d26efa42c0bf7fe30c561c692d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.631491 12167 tablet_bootstrap.cc:492] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.631573 12167 ts_tablet_manager.cc:1397] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250625 14:02:06.632091 12167 raft_consensus.cc:357] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.632203 12167 raft_consensus.cc:383] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.632236 12167 raft_consensus.cc:738] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.632339 12167 consensus_queue.cc:260] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.632679 12167 ts_tablet_manager.cc:1428] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.632875 12167 tablet_bootstrap.cc:492] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.632862 11526 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 12aeec6dd27b4807864685ebdf9bfdf5
I20250625 14:02:06.632946 11717 leader_election.cc:304] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.633201 11526 catalog_manager.cc:6652] ReplaceTablet: tablet 12aeec6dd27b4807864685ebdf9bfdf5 deleted and replaced by tablet 8f8463b880fb4fe79a488903a8badbb2
I20250625 14:02:06.633184 13855 consensus_queue.cc:1035] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.633414 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_39f38f3fc23e425f87d7ae5fdbf08233" } new_table_name: "default.Table_8c717c9b828a4883b08a32a81a765716" modify_external_catalogs: true
I20250625 14:02:06.633467 13855 raft_consensus.cc:2802] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.633553 13855 raft_consensus.cc:695] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.633684 13855 consensus_queue.cc:237] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.634030 12167 tablet_bootstrap.cc:654] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.635190 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c188bc758a4c4a71a5550fc11fe59b1a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.638805 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 12aeec6dd27b4807864685ebdf9bfdf5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f8463b880fb4fe79a488903a8badbb2) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.641134 11528 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_58954f2d1ae54b48910db7f5e335964c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:06.641520 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 9613ce45d22240bb971fcced3e58a60b
W20250625 14:02:06.641544 11528 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58954f2d1ae54b48910db7f5e335964c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.641773 11525 catalog_manager.cc:6652] ReplaceTablet: tablet 9613ce45d22240bb971fcced3e58a60b deleted and replaced by tablet 59d9741cf6bc4ad68747899328867cf8
I20250625 14:02:06.641918 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_54489a71bb6449009b3df0019e3369a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:06.641944 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_e1cebf342db24cbfb93cba3cfb73036c" } new_table_name: "default.Table_59af254371b74c7aac74b9f0e74b989b" modify_external_catalogs: true
W20250625 14:02:06.642257 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54489a71bb6449009b3df0019e3369a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.642819 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet be019f453cab42fa88936c587ca623fa
I20250625 14:02:06.643083 11529 catalog_manager.cc:6652] ReplaceTablet: tablet be019f453cab42fa88936c587ca623fa deleted and replaced by tablet f24a686d1d8b4213803d0572c00359e1
I20250625 14:02:06.643280 11529 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_cea400eaa5f94d80957900c31aed5e12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.643581 11529 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cea400eaa5f94d80957900c31aed5e12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:06.643720 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 12aeec6dd27b4807864685ebdf9bfdf5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12aeec6dd27b4807864685ebdf9bfdf5 already in progress: creating tablet
I20250625 14:02:06.615371 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a3b7cbb8e624e9da3b12a63a710710d" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.645449 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c188bc758a4c4a71a5550fc11fe59b1a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.645720 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 9613ce45d22240bb971fcced3e58a60b with delete_type TABLET_DATA_DELETED (replaced by tablet 59d9741cf6bc4ad68747899328867cf8) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.645783 13835 raft_consensus.cc:491] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.645866 13835 raft_consensus.cc:513] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.646240 13835 leader_election.cc:290] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:06.646641 11717 leader_election.cc:343] T 5a3b7cbb8e624e9da3b12a63a710710d P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.646751 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a753b44395994a4abaaa96fb9b6d594a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.646862 11783 raft_consensus.cc:2466] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:06.646947 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet be019f453cab42fa88936c587ca623fa with delete_type TABLET_DATA_DELETED (replaced by tablet f24a686d1d8b4213803d0572c00359e1) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.647142 11858 leader_election.cc:304] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:06.647305 13835 raft_consensus.cc:2802] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.647356 13835 raft_consensus.cc:491] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.647334 11530 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_7af9a985084d4c85b876e1ffb004ce4a [id=205b876e2e7a4f54bbddec9150d67e0a] alter complete (version 3)
I20250625 14:02:06.647394 13835 raft_consensus.cc:3058] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.647501 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 9613ce45d22240bb971fcced3e58a60b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9613ce45d22240bb971fcced3e58a60b already in progress: creating tablet
W20250625 14:02:06.647644 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet be019f453cab42fa88936c587ca623fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be019f453cab42fa88936c587ca623fa already in progress: creating tablet
I20250625 14:02:06.647792 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_502d9267273a438e86580748f49e7847 [id=d02b8ccb415e4358832eb8334c21a8b9] alter complete (version 2)
I20250625 14:02:06.648061 11855 leader_election.cc:304] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.648514 13837 raft_consensus.cc:2747] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.648567 13835 raft_consensus.cc:513] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.648890 13835 leader_election.cc:290] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.649296 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "a753b44395994a4abaaa96fb9b6d594a" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.649416 11783 raft_consensus.cc:3058] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.650518 11783 raft_consensus.cc:2466] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
W20250625 14:02:06.650553 11855 leader_election.cc:343] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: a753b44395994a4abaaa96fb9b6d594a
W20250625 14:02:06.650925 11855 leader_election.cc:343] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: a753b44395994a4abaaa96fb9b6d594a
I20250625 14:02:06.651276 11858 leader_election.cc:304] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters: 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:02:06.651885 11990 consensus_peers.cc:487] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed -> Peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Couldn't send request to peer bfff52620fea460d850827814b790c35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:06.652096 13835 raft_consensus.cc:2802] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.652199 13835 raft_consensus.cc:695] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:06.652369 13835 consensus_queue.cc:237] T a753b44395994a4abaaa96fb9b6d594a P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.653445 11533 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_74d4c613af8640fdbbc68a8c323375a8" } new_table_name: "default.Table_408b4d666eeb4c258735414b0b0da8be" modify_external_catalogs: true
I20250625 14:02:06.657406 12166 tablet_bootstrap.cc:492] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.657514 12166 ts_tablet_manager.cc:1397] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.161s user 0.001s sys 0.002s
I20250625 14:02:06.658073 12166 raft_consensus.cc:357] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.658187 12166 raft_consensus.cc:383] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.658226 12166 raft_consensus.cc:738] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.658367 12166 consensus_queue.cc:260] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.658679 12166 ts_tablet_manager.cc:1428] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:06.658885 12166 tablet_bootstrap.cc:492] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.659093 13908 raft_consensus.cc:491] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.659194 13908 raft_consensus.cc:513] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.659600 13908 leader_election.cc:290] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.660164 12166 tablet_bootstrap.cc:654] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.661540 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b7f27723e424ae9900b11ef0781533b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.661562 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b7f27723e424ae9900b11ef0781533b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.661680 11783 raft_consensus.cc:2466] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
W20250625 14:02:06.662197 11990 leader_election.cc:343] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.662727 11993 leader_election.cc:304] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.663096 13908 raft_consensus.cc:2802] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.663190 13908 raft_consensus.cc:491] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.663231 13908 raft_consensus.cc:3058] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.664340 13908 raft_consensus.cc:513] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.664688 13908 leader_election.cc:290] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.666679 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b7f27723e424ae9900b11ef0781533b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.666824 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "8b7f27723e424ae9900b11ef0781533b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.666968 11783 raft_consensus.cc:3058] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.667620 11990 leader_election.cc:343] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.668133 11783 raft_consensus.cc:2466] T 8b7f27723e424ae9900b11ef0781533b P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:06.669373 11750 tablet_service.cc:1515] Processing DeleteTablet for tablet a70afbc1a02a457c9099532e16eaac48 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.669445 11764 tablet_service.cc:1515] Processing DeleteTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d600a46fc1c4a6194368f3cd8681364) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.669477 11752 tablet_service.cc:1515] Processing DeleteTablet for tablet 31f843108ecf440090c05255afa1687e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.669407 11747 tablet_service.cc:1515] Processing DeleteTablet for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.669569 11760 tablet_service.cc:1515] Processing DeleteTablet for tablet 725a0db4c6374805903657f755ca1783 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.669641 12177 tablet_replica.cc:331] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.669687 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet ed176205a65d4127b0ae23649187fba0 with delete_type TABLET_DATA_DELETED (replaced by tablet f7808bed1b8f4103bf728b8a525dad5d) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.669785 12177 raft_consensus.cc:2241] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.669875 12177 raft_consensus.cc:2270] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.669385 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 55ede5e94e12449abbbec9146331deb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73f64982ad194dfe9dcbf6b77e047db2) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.670267 12177 ts_tablet_manager.cc:1905] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.670367 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 60414f22c3bd4938b11c678197e0b34c) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.672607 12177 ts_tablet_manager.cc:1918] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.672675 12177 log.cc:1199] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a70afbc1a02a457c9099532e16eaac48
I20250625 14:02:06.672879 12177 ts_tablet_manager.cc:1939] T a70afbc1a02a457c9099532e16eaac48 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.673300 11993 leader_election.cc:304] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.675367 12172 tablet_bootstrap.cc:492] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
W20250625 14:02:06.675413 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cfadca64663b4219a52d6a0c1c2d1065 consensus state has no leader
I20250625 14:02:06.675453 12172 ts_tablet_manager.cc:1397] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.000s
I20250625 14:02:06.675940 12172 raft_consensus.cc:357] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.676054 12172 raft_consensus.cc:383] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.676088 12172 raft_consensus.cc:738] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.676065 13953 raft_consensus.cc:2802] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.676165 13953 raft_consensus.cc:695] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:06.676208 12172 consensus_queue.cc:260] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.676291 13953 consensus_queue.cc:237] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.676498 12172 ts_tablet_manager.cc:1428] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.676702 12172 tablet_bootstrap.cc:492] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.677703 12172 tablet_bootstrap.cc:654] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.678787 12177 tablet_replica.cc:331] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.678802 11922 raft_consensus.cc:3058] T c188bc758a4c4a71a5550fc11fe59b1a P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.678938 12177 raft_consensus.cc:2241] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.679145 12177 raft_consensus.cc:2270] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250625 14:02:06.679904 11533 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 776bee36380d4881b63b86621017bdfe consensus state has no leader
I20250625 14:02:06.681516 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a70afbc1a02a457c9099532e16eaac48 (table default.Table_ca18a9657ad246d1a95d953e4b2389c9 [id=60a0cf9a9dca461c99ae321b9c2528b9]) successfully deleted
I20250625 14:02:06.682255 12177 ts_tablet_manager.cc:1905] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.683612 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet d687605912a544fc945eb45e30ce0f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.684072 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet 59556a6da95144f88aa806a7febd6a58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:06.684115 11717 consensus_peers.cc:487] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 725a0db4c6374805903657f755ca1783. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:06.684298 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 59556a6da95144f88aa806a7febd6a58 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.685338 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet 12aeec6dd27b4807864685ebdf9bfdf5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f8463b880fb4fe79a488903a8badbb2) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.685546 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 12aeec6dd27b4807864685ebdf9bfdf5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f8463b880fb4fe79a488903a8badbb2) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.685914 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet 9613ce45d22240bb971fcced3e58a60b with delete_type TABLET_DATA_DELETED (replaced by tablet 59d9741cf6bc4ad68747899328867cf8) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.686142 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet be019f453cab42fa88936c587ca623fa with delete_type TABLET_DATA_DELETED (replaced by tablet f24a686d1d8b4213803d0572c00359e1) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.686395 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 9613ce45d22240bb971fcced3e58a60b with delete_type TABLET_DATA_DELETED (replaced by tablet 59d9741cf6bc4ad68747899328867cf8) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:06.687901 11993 consensus_peers.cc:487] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed -> Peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Couldn't send request to peer 56419e38d8e34f6985d4d970c1ce76e5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a70afbc1a02a457c9099532e16eaac48. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:06.688632 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet d687605912a544fc945eb45e30ce0f1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.689538 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 60414f22c3bd4938b11c678197e0b34c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.689694 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 185a1a5f14344caa89473baa57f0b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.690821 12173 tablet_replica.cc:331] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:06.690973 12173 raft_consensus.cc:2241] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.691076 12173 pending_rounds.cc:70] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:06.691097 12173 pending_rounds.cc:77] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523075945619456 op_type: NO_OP noop_request { }
I20250625 14:02:06.691156 12173 raft_consensus.cc:2887] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:06.691206 12173 raft_consensus.cc:2270] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.692451 12025 tablet_service.cc:1515] Processing DeleteTablet for tablet a70afbc1a02a457c9099532e16eaac48 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.692575 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet 31f843108ecf440090c05255afa1687e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.692602 13334 raft_consensus.cc:491] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.692682 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ed7734f171f4692ba7900844100c878 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.692687 13334 raft_consensus.cc:513] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.692771 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet ed176205a65d4127b0ae23649187fba0 with delete_type TABLET_DATA_DELETED (replaced by tablet f7808bed1b8f4103bf728b8a525dad5d) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.693073 13334 leader_election.cc:290] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.693446 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet b215f2dc28604d1387e9847a5247564d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.693524 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet f2f25aaee07242329014de1834ca881d with delete_type TABLET_DATA_DELETED (replaced by tablet 08b3ba59f0374c6199cd470d136c59ee) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.693583 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 714bb5a28ec648f990fa1525a1b50129 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:05 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.693658 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 292e9c27637d410ea487761f50bdee88 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.693786 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbe2dcd1fb924dcba5c12aaa8e141435" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.693897 12042 raft_consensus.cc:2466] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.694190 11717 leader_election.cc:304] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.694558 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbe2dcd1fb924dcba5c12aaa8e141435" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.694591 13334 raft_consensus.cc:2802] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.694649 13334 raft_consensus.cc:491] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250625 14:02:06.694648 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 59556a6da95144f88aa806a7febd6a58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59556a6da95144f88aa806a7febd6a58 already in progress: creating tablet
I20250625 14:02:06.694691 13334 raft_consensus.cc:3058] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.694676 11920 raft_consensus.cc:2466] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
W20250625 14:02:06.694782 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 12aeec6dd27b4807864685ebdf9bfdf5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12aeec6dd27b4807864685ebdf9bfdf5 already in progress: creating tablet
W20250625 14:02:06.694882 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet 9613ce45d22240bb971fcced3e58a60b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9613ce45d22240bb971fcced3e58a60b already in progress: creating tablet
I20250625 14:02:06.695137 12177 ts_tablet_manager.cc:1918] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20250625 14:02:06.695145 11517 catalog_manager.cc:4908] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): delete failed for tablet d687605912a544fc945eb45e30ce0f1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d687605912a544fc945eb45e30ce0f1d already in progress: creating tablet
I20250625 14:02:06.695225 12177 log.cc:1199] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/31f843108ecf440090c05255afa1687e
W20250625 14:02:06.695446 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet d687605912a544fc945eb45e30ce0f1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d687605912a544fc945eb45e30ce0f1d already in progress: creating tablet
I20250625 14:02:06.695500 12177 ts_tablet_manager.cc:1939] T 31f843108ecf440090c05255afa1687e P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.695824 13334 raft_consensus.cc:513] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.696019 12177 tablet_replica.cc:331] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.696026 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 31f843108ecf440090c05255afa1687e (table default.Table_973b50c79f674df1b6cf16c53eb85f04 [id=a010df1fd2e248ab8e9c6a3efea3d40d]) successfully deleted
I20250625 14:02:06.696167 13334 leader_election.cc:290] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.696440 12175 tablet_replica.cc:331] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.696527 12042 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbe2dcd1fb924dcba5c12aaa8e141435" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.696575 12175 raft_consensus.cc:2241] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.696635 12042 raft_consensus.cc:3058] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.696705 12175 raft_consensus.cc:2270] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.697150 12175 ts_tablet_manager.cc:1905] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.697623 12042 raft_consensus.cc:2466] T cbe2dcd1fb924dcba5c12aaa8e141435 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.698050 11717 leader_election.cc:304] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters:
I20250625 14:02:06.698400 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet be019f453cab42fa88936c587ca623fa with delete_type TABLET_DATA_DELETED (replaced by tablet f24a686d1d8b4213803d0572c00359e1) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:06.698536 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 86d1b58fd1a9483b9ead08a55e3b1e63 because the tablet was not found. No further retry: Not found: Tablet not found: 86d1b58fd1a9483b9ead08a55e3b1e63
I20250625 14:02:06.698750 11525 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4949c14896924b1db93ba6df52fddae1" } modify_external_catalogs: true
I20250625 14:02:06.698854 11525 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4949c14896924b1db93ba6df52fddae1" } modify_external_catalogs: true
I20250625 14:02:06.699183 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_946189ff0eea4624816248c3b21c198a" } modify_external_catalogs: true
I20250625 14:02:06.699266 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_946189ff0eea4624816248c3b21c198a" } modify_external_catalogs: true
I20250625 14:02:06.699643 12175 ts_tablet_manager.cc:1918] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.699710 12175 log.cc:1199] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/b215f2dc28604d1387e9847a5247564d
I20250625 14:02:06.699939 12175 ts_tablet_manager.cc:1939] T b215f2dc28604d1387e9847a5247564d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.702559 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cbe2dcd1fb924dcba5c12aaa8e141435" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.702695 11920 raft_consensus.cc:3058] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.702885 14057 consensus_queue.cc:1162] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87a003e25dbf461ebec24a29ad7016ed" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:02:06.703737 11920 raft_consensus.cc:2466] T cbe2dcd1fb924dcba5c12aaa8e141435 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 1.
I20250625 14:02:06.704422 13855 raft_consensus.cc:2802] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.704531 13855 raft_consensus.cc:695] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Becoming Leader. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Running, Role: LEADER
I20250625 14:02:06.704676 13855 consensus_queue.cc:237] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.705585 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4e68cf1c61974d0aa5f1c4bfab1c9fcf" } modify_external_catalogs: true
I20250625 14:02:06.705706 11529 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4e68cf1c61974d0aa5f1c4bfab1c9fcf" } modify_external_catalogs: true
I20250625 14:02:06.705819 12175 tablet_replica.cc:331] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.705977 12175 raft_consensus.cc:2241] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.706089 12175 raft_consensus.cc:2270] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.706517 12175 ts_tablet_manager.cc:1905] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.709084 12175 ts_tablet_manager.cc:1918] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.709110 12173 ts_tablet_manager.cc:1905] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.709159 12175 log.cc:1199] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/f2f25aaee07242329014de1834ca881d
I20250625 14:02:06.709373 12175 ts_tablet_manager.cc:1939] T f2f25aaee07242329014de1834ca881d P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.710379 12175 tablet_replica.cc:331] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.710536 12175 raft_consensus.cc:2241] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.710635 12175 raft_consensus.cc:2270] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.711052 12175 ts_tablet_manager.cc:1905] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.711596 12173 ts_tablet_manager.cc:1918] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.711668 12173 log.cc:1199] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/6980c62d63b34c67ad095ad9ea18a3f1
I20250625 14:02:06.711927 12173 ts_tablet_manager.cc:1939] T 6980c62d63b34c67ad095ad9ea18a3f1 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:06.712584 12173 tablet_replica.cc:331] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:06.696167 12177 raft_consensus.cc:2241] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.712709 12173 raft_consensus.cc:2241] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.712803 12173 raft_consensus.cc:2270] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.712801 12177 raft_consensus.cc:2270] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.713145 12173 ts_tablet_manager.cc:1905] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.713156 12175 ts_tablet_manager.cc:1918] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.713222 12175 log.cc:1199] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/292e9c27637d410ea487761f50bdee88
I20250625 14:02:06.713323 12177 ts_tablet_manager.cc:1905] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.715540 12167 tablet_bootstrap.cc:492] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.715621 12167 ts_tablet_manager.cc:1397] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.000s
I20250625 14:02:06.715747 12172 tablet_bootstrap.cc:492] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.715829 12172 ts_tablet_manager.cc:1397] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20250625 14:02:06.716151 12167 raft_consensus.cc:357] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.716248 12167 raft_consensus.cc:383] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250625 14:02:06.714833 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 59556a6da95144f88aa806a7febd6a58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59556a6da95144f88aa806a7febd6a58 already in progress: creating tablet
I20250625 14:02:06.716275 12167 raft_consensus.cc:738] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.716315 12172 raft_consensus.cc:357] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.716418 12172 raft_consensus.cc:383] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.716398 12167 consensus_queue.cc:260] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.716452 12172 raft_consensus.cc:738] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
W20250625 14:02:06.716476 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 12aeec6dd27b4807864685ebdf9bfdf5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 12aeec6dd27b4807864685ebdf9bfdf5 already in progress: creating tablet
I20250625 14:02:06.716704 12167 ts_tablet_manager.cc:1428] T 5d676d411a34492c8b269a64a62fa4af P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.716936 12167 tablet_bootstrap.cc:492] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
W20250625 14:02:06.717038 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 9613ce45d22240bb971fcced3e58a60b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9613ce45d22240bb971fcced3e58a60b already in progress: creating tablet
I20250625 14:02:06.717003 13914 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P 56419e38d8e34f6985d4d970c1ce76e5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20250625 14:02:06.717061 11717 consensus_peers.cc:487] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6980c62d63b34c67ad095ad9ea18a3f1. This is attempt 1: this message will repeat every 5th retry.
W20250625 14:02:06.717166 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet be019f453cab42fa88936c587ca623fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be019f453cab42fa88936c587ca623fa already in progress: creating tablet
I20250625 14:02:06.717312 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet b215f2dc28604d1387e9847a5247564d (table default.Table_677ffd0785754cb59fc1473d4fe7be22 [id=fcb9df7b22c044a6a226c1f2b9d2e055]) successfully deleted
I20250625 14:02:06.717422 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet f2f25aaee07242329014de1834ca881d (table default.Table_972e2b5ba1434aa39649fb5d8c8b9d78 [id=61ec0a905c47494993d61449ae285e91]) successfully deleted
I20250625 14:02:06.716658 12172 consensus_queue.cc:260] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
W20250625 14:02:06.717556 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 714bb5a28ec648f990fa1525a1b50129 because the tablet was not found. No further retry: Not found: Tablet not found: 714bb5a28ec648f990fa1525a1b50129
I20250625 14:02:06.717986 12167 tablet_bootstrap.cc:654] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.718226 13974 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P bfff52620fea460d850827814b790c35: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:02:06.718516 13232 raft_consensus.cc:491] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.718608 13232 raft_consensus.cc:513] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.718964 13232 leader_election.cc:290] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.719341 12172 ts_tablet_manager.cc:1428] T 32e39d974af9439c873ba8ec6523c428 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:06.719521 12172 tablet_bootstrap.cc:492] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.719508 13915 tablet.cc:1722] T b08135db764c4eb286d5f67ccba94ed5 P 87a003e25dbf461ebec24a29ad7016ed: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250625 14:02:06.719794 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5f7bbc6f086d49d7830d47d9db4ebf7b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.719928 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5f7bbc6f086d49d7830d47d9db4ebf7b" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.720197 11993 leader_election.cc:343] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:06.720418 11990 leader_election.cc:343] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.720472 11990 leader_election.cc:304] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.720793 12172 tablet_bootstrap.cc:654] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.721951 13232 raft_consensus.cc:2747] T 5f7bbc6f086d49d7830d47d9db4ebf7b P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.723498 12173 ts_tablet_manager.cc:1918] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.723562 12173 log.cc:1199] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/185a1a5f14344caa89473baa57f0b02d
I20250625 14:02:06.723752 12173 ts_tablet_manager.cc:1939] T 185a1a5f14344caa89473baa57f0b02d P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:06.726929 12177 ts_tablet_manager.cc:1918] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.728936 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 6980c62d63b34c67ad095ad9ea18a3f1 (table default.Table_9b41aea39b8742708a9383406513993b [id=f64f7d5b36ce42b39034f4439346303e]) successfully deleted
I20250625 14:02:06.729390 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet 185a1a5f14344caa89473baa57f0b02d (table default.Table_65610e9b154a415e81112beb1f0412b4 [id=2efaf3cfcced4f92a53e106561ccec60]) successfully deleted
I20250625 14:02:06.730175 12173 tablet_replica.cc:331] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:06.730363 12173 raft_consensus.cc:2241] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.730552 12173 pending_rounds.cc:70] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Trying to abort 1 pending ops.
I20250625 14:02:06.730590 12173 pending_rounds.cc:77] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523076725788672 op_type: NO_OP noop_request { }
I20250625 14:02:06.730655 12173 raft_consensus.cc:2887] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:06.730708 12173 raft_consensus.cc:2270] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.734475 12166 tablet_bootstrap.cc:492] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.734596 12166 ts_tablet_manager.cc:1397] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.000s
I20250625 14:02:06.735078 12166 raft_consensus.cc:357] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.735194 12166 raft_consensus.cc:383] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.735226 12166 raft_consensus.cc:738] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.735340 12166 consensus_queue.cc:260] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.735637 12166 ts_tablet_manager.cc:1428] T a70afbc1a02a457c9099532e16eaac48 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.735961 12173 ts_tablet_manager.cc:1905] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.736637 12175 ts_tablet_manager.cc:1939] T 292e9c27637d410ea487761f50bdee88 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.737030 12166 tablet_bootstrap.cc:492] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.737977 12166 tablet_bootstrap.cc:654] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.739044 12173 ts_tablet_manager.cc:1918] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.739118 12173 log.cc:1199] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/a70afbc1a02a457c9099532e16eaac48
I20250625 14:02:06.739737 11524 master_service.cc:948] ReplaceTablet: received request to replace tablet 289eaa893df4471dbdcd99fbb7b730c3 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.740175 12167 tablet_bootstrap.cc:492] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.740275 12167 ts_tablet_manager.cc:1397] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250625 14:02:06.740815 12167 raft_consensus.cc:357] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.740945 12167 raft_consensus.cc:383] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.740988 12167 raft_consensus.cc:738] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.741112 12167 consensus_queue.cc:260] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.741397 12167 ts_tablet_manager.cc:1428] T c4c32692666047fe9a18a75e66365e16 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.741595 12167 tablet_bootstrap.cc:492] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.743413 12167 tablet_bootstrap.cc:654] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.745262 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 292e9c27637d410ea487761f50bdee88 (table default.Table_0d17996fd693448e97e67565ee825f38 [id=21f01c21cb3f40769f25c95f3f986449]) successfully deleted
I20250625 14:02:06.747856 12177 log.cc:1199] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/7bcc674dc5e448c0871e4efe0c9100b8
I20250625 14:02:06.749775 12166 tablet_bootstrap.cc:492] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.749902 12166 ts_tablet_manager.cc:1397] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250625 14:02:06.750468 12166 raft_consensus.cc:357] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.750584 12166 raft_consensus.cc:383] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.750617 12166 raft_consensus.cc:738] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.750736 12166 consensus_queue.cc:260] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.751052 12166 ts_tablet_manager.cc:1428] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.751255 12166 tablet_bootstrap.cc:492] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.751801 12177 ts_tablet_manager.cc:1939] T 7bcc674dc5e448c0871e4efe0c9100b8 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.752166 12177 tablet_replica.cc:331] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.752209 13232 consensus_queue.cc:1035] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.752296 12177 raft_consensus.cc:2241] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.752367 12166 tablet_bootstrap.cc:654] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.752638 12177 raft_consensus.cc:2270] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.754604 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 7bcc674dc5e448c0871e4efe0c9100b8 (table default.Table_6826e63ce5054cbea665e81b978621cf [id=0cc4d60231684c63a378ce32eadc8106]) successfully deleted
I20250625 14:02:06.755208 12177 ts_tablet_manager.cc:1905] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.755721 12172 tablet_bootstrap.cc:492] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.755848 12172 ts_tablet_manager.cc:1397] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250625 14:02:06.756250 11525 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 1c88a1da38f54117ae2d77cb304b097a
I20250625 14:02:06.756388 12172 raft_consensus.cc:357] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.756485 12172 raft_consensus.cc:383] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.756520 12172 raft_consensus.cc:738] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.756842 12172 consensus_queue.cc:260] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.757757 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 1c88a1da38f54117ae2d77cb304b097a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.758287 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 1c88a1da38f54117ae2d77cb304b097a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.760255 12172 ts_tablet_manager.cc:1428] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:06.760471 12172 tablet_bootstrap.cc:492] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.760676 12167 tablet_bootstrap.cc:492] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.760769 12167 ts_tablet_manager.cc:1397] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20250625 14:02:06.761300 12173 ts_tablet_manager.cc:1939] T a70afbc1a02a457c9099532e16eaac48 P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:06.761348 12167 raft_consensus.cc:357] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.761469 12167 raft_consensus.cc:383] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.761502 12167 raft_consensus.cc:738] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.761631 12167 consensus_queue.cc:260] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.762009 12167 ts_tablet_manager.cc:1428] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:06.762641 12167 tablet_bootstrap.cc:492] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.762800 12166 tablet_bootstrap.cc:492] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.762907 12166 ts_tablet_manager.cc:1397] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250625 14:02:06.763429 12166 raft_consensus.cc:357] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.763552 12166 raft_consensus.cc:383] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.763592 12166 raft_consensus.cc:738] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.763726 12166 consensus_queue.cc:260] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.763901 12167 tablet_bootstrap.cc:654] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
W20250625 14:02:06.763911 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 1c88a1da38f54117ae2d77cb304b097a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c88a1da38f54117ae2d77cb304b097a already in progress: creating tablet
I20250625 14:02:06.764035 12166 ts_tablet_manager.cc:1428] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250625 14:02:06.764210 12166 tablet_bootstrap.cc:492] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.765319 12166 tablet_bootstrap.cc:654] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.765504 12172 tablet_bootstrap.cc:654] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.767095 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 1c88a1da38f54117ae2d77cb304b097a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.769194 12166 tablet_bootstrap.cc:492] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.769300 12166 ts_tablet_manager.cc:1397] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:06.769826 12166 raft_consensus.cc:357] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.769956 12166 raft_consensus.cc:383] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.769992 12166 raft_consensus.cc:738] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.770121 12166 consensus_queue.cc:260] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.770464 12166 ts_tablet_manager.cc:1428] T 185a1a5f14344caa89473baa57f0b02d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250625 14:02:06.770653 12166 tablet_bootstrap.cc:492] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.771777 12166 tablet_bootstrap.cc:654] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.773130 12166 tablet_bootstrap.cc:492] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.773222 12166 ts_tablet_manager.cc:1397] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250625 14:02:06.773712 12166 raft_consensus.cc:357] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.773766 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 289eaa893df4471dbdcd99fbb7b730c3
I20250625 14:02:06.773831 12166 raft_consensus.cc:383] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.773851 12177 ts_tablet_manager.cc:1918] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.773867 12166 raft_consensus.cc:738] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.774077 11524 catalog_manager.cc:6652] ReplaceTablet: tablet 289eaa893df4471dbdcd99fbb7b730c3 deleted and replaced by tablet 56396f274469484aaf6629b28623eab7
I20250625 14:02:06.774050 12166 consensus_queue.cc:260] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.774384 12166 ts_tablet_manager.cc:1428] T c4c32692666047fe9a18a75e66365e16 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.774703 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_4faaef6d3d50447b867083a4b753da64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.775133 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4faaef6d3d50447b867083a4b753da64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.775635 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 289eaa893df4471dbdcd99fbb7b730c3 with delete_type TABLET_DATA_DELETED (replaced by tablet 56396f274469484aaf6629b28623eab7) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.775925 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 289eaa893df4471dbdcd99fbb7b730c3 with delete_type TABLET_DATA_DELETED (replaced by tablet 56396f274469484aaf6629b28623eab7) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.773932 12177 log.cc:1199] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/725a0db4c6374805903657f755ca1783
I20250625 14:02:06.777305 12166 tablet_bootstrap.cc:492] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.777634 12177 ts_tablet_manager.cc:1939] T 725a0db4c6374805903657f755ca1783 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:02:06.777768 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 289eaa893df4471dbdcd99fbb7b730c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 289eaa893df4471dbdcd99fbb7b730c3 already in progress: creating tablet
I20250625 14:02:06.778438 12166 tablet_bootstrap.cc:654] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.779794 12166 tablet_bootstrap.cc:492] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.779896 12166 ts_tablet_manager.cc:1397] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:02:06.780409 12166 raft_consensus.cc:357] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.780521 12166 raft_consensus.cc:383] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.780553 12166 raft_consensus.cc:738] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.780673 12166 consensus_queue.cc:260] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.780959 12166 ts_tablet_manager.cc:1428] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:06.781138 12166 tablet_bootstrap.cc:492] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.782418 12166 tablet_bootstrap.cc:654] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.783831 12177 tablet_replica.cc:331] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.784013 12166 tablet_bootstrap.cc:492] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.784155 12166 ts_tablet_manager.cc:1397] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250625 14:02:06.784153 13232 raft_consensus.cc:491] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.784255 13232 raft_consensus.cc:513] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.784556 12177 raft_consensus.cc:2241] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.784643 13232 leader_election.cc:290] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.784674 12166 raft_consensus.cc:357] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.784790 12166 raft_consensus.cc:383] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.784832 12166 raft_consensus.cc:738] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.784969 12166 consensus_queue.cc:260] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.785287 12166 ts_tablet_manager.cc:1428] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:06.785559 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0d890fd97404513bb031cd6f866b976" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.778501 11717 consensus_peers.cc:487] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 -> Peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Couldn't send request to peer 87a003e25dbf461ebec24a29ad7016ed. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55ede5e94e12449abbbec9146331deb5. This is attempt 1: this message will repeat every 5th retry.
W20250625 14:02:06.786202 11990 leader_election.cc:343] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.786345 12166 tablet_bootstrap.cc:492] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.787038 11778 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "d0d890fd97404513bb031cd6f866b976" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.787353 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 725a0db4c6374805903657f755ca1783 (table default.Table_a868c6d7d31c43a49e263018f45db372 [id=dedb3f4f2a96493ea38bc83aa1eaa3e7]) successfully deleted
I20250625 14:02:06.787460 12166 tablet_bootstrap.cc:654] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.787695 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 289eaa893df4471dbdcd99fbb7b730c3 with delete_type TABLET_DATA_DELETED (replaced by tablet 56396f274469484aaf6629b28623eab7) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.787797 13232 consensus_queue.cc:1035] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:06.787971 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ed176205a65d4127b0ae23649187fba0 because the tablet was not found. No further retry: Not found: Tablet not found: ed176205a65d4127b0ae23649187fba0
I20250625 14:02:06.783175 12172 tablet_bootstrap.cc:492] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.788272 12172 ts_tablet_manager.cc:1397] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20250625 14:02:06.788744 12172 raft_consensus.cc:357] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.788900 12172 raft_consensus.cc:383] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.788951 12172 raft_consensus.cc:738] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.789252 12172 consensus_queue.cc:260] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.789526 12173 tablet_replica.cc:331] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: stopping tablet replica
I20250625 14:02:06.789624 11517 catalog_manager.cc:4928] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): tablet a70afbc1a02a457c9099532e16eaac48 (table default.Table_ca18a9657ad246d1a95d953e4b2389c9 [id=60a0cf9a9dca461c99ae321b9c2528b9]) successfully deleted
I20250625 14:02:06.789673 12173 raft_consensus.cc:2241] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.789767 12173 raft_consensus.cc:2270] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.790373 12166 tablet_bootstrap.cc:492] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
W20250625 14:02:06.790488 11993 leader_election.cc:343] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.790525 12166 ts_tablet_manager.cc:1397] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:06.790570 11993 leader_election.cc:304] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.790709 13232 raft_consensus.cc:2747] T d0d890fd97404513bb031cd6f866b976 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.791785 12166 raft_consensus.cc:357] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.792135 12166 raft_consensus.cc:383] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.792403 12166 raft_consensus.cc:738] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.792606 12166 consensus_queue.cc:260] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.793939 12166 ts_tablet_manager.cc:1428] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250625 14:02:06.793952 12172 ts_tablet_manager.cc:1428] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250625 14:02:06.794152 12172 tablet_bootstrap.cc:492] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.794768 12166 tablet_bootstrap.cc:492] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.798696 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet ab7cefe7389d447d9c6296b8cc89314d
I20250625 14:02:06.799513 12172 tablet_bootstrap.cc:654] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.799569 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7cefe7389d447d9c6296b8cc89314d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.800428 13953 raft_consensus.cc:491] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.800442 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7cefe7389d447d9c6296b8cc89314d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.800525 13953 raft_consensus.cc:513] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.800951 13953 leader_election.cc:290] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
W20250625 14:02:06.801203 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet ab7cefe7389d447d9c6296b8cc89314d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab7cefe7389d447d9c6296b8cc89314d already in progress: creating tablet
I20250625 14:02:06.801261 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb6f4cb8f8c9426bbbfcdd3b350e950e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.801594 12177 pending_rounds.cc:70] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
W20250625 14:02:06.801596 11990 leader_election.cc:343] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.801726 12177 pending_rounds.cc:77] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523077341421568 op_type: NO_OP noop_request { }
I20250625 14:02:06.801833 12177 raft_consensus.cc:2887] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:06.801858 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb6f4cb8f8c9426bbbfcdd3b350e950e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.802045 11783 raft_consensus.cc:2466] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.802075 12177 raft_consensus.cc:2270] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.802348 11993 leader_election.cc:304] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.802587 13908 raft_consensus.cc:2802] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.802649 13908 raft_consensus.cc:491] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.802700 13908 raft_consensus.cc:3058] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.802765 12166 tablet_bootstrap.cc:654] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.802860 11532 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_86a94c5d1bce4a798865c89f3d37c87c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.803334 11532 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86a94c5d1bce4a798865c89f3d37c87c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.803970 13908 raft_consensus.cc:513] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.804044 12166 tablet_bootstrap.cc:492] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.804126 12166 ts_tablet_manager.cc:1397] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250625 14:02:06.804368 13908 leader_election.cc:290] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.804653 12166 raft_consensus.cc:357] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.804760 12166 raft_consensus.cc:383] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.804798 12166 raft_consensus.cc:738] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.804939 12166 consensus_queue.cc:260] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.805727 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_048cc8049e2d4691aafb1046baaa2a43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.806162 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_048cc8049e2d4691aafb1046baaa2a43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.806252 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb6f4cb8f8c9426bbbfcdd3b350e950e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.806407 11783 raft_consensus.cc:3058] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.805323 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "bb6f4cb8f8c9426bbbfcdd3b350e950e" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.806833 12177 ts_tablet_manager.cc:1905] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.807590 11783 raft_consensus.cc:2466] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
W20250625 14:02:06.807934 11990 leader_election.cc:343] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.808322 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet ab7cefe7389d447d9c6296b8cc89314d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.808440 11993 leader_election.cc:304] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.808671 13908 raft_consensus.cc:2802] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.808768 13908 raft_consensus.cc:695] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:06.808909 12166 ts_tablet_manager.cc:1428] T 32e39d974af9439c873ba8ec6523c428 P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250625 14:02:06.808907 13908 consensus_queue.cc:237] T bb6f4cb8f8c9426bbbfcdd3b350e950e P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.809835 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a6544a9b408946abb14fab1114bee055" } modify_external_catalogs: true
I20250625 14:02:06.809949 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_a6544a9b408946abb14fab1114bee055" } modify_external_catalogs: true
I20250625 14:02:06.813174 11524 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4777298e57934c8ab996cfecc9626fc8" } modify_external_catalogs: true
I20250625 14:02:06.813318 11524 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4777298e57934c8ab996cfecc9626fc8" } modify_external_catalogs: true
I20250625 14:02:06.814811 13953 raft_consensus.cc:491] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.814927 13953 raft_consensus.cc:513] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.815313 13953 leader_election.cc:290] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.815575 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5befd721fd0547cba58e4ead7c2ce5c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.815973 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5befd721fd0547cba58e4ead7c2ce5c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.818428 11526 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_5c451f1ba2f246549b649bf689a73ec1" } new_table_name: "default.Table_f1b3b34a16bf4283adf1d44e4219bfe1" modify_external_catalogs: true
I20250625 14:02:06.814556 12166 tablet_bootstrap.cc:492] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.816074 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cdbebbb725564dc98c30ce4bbd3af8db" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.820788 11990 leader_election.cc:343] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.822063 11532 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 35f16657b4514c92b5d1a88db036b39e
I20250625 14:02:06.822752 11524 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6ee9e1c72c474cfcae246b73cdeddf74
I20250625 14:02:06.822793 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 35f16657b4514c92b5d1a88db036b39e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:06.823401 11517 catalog_manager.cc:4908] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 35f16657b4514c92b5d1a88db036b39e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35f16657b4514c92b5d1a88db036b39e already in progress: creating tablet
I20250625 14:02:06.823720 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ee9e1c72c474cfcae246b73cdeddf74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.824067 13953 raft_consensus.cc:491] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.824183 13953 raft_consensus.cc:513] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.824616 13953 leader_election.cc:290] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.825026 12172 tablet_bootstrap.cc:492] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:06.825068 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 35f16657b4514c92b5d1a88db036b39e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.825207 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ee9e1c72c474cfcae246b73cdeddf74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:06.825204 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6ee9e1c72c474cfcae246b73cdeddf74 because the tablet was not found. No further retry: Not found: Tablet not found: 6ee9e1c72c474cfcae246b73cdeddf74
I20250625 14:02:06.825207 11922 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a67a7c7c8a4c6eb331676ea4d126a6" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.825440 12172 ts_tablet_manager.cc:1397] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
W20250625 14:02:06.825547 11990 leader_election.cc:343] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.826063 12172 raft_consensus.cc:357] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.826176 12172 raft_consensus.cc:383] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.826208 12172 raft_consensus.cc:738] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.826386 12172 consensus_queue.cc:260] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.827180 13837 raft_consensus.cc:491] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.827266 13837 raft_consensus.cc:513] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.827641 13837 leader_election.cc:290] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:06.829003 12166 tablet_bootstrap.cc:654] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.830420 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cdbebbb725564dc98c30ce4bbd3af8db" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.830546 11783 raft_consensus.cc:2466] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.830787 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ee9e1c72c474cfcae246b73cdeddf74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.830928 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 35f16657b4514c92b5d1a88db036b39e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.831329 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "16b68e0df99d4a1b8744b52d175b2eb2" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.831447 11783 raft_consensus.cc:2466] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:06.831697 11922 raft_consensus.cc:3058] T 4ed7734f171f4692ba7900844100c878 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.831782 11858 leader_election.cc:304] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:06.831969 13837 raft_consensus.cc:2802] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.832023 13837 raft_consensus.cc:491] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.832063 13837 raft_consensus.cc:3058] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.833017 13837 raft_consensus.cc:513] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.833256 13953 consensus_queue.cc:1035] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.833397 13837 leader_election.cc:290] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Requested vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
W20250625 14:02:06.833791 11526 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a81cafac2f041a9942bf8b074473d04 consensus state has no leader
I20250625 14:02:06.833774 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "16b68e0df99d4a1b8744b52d175b2eb2" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.833880 11783 raft_consensus.cc:3058] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.834658 12172 ts_tablet_manager.cc:1428] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20250625 14:02:06.835021 11783 raft_consensus.cc:2466] T 16b68e0df99d4a1b8744b52d175b2eb2 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:06.835424 11858 leader_election.cc:304] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35; no voters:
I20250625 14:02:06.835675 13837 raft_consensus.cc:2802] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.835763 13837 raft_consensus.cc:695] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [term 1 LEADER]: Becoming Leader. State: Replica: bfff52620fea460d850827814b790c35, State: Running, Role: LEADER
I20250625 14:02:06.835909 13837 consensus_queue.cc:237] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.836223 12172 tablet_bootstrap.cc:492] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:06.836298 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_4f53ff9a13b84b4c997fd1123d48f383" } new_table_name: "default.Table_7f31849a79144d14bce255cbeba66fbb" modify_external_catalogs: true
I20250625 14:02:06.837471 12172 tablet_bootstrap.cc:654] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.837666 11993 leader_election.cc:304] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.838125 13953 raft_consensus.cc:2802] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.838184 13953 raft_consensus.cc:491] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.838155 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "16b68e0df99d4a1b8744b52d175b2eb2" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.838223 13953 raft_consensus.cc:3058] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.838279 12047 raft_consensus.cc:2466] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 0.
I20250625 14:02:06.838483 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "16b68e0df99d4a1b8744b52d175b2eb2" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.838569 12044 raft_consensus.cc:3058] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.839314 13953 raft_consensus.cc:513] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.824489 12177 ts_tablet_manager.cc:1918] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.839432 12177 log.cc:1199] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/55ede5e94e12449abbbec9146331deb5
I20250625 14:02:06.839565 12044 raft_consensus.cc:2466] T 16b68e0df99d4a1b8744b52d175b2eb2 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfff52620fea460d850827814b790c35 in term 1.
I20250625 14:02:06.839676 13953 leader_election.cc:290] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.839757 13953 raft_consensus.cc:491] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.839818 13953 raft_consensus.cc:513] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.840114 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cdbebbb725564dc98c30ce4bbd3af8db" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:06.840466 11990 leader_election.cc:343] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.840448 13953 leader_election.cc:290] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.840843 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "881295234a5b4a089985382765774cd9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.841362 11990 leader_election.cc:343] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.842015 11783 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a67a7c7c8a4c6eb331676ea4d126a6" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.842154 11783 raft_consensus.cc:2466] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.843683 12177 ts_tablet_manager.cc:1939] T 55ede5e94e12449abbbec9146331deb5 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.844471 12177 tablet_replica.cc:331] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
W20250625 14:02:06.845999 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e806fb1961b4672a1fa3a114ade1d7f consensus state has no leader
I20250625 14:02:06.847096 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "cdbebbb725564dc98c30ce4bbd3af8db" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.847185 11780 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "881295234a5b4a089985382765774cd9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.847226 11782 raft_consensus.cc:3058] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.847268 11780 raft_consensus.cc:2466] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.847626 11525 master_service.cc:948] ReplaceTablet: received request to replace tablet d7d225545467475d9d656f5354585aa0 from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:06.847718 11993 leader_election.cc:304] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.848129 13908 raft_consensus.cc:2802] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.846897 12177 raft_consensus.cc:2241] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.848202 13908 raft_consensus.cc:491] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.848253 13908 raft_consensus.cc:3058] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.848346 11782 raft_consensus.cc:2466] T cdbebbb725564dc98c30ce4bbd3af8db P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:06.848387 12177 raft_consensus.cc:2270] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.849316 12177 ts_tablet_manager.cc:1905] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.849619 13908 raft_consensus.cc:513] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.850054 13908 leader_election.cc:290] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.850764 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a67a7c7c8a4c6eb331676ea4d126a6" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:06.851176 11990 leader_election.cc:343] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.851341 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_0fde474bfb82476aa6df294d0d959224"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.851795 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fde474bfb82476aa6df294d0d959224 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.853399 11525 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_365fecdd52d641cca7743ce24911741a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.853803 11525 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_365fecdd52d641cca7743ce24911741a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.854193 12177 ts_tablet_manager.cc:1918] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.856067 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet cbe2dcd1fb924dcba5c12aaa8e141435 (table default.Table_d0b3e2e69d20402f990444c966a8f3c0 [id=2e114a17eddf47f4b5522bcdad81bd16]). Expected version 2 got 0
I20250625 14:02:06.856204 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c188bc758a4c4a71a5550fc11fe59b1a (table default.Table_cabcd06410bc4ee282294a6d0f1b2fe7 [id=8030abc171274e888b1dc6dd7b57b98d]). Expected version 1 got 0
I20250625 14:02:06.856287 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 8b7f27723e424ae9900b11ef0781533b (table default.Table_240eff761a9d4c4c8d44f3e36ffe1d7d [id=0d2976b736fb4eb5a4cc83a8a793dc21]). Expected version 1 got 0
I20250625 14:02:06.856395 11533 catalog_manager.cc:5582] T c744b3d26efa42c0bf7fe30c561c692d P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:06.856577 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c744b3d26efa42c0bf7fe30c561c692d (table default.Table_d2b2e6f3136e451cbb109d8f43d96682 [id=5d7d7235935340089195e54e50d9bc32]). Expected version 1 got 0
I20250625 14:02:06.856719 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet cdbebbb725564dc98c30ce4bbd3af8db (table default.Table_67c0588df36842488fcf1789bb9e0c88 [id=ca4d9657d22c41cb8df831d8a7470745]). Expected version 2 got 0
I20250625 14:02:06.856791 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 13a2c2f498e24f47a12181a89dcbd769 (table default.Table_c2fa6c9333664dedaedb249e523d7f55 [id=21a50fe75ad14d07b605f238ce89ca09]). Expected version 1 got 0
I20250625 14:02:06.856909 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet 41eb1c8d2afa4a4593a466bffae5dc23 (table default.Table_ee2bfa38bd964932a98b687fe8472e56 [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 2 got 0
I20250625 14:02:06.857035 11533 catalog_manager.cc:5582] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:06.856253 11524 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_5ed646e5c87e4b42b27df2e82720e48b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:06.857228 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet fddd9a629d984649ad92c8f4fe52e114 (table default.Table_6ddf39e5d36e4f2dbae8115326df5d33 [id=db2d7f8c45ba4676b4fa1da5714279df]). Expected version 1 got 0
I20250625 14:02:06.857374 11533 catalog_manager.cc:5582] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
W20250625 14:02:06.857510 11524 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ed646e5c87e4b42b27df2e82720e48b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.857510 11533 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
I20250625 14:02:06.858340 11674 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 6ee9e1c72c474cfcae246b73cdeddf74
I20250625 14:02:06.859030 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ee9e1c72c474cfcae246b73cdeddf74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.859018 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ee9e1c72c474cfcae246b73cdeddf74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
W20250625 14:02:06.859522 11517 catalog_manager.cc:4895] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): delete failed for tablet 6ee9e1c72c474cfcae246b73cdeddf74 because the tablet was not found. No further retry: Not found: Tablet not found: 6ee9e1c72c474cfcae246b73cdeddf74
I20250625 14:02:06.860121 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 6e775cff57244c37bc6f2a8b8a317075 (DEFAULT_TABLE table=default.Table_9916a22393ea44d38bdf1d5d9cca4ed5 [id=22e71207c8644201b46a78503340f9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.860123 12026 tablet_service.cc:1468] Processing CreateTablet for tablet 6e775cff57244c37bc6f2a8b8a317075 (DEFAULT_TABLE table=default.Table_9916a22393ea44d38bdf1d5d9cca4ed5 [id=22e71207c8644201b46a78503340f9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.860414 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e775cff57244c37bc6f2a8b8a317075. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.860417 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e775cff57244c37bc6f2a8b8a317075. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.862859 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 55ede5e94e12449abbbec9146331deb5 (table default.Table_85edeb4b51284604b988da8b6dbd6a34 [id=0954c7104a6243169519805ca7369806]) successfully deleted
I20250625 14:02:06.863329 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 43098f9893c84989b118eb9d24fa4d5e (DEFAULT_TABLE table=default.Table_c4645bbf5a5d493793ce383e37bcf7aa [id=d4b5f84de6d146f0aede779ab56f29fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.863607 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43098f9893c84989b118eb9d24fa4d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.864631 11781 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c9a67a7c7c8a4c6eb331676ea4d126a6" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.864779 11781 raft_consensus.cc:3058] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.864876 11993 leader_election.cc:304] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.865103 11993 leader_election.cc:304] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.865379 13908 raft_consensus.cc:2802] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.865432 13908 raft_consensus.cc:491] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.865471 13908 raft_consensus.cc:3058] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.865845 11781 raft_consensus.cc:2466] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
I20250625 14:02:06.865871 11757 tablet_service.cc:1515] Processing DeleteTablet for tablet 6ee9e1c72c474cfcae246b73cdeddf74 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.866156 11759 tablet_service.cc:1468] Processing CreateTablet for tablet 6e775cff57244c37bc6f2a8b8a317075 (DEFAULT_TABLE table=default.Table_9916a22393ea44d38bdf1d5d9cca4ed5 [id=22e71207c8644201b46a78503340f9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.866411 13908 raft_consensus.cc:513] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.866156 11753 tablet_service.cc:1468] Processing CreateTablet for tablet 43098f9893c84989b118eb9d24fa4d5e (DEFAULT_TABLE table=default.Table_c4645bbf5a5d493793ce383e37bcf7aa [id=d4b5f84de6d146f0aede779ab56f29fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.866784 13908 leader_election.cc:290] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.866781 13835 raft_consensus.cc:491] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.866902 13908 raft_consensus.cc:2802] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.866890 13835 raft_consensus.cc:513] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.866961 13908 raft_consensus.cc:695] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:06.867077 13908 consensus_queue.cc:237] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.867322 13835 leader_election.cc:290] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.867359 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "881295234a5b4a089985382765774cd9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
W20250625 14:02:06.867707 11990 leader_election.cc:343] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.868526 11993 leader_election.cc:304] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.868518 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "881295234a5b4a089985382765774cd9" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
I20250625 14:02:06.868649 11782 raft_consensus.cc:3058] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.868804 11855 leader_election.cc:343] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 7bcc674dc5e448c0871e4efe0c9100b8
I20250625 14:02:06.869024 13953 raft_consensus.cc:2802] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.869108 13953 raft_consensus.cc:695] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:06.869230 13953 consensus_queue.cc:237] T c9a67a7c7c8a4c6eb331676ea4d126a6 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.869701 11782 raft_consensus.cc:2466] T 881295234a5b4a089985382765774cd9 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 1.
W20250625 14:02:06.870055 11858 leader_election.cc:343] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 7bcc674dc5e448c0871e4efe0c9100b8
I20250625 14:02:06.870155 11858 leader_election.cc:304] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.854283 12177 log.cc:1199] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/6980c62d63b34c67ad095ad9ea18a3f1
I20250625 14:02:06.870421 11993 leader_election.cc:304] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.870636 11759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e775cff57244c37bc6f2a8b8a317075. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.870662 12177 ts_tablet_manager.cc:1939] T 6980c62d63b34c67ad095ad9ea18a3f1 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.870723 13908 raft_consensus.cc:2802] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election won for term 1
I20250625 14:02:06.870795 11753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43098f9893c84989b118eb9d24fa4d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.870803 13908 raft_consensus.cc:695] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [term 1 LEADER]: Becoming Leader. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Running, Role: LEADER
I20250625 14:02:06.870920 13908 consensus_queue.cc:237] T 881295234a5b4a089985382765774cd9 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.871995 12166 tablet_bootstrap.cc:492] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.872094 12166 ts_tablet_manager.cc:1397] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.000s
I20250625 14:02:06.872599 12166 raft_consensus.cc:357] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.872709 12166 raft_consensus.cc:383] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.872742 12166 raft_consensus.cc:738] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.872821 13835 raft_consensus.cc:2747] T 7bcc674dc5e448c0871e4efe0c9100b8 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.872902 12166 consensus_queue.cc:260] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.873340 12166 ts_tablet_manager.cc:1428] T 8b7f27723e424ae9900b11ef0781533b P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.873528 12166 tablet_bootstrap.cc:492] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.875370 12166 tablet_bootstrap.cc:654] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.875555 13855 consensus_queue.cc:1035] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.877825 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
I20250625 14:02:06.878039 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c744b3d26efa42c0bf7fe30c561c692d (table default.Table_d2b2e6f3136e451cbb109d8f43d96682 [id=5d7d7235935340089195e54e50d9bc32]). Expected version 1 got 0
I20250625 14:02:06.878190 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c188bc758a4c4a71a5550fc11fe59b1a (table default.Table_cabcd06410bc4ee282294a6d0f1b2fe7 [id=8030abc171274e888b1dc6dd7b57b98d]). Expected version 1 got 0
I20250625 14:02:06.878263 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 13a2c2f498e24f47a12181a89dcbd769 (table default.Table_c2fa6c9333664dedaedb249e523d7f55 [id=21a50fe75ad14d07b605f238ce89ca09]). Expected version 1 got 0
I20250625 14:02:06.878472 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet cbe2dcd1fb924dcba5c12aaa8e141435 (table default.Table_d0b3e2e69d20402f990444c966a8f3c0 [id=2e114a17eddf47f4b5522bcdad81bd16]). Expected version 2 got 0
I20250625 14:02:06.880317 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c188bc758a4c4a71a5550fc11fe59b1a (table default.Table_cabcd06410bc4ee282294a6d0f1b2fe7 [id=8030abc171274e888b1dc6dd7b57b98d]). Expected version 1 got 0
I20250625 14:02:06.880492 11528 catalog_manager.cc:5582] T 8b7f27723e424ae9900b11ef0781533b P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:06.880724 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 8b7f27723e424ae9900b11ef0781533b (table default.Table_240eff761a9d4c4c8d44f3e36ffe1d7d [id=0d2976b736fb4eb5a4cc83a8a793dc21]). Expected version 1 got 0
I20250625 14:02:06.880970 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 13a2c2f498e24f47a12181a89dcbd769 (table default.Table_c2fa6c9333664dedaedb249e523d7f55 [id=21a50fe75ad14d07b605f238ce89ca09]). Expected version 1 got 0
I20250625 14:02:06.881110 11528 catalog_manager.cc:5582] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20250625 14:02:06.881429 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 41eb1c8d2afa4a4593a466bffae5dc23 (table default.Table_ee2bfa38bd964932a98b687fe8472e56 [id=db2410fbfdb04e9980e32af6f24ae771]). Expected version 2 got 0
I20250625 14:02:06.881575 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet cdbebbb725564dc98c30ce4bbd3af8db (table default.Table_67c0588df36842488fcf1789bb9e0c88 [id=ca4d9657d22c41cb8df831d8a7470745]). Expected version 2 got 0
I20250625 14:02:06.881740 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet c744b3d26efa42c0bf7fe30c561c692d (table default.Table_d2b2e6f3136e451cbb109d8f43d96682 [id=5d7d7235935340089195e54e50d9bc32]). Expected version 1 got 0
I20250625 14:02:06.888423 12173 ts_tablet_manager.cc:1905] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.889901 13855 consensus_queue.cc:1035] T a951fa8b0cab485f9c221367c029fa4a P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.890236 11422 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskc2VY_P/build/debug/bin/kudu with pid 13510
I20250625 14:02:06.893322 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_e3322169c32b4dd8af57a18e67156a86 [id=cd68b5ad9c1849298e961363e2e27608] alter complete (version 1)
I20250625 14:02:06.900116 11533 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_208a448bb1364aabb108effff5aa2200 [id=163afb6ad61f460eacc876d8d0e95c24] alter complete (version 1)
I20250625 14:02:06.902259 11525 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_aab93ae1bcc240568c20e53d049f3e90" } new_table_name: "default.Table_5b7be7cb91c44edc906d83ede3d3ce6f" modify_external_catalogs: true
I20250625 14:02:06.904124 11524 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_673d4f709a6046da8ce9e476d447782f" } new_table_name: "default.Table_7abdd502a98f40b28287daa0a58c8d9d" modify_external_catalogs: true
I20250625 14:02:06.905189 11526 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_1a9beeadc76343c899d1efd2de57e02d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.905541 11526 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a9beeadc76343c899d1efd2de57e02d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.906683 11532 catalog_manager.cc:3502] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_f130f865e7e14d0188c06791bcc2071c" } new_table_name: "default.Table_f6785a5dde5f4b43b7418305f6fd3d27" modify_external_catalogs: true
I20250625 14:02:06.907541 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 6980c62d63b34c67ad095ad9ea18a3f1 (table default.Table_9b41aea39b8742708a9383406513993b [id=f64f7d5b36ce42b39034f4439346303e]) successfully deleted
I20250625 14:02:06.907729 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_033d28bc861b4fba9ad976ece65a2428"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:06.907759 11533 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_6f10e1f6ec904ffca3af05de73867204"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250625 14:02:06.908135 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_033d28bc861b4fba9ad976ece65a2428 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250625 14:02:06.908406 11533 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f10e1f6ec904ffca3af05de73867204 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:06.908987 13835 raft_consensus.cc:491] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.909091 13835 raft_consensus.cc:513] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.909487 13835 leader_election.cc:290] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:06.909994 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c767ef4cab694e09866524f84a429da7" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.910152 12047 raft_consensus.cc:2391] T c767ef4cab694e09866524f84a429da7 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:06.910143 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "c767ef4cab694e09866524f84a429da7" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.910634 11858 leader_election.cc:304] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
W20250625 14:02:06.910701 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 1c88a1da38f54117ae2d77cb304b097a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c88a1da38f54117ae2d77cb304b097a already in progress: creating tablet
I20250625 14:02:06.910871 13835 raft_consensus.cc:3058] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
W20250625 14:02:06.911037 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 289eaa893df4471dbdcd99fbb7b730c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 289eaa893df4471dbdcd99fbb7b730c3 already in progress: creating tablet
W20250625 14:02:06.911226 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet ab7cefe7389d447d9c6296b8cc89314d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab7cefe7389d447d9c6296b8cc89314d already in progress: creating tablet
W20250625 14:02:06.911410 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6ee9e1c72c474cfcae246b73cdeddf74 because the tablet was not found. No further retry: Not found: Tablet not found: 6ee9e1c72c474cfcae246b73cdeddf74
W20250625 14:02:06.911581 11520 catalog_manager.cc:4908] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 35f16657b4514c92b5d1a88db036b39e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35f16657b4514c92b5d1a88db036b39e already in progress: creating tablet
W20250625 14:02:06.911746 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 6ee9e1c72c474cfcae246b73cdeddf74 because the tablet was not found. No further retry: Not found: Tablet not found: 6ee9e1c72c474cfcae246b73cdeddf74
I20250625 14:02:06.911919 13835 raft_consensus.cc:2747] T c767ef4cab694e09866524f84a429da7 P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.912781 11529 catalog_manager.cc:5869] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: Sending DeleteTablet for 3 replicas of tablet 0f49508e87b5416db9f123df898eaada
I20250625 14:02:06.912823 12166 tablet_bootstrap.cc:492] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:06.912904 12166 ts_tablet_manager.cc:1397] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20250625 14:02:06.913601 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f49508e87b5416db9f123df898eaada with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.913704 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f49508e87b5416db9f123df898eaada with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.913856 12175 tablet_replica.cc:331] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.913988 12175 raft_consensus.cc:2241] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.914067 12175 pending_rounds.cc:70] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Trying to abort 1 pending ops.
I20250625 14:02:06.914089 12175 pending_rounds.cc:77] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523077364609024 op_type: NO_OP noop_request { }
I20250625 14:02:06.914144 12175 raft_consensus.cc:2887] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:06.914193 12175 raft_consensus.cc:2270] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.914547 13835 raft_consensus.cc:491] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.914630 13835 raft_consensus.cc:513] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.914945 13835 leader_election.cc:290] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:06.915437 12167 tablet_bootstrap.cc:492] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:06.915544 12167 ts_tablet_manager.cc:1397] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.000s
I20250625 14:02:06.914556 12166 raft_consensus.cc:357] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.915611 12166 raft_consensus.cc:383] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.915647 12166 raft_consensus.cc:738] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
W20250625 14:02:06.915861 11858 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 082a46d213c545b18acbcac1b699d140
I20250625 14:02:06.916049 12167 raft_consensus.cc:357] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.916162 12167 raft_consensus.cc:383] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:06.916196 12167 raft_consensus.cc:738] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:06.916211 12166 consensus_queue.cc:260] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.916329 12167 consensus_queue.cc:260] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.916625 12166 ts_tablet_manager.cc:1428] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250625 14:02:06.916678 12167 ts_tablet_manager.cc:1428] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:06.916795 12166 tablet_bootstrap.cc:492] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:06.916883 12167 tablet_bootstrap.cc:492] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:06.917366 11887 tablet_service.cc:1515] Processing DeleteTablet for tablet 60ca3a1ea9b944a2a1830cad6cee3cff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.917495 11888 tablet_service.cc:1515] Processing DeleteTablet for tablet c06757067b3e465f8239b9ff38b68071 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:01 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.917995 12166 tablet_bootstrap.cc:654] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.918092 12167 tablet_bootstrap.cc:654] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:06.918834 11891 tablet_service.cc:1515] Processing DeleteTablet for tablet a753b44395994a4abaaa96fb9b6d594a with delete_type TABLET_DATA_DELETED (replaced by tablet bf421457ab6c481f9fd6e18a9572ba5f) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.919203 11894 tablet_service.cc:1515] Processing DeleteTablet for tablet 7bcc674dc5e448c0871e4efe0c9100b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d600a46fc1c4a6194368f3cd8681364) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.919282 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 31f843108ecf440090c05255afa1687e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.918587 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet b55487136b024aa788e31debeb1b2eca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.919346 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet 725a0db4c6374805903657f755ca1783 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.919004 11889 tablet_service.cc:1515] Processing DeleteTablet for tablet ed176205a65d4127b0ae23649187fba0 with delete_type TABLET_DATA_DELETED (replaced by tablet f7808bed1b8f4103bf728b8a525dad5d) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.919665 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 55ede5e94e12449abbbec9146331deb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73f64982ad194dfe9dcbf6b77e047db2) from {username='slave'} at 127.0.0.1:33946
W20250625 14:02:06.921952 11855 leader_election.cc:343] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 082a46d213c545b18acbcac1b699d140
I20250625 14:02:06.922041 11855 leader_election.cc:304] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.922164 13837 raft_consensus.cc:491] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.922351 13835 raft_consensus.cc:2747] T 082a46d213c545b18acbcac1b699d140 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.922255 13837 raft_consensus.cc:513] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.922683 13837 leader_election.cc:290] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
W20250625 14:02:06.923300 11858 leader_election.cc:343] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Not found: Tablet not found: 6980c62d63b34c67ad095ad9ea18a3f1
W20250625 14:02:06.923938 11855 leader_election.cc:343] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921): Not found: Tablet not found: 6980c62d63b34c67ad095ad9ea18a3f1
I20250625 14:02:06.923997 11855 leader_election.cc:304] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.924166 13837 raft_consensus.cc:2747] T 6980c62d63b34c67ad095ad9ea18a3f1 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.925323 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet d0d890fd97404513bb031cd6f866b976 with delete_type TABLET_DATA_DELETED (replaced by tablet 39b41ff066cb499fae9b71ca1f2f9d2b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.925520 12025 tablet_service.cc:1515] Processing DeleteTablet for tablet bb6f4cb8f8c9426bbbfcdd3b350e950e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.925560 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet c767ef4cab694e09866524f84a429da7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1b9e127f181474fa1571efd76a99536) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.925503 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet c9a67a7c7c8a4c6eb331676ea4d126a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa9aeec4f564a8b83f055e2e53810ec) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.925844 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet d8227e0205bb4b9fa9b8047558cf9a1c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.926424 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 60414f22c3bd4938b11c678197e0b34c) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.927198 12025 tablet_service.cc:1515] Processing DeleteTablet for tablet b345695e57a24b09aff2b8e00bf0fbdf with delete_type TABLET_DATA_DELETED (replaced by tablet 357d05c539144e9c8bafe6819f8ee39b) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.928718 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 185a1a5f14344caa89473baa57f0b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.928889 12177 tablet_replica.cc:331] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.928949 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet c4c32692666047fe9a18a75e66365e16 with delete_type TABLET_DATA_DELETED (replaced by tablet f8f4f4c9b85c4c08a386347b4164efa7) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.929064 12177 raft_consensus.cc:2241] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:06.929140 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet a753b44395994a4abaaa96fb9b6d594a with delete_type TABLET_DATA_DELETED (replaced by tablet bf421457ab6c481f9fd6e18a9572ba5f) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.929207 12177 pending_rounds.cc:70] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:06.929227 12019 tablet_service.cc:1515] Processing DeleteTablet for tablet a70afbc1a02a457c9099532e16eaac48 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.929234 12177 pending_rounds.cc:77] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523078692990976 op_type: NO_OP noop_request { }
I20250625 14:02:06.929288 12177 raft_consensus.cc:2887] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:06.929337 12177 raft_consensus.cc:2270] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.929358 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 55ede5e94e12449abbbec9146331deb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73f64982ad194dfe9dcbf6b77e047db2) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.929368 12027 tablet_service.cc:1515] Processing DeleteTablet for tablet 5f7bbc6f086d49d7830d47d9db4ebf7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.929566 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet b345695e57a24b09aff2b8e00bf0fbdf with delete_type TABLET_DATA_DELETED (replaced by tablet 357d05c539144e9c8bafe6819f8ee39b) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.929653 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ed7734f171f4692ba7900844100c878 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.929769 12028 tablet_service.cc:1515] Processing DeleteTablet for tablet 32e39d974af9439c873ba8ec6523c428 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.929875 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.929971 12177 ts_tablet_manager.cc:1905] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.930795 11759 tablet_service.cc:1515] Processing DeleteTablet for tablet b55487136b024aa788e31debeb1b2eca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:58 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.930848 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 31f843108ecf440090c05255afa1687e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.931262 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet c767ef4cab694e09866524f84a429da7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1b9e127f181474fa1571efd76a99536) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.931456 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 725a0db4c6374805903657f755ca1783 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.931617 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.931771 11753 tablet_service.cc:1515] Processing DeleteTablet for tablet 0f49508e87b5416db9f123df898eaada with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:06 UTC) from {username='slave'} at 127.0.0.1:48698
I20250625 14:02:06.933070 12177 ts_tablet_manager.cc:1918] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.933135 12177 log.cc:1199] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/185a1a5f14344caa89473baa57f0b02d
I20250625 14:02:06.933391 12177 ts_tablet_manager.cc:1939] T 185a1a5f14344caa89473baa57f0b02d P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.934681 13232 consensus_queue.cc:1035] T 4ed7734f171f4692ba7900844100c878 P 87a003e25dbf461ebec24a29ad7016ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250625 14:02:06.936144 11720 connection.cc:537] client connection to 127.11.39.190:38199 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250625 14:02:06.936508 11858 connection.cc:537] client connection to 127.11.39.190:38199 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250625 14:02:06.936811 12177 tablet_replica.cc:331] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.937296 12177 raft_consensus.cc:2241] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.937430 12177 raft_consensus.cc:2270] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.937808 12177 ts_tablet_manager.cc:1905] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:06.940634 11993 connection.cc:537] client connection to 127.11.39.190:38199 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250625 14:02:06.942274 14107 negotiation.cc:337] Failed RPC negotiation. Trace:
0625 14:02:06.937430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.39.190:38199 (local address 127.11.39.130:53249)
0625 14:02:06.941025 (+ 3595us) negotiation.cc:107] Waiting for socket to connect
0625 14:02:06.941041 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0625 14:02:06.941530 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0625 14:02:06.942123 (+ 593us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.39.190:38199: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":3512,"thread_start_us":66,"threads_started":1}
W20250625 14:02:06.943060 14110 negotiation.cc:337] Failed RPC negotiation. Trace:
0625 14:02:06.941543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.39.190:38199 (local address 127.11.39.131:44937)
0625 14:02:06.942622 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0625 14:02:06.942724 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.39.190:38199: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":96,"threads_started":1}
I20250625 14:02:06.944391 12177 ts_tablet_manager.cc:1918] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.944479 12177 log.cc:1199] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c4c32692666047fe9a18a75e66365e16
I20250625 14:02:06.944775 12177 ts_tablet_manager.cc:1939] T c4c32692666047fe9a18a75e66365e16 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.945151 12177 tablet_replica.cc:331] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.945392 12177 raft_consensus.cc:2241] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.945566 12177 raft_consensus.cc:2270] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.946130 12177 ts_tablet_manager.cc:1905] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.950100 11531 catalog_manager.cc:5582] T cbe2dcd1fb924dcba5c12aaa8e141435 P 56419e38d8e34f6985d4d970c1ce76e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129). New cstate: current_term: 1 leader_uuid: "56419e38d8e34f6985d4d970c1ce76e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } }
W20250625 14:02:06.946197 14108 negotiation.cc:337] Failed RPC negotiation. Trace:
0625 14:02:06.938678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.39.190:38199 (local address 127.11.39.129:38979)
0625 14:02:06.946022 (+ 7344us) negotiation.cc:107] Waiting for socket to connect
0625 14:02:06.946078 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.39.190:38199: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":7267,"thread_start_us":72,"threads_started":1}
I20250625 14:02:06.950436 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet cbe2dcd1fb924dcba5c12aaa8e141435 (table default.Table_d0b3e2e69d20402f990444c966a8f3c0 [id=2e114a17eddf47f4b5522bcdad81bd16]). Expected version 2 got 0
I20250625 14:02:06.950702 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
I20250625 14:02:06.950949 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet fddd9a629d984649ad92c8f4fe52e114 (table default.Table_6ddf39e5d36e4f2dbae8115326df5d33 [id=db2d7f8c45ba4676b4fa1da5714279df]). Expected version 1 got 0
I20250625 14:02:06.951095 11531 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet c744b3d26efa42c0bf7fe30c561c692d (table default.Table_d2b2e6f3136e451cbb109d8f43d96682 [id=5d7d7235935340089195e54e50d9bc32]). Expected version 1 got 0
I20250625 14:02:06.952105 14055 raft_consensus.cc:491] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.952193 14055 raft_consensus.cc:513] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
W20250625 14:02:06.952454 11525 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da13ef9a09204e518be07bb0db018d7f consensus state has no leader
I20250625 14:02:06.952566 14055 leader_election.cc:290] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.953002 13908 raft_consensus.cc:491] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.953100 13908 raft_consensus.cc:513] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.953471 13908 leader_election.cc:290] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.954025 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41eb1c8d2afa4a4593a466bffae5dc23" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.954475 11920 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41eb1c8d2afa4a4593a466bffae5dc23" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
W20250625 14:02:06.954654 11524 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21b0e99fed5e410b964ca71432a2a704 consensus state has no leader
W20250625 14:02:06.954841 11990 leader_election.cc:343] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
W20250625 14:02:06.954886 11717 leader_election.cc:343] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.955011 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41eb1c8d2afa4a4593a466bffae5dc23" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.955116 12044 raft_consensus.cc:2466] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56419e38d8e34f6985d4d970c1ce76e5 in term 0.
I20250625 14:02:06.955191 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41eb1c8d2afa4a4593a466bffae5dc23" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.955272 12177 ts_tablet_manager.cc:1918] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.955307 11782 raft_consensus.cc:2466] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a003e25dbf461ebec24a29ad7016ed in term 0.
I20250625 14:02:06.955343 12177 log.cc:1199] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/a753b44395994a4abaaa96fb9b6d594a
I20250625 14:02:06.955570 12177 ts_tablet_manager.cc:1939] T a753b44395994a4abaaa96fb9b6d594a P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.955780 11717 leader_election.cc:304] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.956210 14055 raft_consensus.cc:2802] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.956199 11993 leader_election.cc:304] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed; no voters: bfff52620fea460d850827814b790c35
I20250625 14:02:06.956269 14055 raft_consensus.cc:491] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.956312 14055 raft_consensus.cc:3058] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.956463 13232 raft_consensus.cc:2802] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250625 14:02:06.956516 13232 raft_consensus.cc:491] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250625 14:02:06.956554 13232 raft_consensus.cc:3058] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.957347 14055 raft_consensus.cc:513] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.957620 14055 leader_election.cc:290] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Requested vote from peers bfff52620fea460d850827814b790c35 (127.11.39.130:45381), 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921)
I20250625 14:02:06.957648 13232 raft_consensus.cc:513] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:06.958039 13232 leader_election.cc:290] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Requested vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.960346 11919 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41eb1c8d2afa4a4593a466bffae5dc23" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.960641 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41eb1c8d2afa4a4593a466bffae5dc23" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5"
W20250625 14:02:06.960695 11717 leader_election.cc:343] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.960772 11782 raft_consensus.cc:2391] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 87a003e25dbf461ebec24a29ad7016ed in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:06.961288 12177 tablet_replica.cc:331] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.961485 12177 raft_consensus.cc:2241] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
W20250625 14:02:06.962146 11532 catalog_manager.cc:5842] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee8757ca1f064d259b1dca36c431a0c2 consensus state has no leader
I20250625 14:02:06.962164 12177 pending_rounds.cc:70] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:06.962220 12177 pending_rounds.cc:77] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523078321737728 op_type: NO_OP noop_request { }
I20250625 14:02:06.962265 12177 raft_consensus.cc:2887] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:06.962314 12177 raft_consensus.cc:2270] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.962570 11916 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41eb1c8d2afa4a4593a466bffae5dc23" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35"
I20250625 14:02:06.962940 12047 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "41eb1c8d2afa4a4593a466bffae5dc23" candidate_uuid: "56419e38d8e34f6985d4d970c1ce76e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed"
I20250625 14:02:06.963065 12047 raft_consensus.cc:2391] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56419e38d8e34f6985d4d970c1ce76e5 in current term 1: Already voted for candidate 87a003e25dbf461ebec24a29ad7016ed in this term.
I20250625 14:02:06.963306 11920 raft_consensus.cc:3058] T fddd9a629d984649ad92c8f4fe52e114 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.963856 12177 ts_tablet_manager.cc:1905] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250625 14:02:06.963886 11990 leader_election.cc:343] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:06.963955 11990 leader_election.cc:304] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:06.964485 13232 raft_consensus.cc:2747] T 41eb1c8d2afa4a4593a466bffae5dc23 P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.964931 13855 consensus_queue.cc:1035] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.965147 11717 leader_election.cc:304] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56419e38d8e34f6985d4d970c1ce76e5; no voters: 87a003e25dbf461ebec24a29ad7016ed, bfff52620fea460d850827814b790c35
I20250625 14:02:06.965281 13855 raft_consensus.cc:2747] T 41eb1c8d2afa4a4593a466bffae5dc23 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.966563 11528 catalog_manager.cc:5582] T cdbebbb725564dc98c30ce4bbd3af8db P 87a003e25dbf461ebec24a29ad7016ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131). New cstate: current_term: 1 leader_uuid: "87a003e25dbf461ebec24a29ad7016ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:06.966774 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet cdbebbb725564dc98c30ce4bbd3af8db (table default.Table_67c0588df36842488fcf1789bb9e0c88 [id=ca4d9657d22c41cb8df831d8a7470745]). Expected version 2 got 0
I20250625 14:02:06.966956 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
I20250625 14:02:06.967046 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 6d43d6332c6046b3a9171f93335e72fd (table default.Table_8ff447c86dfe4b5196d270ccc4247395 [id=c43c12f7088042ed8ce964bb3a28a967]). Expected version 1 got 0
I20250625 14:02:06.967141 11528 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet 13a2c2f498e24f47a12181a89dcbd769 (table default.Table_c2fa6c9333664dedaedb249e523d7f55 [id=21a50fe75ad14d07b605f238ce89ca09]). Expected version 1 got 0
I20250625 14:02:06.971634 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
I20250625 14:02:06.971899 11527 catalog_manager.cc:5582] T 16b68e0df99d4a1b8744b52d175b2eb2 P bfff52620fea460d850827814b790c35 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfff52620fea460d850827814b790c35 (127.11.39.130). New cstate: current_term: 1 leader_uuid: "bfff52620fea460d850827814b790c35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } health_report { overall_health: HEALTHY } } }
I20250625 14:02:06.972240 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet c188bc758a4c4a71a5550fc11fe59b1a (table default.Table_cabcd06410bc4ee282294a6d0f1b2fe7 [id=8030abc171274e888b1dc6dd7b57b98d]). Expected version 1 got 0
I20250625 14:02:06.972332 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet 8b7f27723e424ae9900b11ef0781533b (table default.Table_240eff761a9d4c4c8d44f3e36ffe1d7d [id=0d2976b736fb4eb5a4cc83a8a793dc21]). Expected version 1 got 0
I20250625 14:02:06.972402 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet fddd9a629d984649ad92c8f4fe52e114 (table default.Table_6ddf39e5d36e4f2dbae8115326df5d33 [id=db2d7f8c45ba4676b4fa1da5714279df]). Expected version 1 got 0
I20250625 14:02:06.974634 12177 ts_tablet_manager.cc:1918] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.974721 12177 log.cc:1199] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b345695e57a24b09aff2b8e00bf0fbdf
I20250625 14:02:06.974979 12177 ts_tablet_manager.cc:1939] T b345695e57a24b09aff2b8e00bf0fbdf P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.975674 12177 tablet_replica.cc:331] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.975886 12177 raft_consensus.cc:2241] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.976158 12177 raft_consensus.cc:2270] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.976807 12177 ts_tablet_manager.cc:1905] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.977798 13855 consensus_queue.cc:1035] T fddd9a629d984649ad92c8f4fe52e114 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:06.979481 11531 catalog_manager.cc:6127] T 00000000000000000000000000000000 P 9b19d4bb9dd34b4c92dd939a17482334: default.Table_8c717c9b828a4883b08a32a81a765716 [id=44f2f74bfee54c72b3dee93db46b35e5] alter complete (version 5)
I20250625 14:02:06.980923 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet 881295234a5b4a089985382765774cd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:00 UTC) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.983110 12026 tablet_service.cc:1515] Processing DeleteTablet for tablet c4c32692666047fe9a18a75e66365e16 with delete_type TABLET_DATA_DELETED (replaced by tablet f8f4f4c9b85c4c08a386347b4164efa7) from {username='slave'} at 127.0.0.1:36272
I20250625 14:02:06.986366 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet fddd9a629d984649ad92c8f4fe52e114 (table default.Table_6ddf39e5d36e4f2dbae8115326df5d33 [id=db2d7f8c45ba4676b4fa1da5714279df]). Expected version 1 got 0
I20250625 14:02:06.986518 11527 catalog_manager.cc:5674] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
I20250625 14:02:06.986958 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
I20250625 14:02:06.987075 11531 catalog_manager.cc:5674] TS 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921) does not have the latest schema for tablet fddd9a629d984649ad92c8f4fe52e114 (table default.Table_6ddf39e5d36e4f2dbae8115326df5d33 [id=db2d7f8c45ba4676b4fa1da5714279df]). Expected version 1 got 0
I20250625 14:02:06.987687 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet 6980c62d63b34c67ad095ad9ea18a3f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 60414f22c3bd4938b11c678197e0b34c) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.987865 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet a70afbc1a02a457c9099532e16eaac48 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.987974 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 4ed7734f171f4692ba7900844100c878 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.988062 11895 tablet_service.cc:1515] Processing DeleteTablet for tablet 32e39d974af9439c873ba8ec6523c428 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.988118 11889 tablet_service.cc:1515] Processing DeleteTablet for tablet 185a1a5f14344caa89473baa57f0b02d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:02:02 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.988400 11899 tablet_service.cc:1515] Processing DeleteTablet for tablet 5a3b7cbb8e624e9da3b12a63a710710d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-06-25 14:01:59 UTC) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.988512 11890 tablet_service.cc:1515] Processing DeleteTablet for tablet c767ef4cab694e09866524f84a429da7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1b9e127f181474fa1571efd76a99536) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.988600 11892 tablet_service.cc:1515] Processing DeleteTablet for tablet c4c32692666047fe9a18a75e66365e16 with delete_type TABLET_DATA_DELETED (replaced by tablet f8f4f4c9b85c4c08a386347b4164efa7) from {username='slave'} at 127.0.0.1:33946
I20250625 14:02:06.989037 12177 ts_tablet_manager.cc:1918] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.989166 12177 log.cc:1199] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/4ed7734f171f4692ba7900844100c878
W20250625 14:02:06.989552 14082 consensus_queue.cc:1162] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfff52620fea460d850827814b790c35" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250625 14:02:06.989748 12177 ts_tablet_manager.cc:1939] T 4ed7734f171f4692ba7900844100c878 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.990753 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet a951fa8b0cab485f9c221367c029fa4a (table default.Table_4f9c33e79caa412db635282d0138fe92 [id=b47a27670713465f9246664bd492cd59]). Expected version 2 got 0
W20250625 14:02:06.990895 11990 consensus_peers.cc:487] T 0f49508e87b5416db9f123df898eaada P 87a003e25dbf461ebec24a29ad7016ed -> Peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Couldn't send request to peer bfff52620fea460d850827814b790c35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20250625 14:02:06.991047 11527 catalog_manager.cc:5674] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381) does not have the latest schema for tablet fddd9a629d984649ad92c8f4fe52e114 (table default.Table_6ddf39e5d36e4f2dbae8115326df5d33 [id=db2d7f8c45ba4676b4fa1da5714279df]). Expected version 1 got 0
I20250625 14:02:06.991447 12175 ts_tablet_manager.cc:1905] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.993294 12177 tablet_replica.cc:331] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:06.993418 13837 raft_consensus.cc:491] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.993474 12177 raft_consensus.cc:2241] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.993507 13837 raft_consensus.cc:513] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.993582 12177 raft_consensus.cc:2270] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.993850 13837 leader_election.cc:290] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87a003e25dbf461ebec24a29ad7016ed (127.11.39.131:34921), 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223)
I20250625 14:02:06.993935 12177 ts_tablet_manager.cc:1905] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.994477 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a3b7cbb8e624e9da3b12a63a710710d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:06.994704 12044 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "5a3b7cbb8e624e9da3b12a63a710710d" candidate_uuid: "bfff52620fea460d850827814b790c35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87a003e25dbf461ebec24a29ad7016ed" is_pre_election: true
I20250625 14:02:06.994858 12044 raft_consensus.cc:2391] T 5a3b7cbb8e624e9da3b12a63a710710d P 87a003e25dbf461ebec24a29ad7016ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfff52620fea460d850827814b790c35 in current term 1: Already voted for candidate 56419e38d8e34f6985d4d970c1ce76e5 in this term.
I20250625 14:02:06.995565 12175 ts_tablet_manager.cc:1918] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:06.995648 12175 log.cc:1199] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/0f49508e87b5416db9f123df898eaada
I20250625 14:02:06.995909 12175 ts_tablet_manager.cc:1939] T 0f49508e87b5416db9f123df898eaada P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:06.996338 11855 leader_election.cc:304] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfff52620fea460d850827814b790c35; no voters: 56419e38d8e34f6985d4d970c1ce76e5, 87a003e25dbf461ebec24a29ad7016ed
I20250625 14:02:06.996542 13837 raft_consensus.cc:3058] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Advancing to term 1
I20250625 14:02:06.996695 12177 ts_tablet_manager.cc:1918] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:06.996762 12177 log.cc:1199] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/b55487136b024aa788e31debeb1b2eca
I20250625 14:02:06.996878 12175 tablet_replica.cc:331] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:06.996968 12177 ts_tablet_manager.cc:1939] T b55487136b024aa788e31debeb1b2eca P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
I20250625 14:02:06.997041 12175 raft_consensus.cc:2241] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:06.997162 12175 raft_consensus.cc:2270] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:06.997464 13837 raft_consensus.cc:2747] T 5a3b7cbb8e624e9da3b12a63a710710d P bfff52620fea460d850827814b790c35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:06.997669 13908 raft_consensus.cc:491] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250625 14:02:06.997772 13908 raft_consensus.cc:513] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:06.997931 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 0f49508e87b5416db9f123df898eaada (table default.Table_4e68cf1c61974d0aa5f1c4bfab1c9fcf [id=f60e403ee8b148c0bba46992498547e5]) successfully deleted
I20250625 14:02:06.998142 13908 leader_election.cc:290] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223), bfff52620fea460d850827814b790c35 (127.11.39.130:45381)
I20250625 14:02:06.998390 12175 ts_tablet_manager.cc:1905] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:06.998745 11915 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d43d6332c6046b3a9171f93335e72fd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfff52620fea460d850827814b790c35" is_pre_election: true
I20250625 14:02:06.998756 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 43098f9893c84989b118eb9d24fa4d5e (DEFAULT_TABLE table=default.Table_c4645bbf5a5d493793ce383e37bcf7aa [id=d4b5f84de6d146f0aede779ab56f29fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.999226 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43098f9893c84989b118eb9d24fa4d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:06.999580 12026 tablet_service.cc:1468] Processing CreateTablet for tablet d13234164b87464897bb8dc73e74aa17 (DEFAULT_TABLE table=default.Table_bc5a26df1c7e4b1789e21dd84d5cfa6c [id=dcf68474e2af4482a8e349df4d088a00]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:06.999850 11890 tablet_service.cc:1468] Processing CreateTablet for tablet d13234164b87464897bb8dc73e74aa17 (DEFAULT_TABLE table=default.Table_bc5a26df1c7e4b1789e21dd84d5cfa6c [id=dcf68474e2af4482a8e349df4d088a00]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.000080 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13234164b87464897bb8dc73e74aa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.001385 12175 ts_tablet_manager.cc:1918] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:07.001453 12175 log.cc:1199] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/60ca3a1ea9b944a2a1830cad6cee3cff
I20250625 14:02:07.001677 12175 ts_tablet_manager.cc:1939] T 60ca3a1ea9b944a2a1830cad6cee3cff P bfff52620fea460d850827814b790c35: Deleting consensus metadata
W20250625 14:02:07.002172 11990 leader_election.cc:343] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfff52620fea460d850827814b790c35 (127.11.39.130:45381): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:07.002590 13855 consensus_queue.cc:1035] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250625 14:02:07.002930 11782 tablet_service.cc:1813] Received RequestConsensusVote() RPC: tablet_id: "6d43d6332c6046b3a9171f93335e72fd" candidate_uuid: "87a003e25dbf461ebec24a29ad7016ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56419e38d8e34f6985d4d970c1ce76e5" is_pre_election: true
I20250625 14:02:07.003190 12177 tablet_replica.cc:331] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: stopping tablet replica
I20250625 14:02:07.003261 12028 tablet_service.cc:1468] Processing CreateTablet for tablet 4594d18314ec4584a21c9bc433d046a6 (DEFAULT_TABLE table=default.Table_3c4fe503497f42e7aafa2f6d65f8e47f [id=a331a6f30a5f4515a728659447741d0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.003430 12177 raft_consensus.cc:2241] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: Raft consensus shutting down.
I20250625 14:02:07.003636 12177 pending_rounds.cc:70] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Trying to abort 1 pending ops.
I20250625 14:02:07.003589 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 4594d18314ec4584a21c9bc433d046a6 (DEFAULT_TABLE table=default.Table_3c4fe503497f42e7aafa2f6d65f8e47f [id=a331a6f30a5f4515a728659447741d0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.003734 12177 pending_rounds.cc:77] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7171523078492770304 op_type: NO_OP noop_request { }
I20250625 14:02:07.003836 12177 raft_consensus.cc:2887] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250625 14:02:07.003943 12177 raft_consensus.cc:2270] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:07.003968 12027 tablet_service.cc:1468] Processing CreateTablet for tablet 82ac196ab2744048aefd798ba2c52537 (DEFAULT_TABLE table=default.Table_337b4d633c9645dca88b5b53c38f21dc [id=2c02e09b59274301aafc3eabb967383e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.004281 11892 tablet_service.cc:1468] Processing CreateTablet for tablet 82ac196ab2744048aefd798ba2c52537 (DEFAULT_TABLE table=default.Table_337b4d633c9645dca88b5b53c38f21dc [id=2c02e09b59274301aafc3eabb967383e]), partition=RANGE (key) PARTITION UNBOUNDED
W20250625 14:02:07.004361 11993 leader_election.cc:343] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): Illegal state: must be running to vote when last-logged opid is not known
I20250625 14:02:07.004424 11993 leader_election.cc:304] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87a003e25dbf461ebec24a29ad7016ed; no voters: 56419e38d8e34f6985d4d970c1ce76e5, bfff52620fea460d850827814b790c35
I20250625 14:02:07.004637 13232 raft_consensus.cc:2747] T 6d43d6332c6046b3a9171f93335e72fd P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250625 14:02:07.004769 12019 tablet_service.cc:1468] Processing CreateTablet for tablet d2642df27bcb4708ae2162b612c0c09a (DEFAULT_TABLE table=default.Table_d4df400c852740fbaf7dbb91497de8d5 [id=6af82a93ea5a4f9e8951cb2cf5ad7327]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.005028 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4594d18314ec4584a21c9bc433d046a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.005077 11899 tablet_service.cc:1468] Processing CreateTablet for tablet d2642df27bcb4708ae2162b612c0c09a (DEFAULT_TABLE table=default.Table_d4df400c852740fbaf7dbb91497de8d5 [id=6af82a93ea5a4f9e8951cb2cf5ad7327]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.005293 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2642df27bcb4708ae2162b612c0c09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.005786 12175 tablet_replica.cc:331] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: stopping tablet replica
I20250625 14:02:07.005913 12175 raft_consensus.cc:2241] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250625 14:02:07.005889 11517 catalog_manager.cc:4928] TS bfff52620fea460d850827814b790c35 (127.11.39.130:45381): tablet 60ca3a1ea9b944a2a1830cad6cee3cff (table default.Table_ba6488926235441ea0f1a8d78706f1d6 [id=8a0d72a771cc4aea88a1e400245cb1f8]) successfully deleted
I20250625 14:02:07.006017 12175 raft_consensus.cc:2270] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250625 14:02:07.006413 12175 ts_tablet_manager.cc:1905] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:07.006470 12025 tablet_service.cc:1468] Processing CreateTablet for tablet f0d4bbb734dd4f2e98fdf9fd1b16cd8e (DEFAULT_TABLE table=default.Table_622d35123f4842a881aba8df38eb071f [id=f317c0ab26d34b9d84b06b4f46934a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.006793 11889 tablet_service.cc:1468] Processing CreateTablet for tablet f0d4bbb734dd4f2e98fdf9fd1b16cd8e (DEFAULT_TABLE table=default.Table_622d35123f4842a881aba8df38eb071f [id=f317c0ab26d34b9d84b06b4f46934a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.007642 11892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ac196ab2744048aefd798ba2c52537. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.008126 12020 tablet_service.cc:1468] Processing CreateTablet for tablet f9324c1881d643f099f250ec647b3aab (DEFAULT_TABLE table=default.Table_76e2745232164aeb8c602c3702e616cf [id=58eb437b92be479098fbf06ec70b1baf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.008734 11895 tablet_service.cc:1468] Processing CreateTablet for tablet f9324c1881d643f099f250ec647b3aab (DEFAULT_TABLE table=default.Table_76e2745232164aeb8c602c3702e616cf [id=58eb437b92be479098fbf06ec70b1baf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.008944 11895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9324c1881d643f099f250ec647b3aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.011958 12031 tablet_service.cc:1468] Processing CreateTablet for tablet 8727d01c8f794ec1939846f4bfb9194a (DEFAULT_TABLE table=default.Table_bc0e4c79bfa64b45bb0f39f20012635e [id=a2f01b89ef8a45c4b2f9780578d88480]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.012415 11899 tablet_service.cc:1468] Processing CreateTablet for tablet 8727d01c8f794ec1939846f4bfb9194a (DEFAULT_TABLE table=default.Table_bc0e4c79bfa64b45bb0f39f20012635e [id=a2f01b89ef8a45c4b2f9780578d88480]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.012671 11899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8727d01c8f794ec1939846f4bfb9194a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.013206 12177 ts_tablet_manager.cc:1905] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250625 14:02:07.013278 12172 tablet_bootstrap.cc:492] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:07.013363 12172 ts_tablet_manager.cc:1397] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.177s user 0.002s sys 0.000s
I20250625 14:02:07.013895 12172 raft_consensus.cc:357] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:07.014003 12172 raft_consensus.cc:383] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:07.014031 12172 raft_consensus.cc:738] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:07.014154 12172 consensus_queue.cc:260] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:07.014503 12172 ts_tablet_manager.cc:1428] T 5d676d411a34492c8b269a64a62fa4af P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:07.014868 12172 tablet_bootstrap.cc:492] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5: Bootstrap starting.
I20250625 14:02:07.015249 12034 tablet_service.cc:1468] Processing CreateTablet for tablet 3da18e1a390c4f198340af55217ef9cb (DEFAULT_TABLE table=default.Table_803deaef2bc34cf3ae96731d810e19e4 [id=a567d4195a6c46b08a4de0fdf34db0e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.015893 12172 tablet_bootstrap.cc:654] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:07.016253 12177 ts_tablet_manager.cc:1918] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:07.016317 12177 log.cc:1199] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-0/wal/wals/c767ef4cab694e09866524f84a429da7
I20250625 14:02:07.016383 11889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d4bbb734dd4f2e98fdf9fd1b16cd8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.017163 12177 ts_tablet_manager.cc:1939] T c767ef4cab694e09866524f84a429da7 P 56419e38d8e34f6985d4d970c1ce76e5: Deleting consensus metadata
W20250625 14:02:07.018062 11427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.11.39.129:44223, user_credentials={real_user=slave}} blocked reactor thread for 76667.6us
I20250625 14:02:07.018561 11890 tablet_service.cc:1468] Processing CreateTablet for tablet 3da18e1a390c4f198340af55217ef9cb (DEFAULT_TABLE table=default.Table_803deaef2bc34cf3ae96731d810e19e4 [id=a567d4195a6c46b08a4de0fdf34db0e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250625 14:02:07.018935 11890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da18e1a390c4f198340af55217ef9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.019013 12172 tablet_bootstrap.cc:492] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5: No bootstrap required, opened a new log
I20250625 14:02:07.019094 12172 ts_tablet_manager.cc:1397] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250625 14:02:07.019534 12172 raft_consensus.cc:357] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:07.019632 12172 raft_consensus.cc:383] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:07.019661 12172 raft_consensus.cc:738] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56419e38d8e34f6985d4d970c1ce76e5, State: Initialized, Role: FOLLOWER
I20250625 14:02:07.019784 12172 consensus_queue.cc:260] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:07.020074 12172 ts_tablet_manager.cc:1428] T 32dd38cbe4634d3e97d657a8a4129039 P 56419e38d8e34f6985d4d970c1ce76e5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:07.021515 12175 ts_tablet_manager.cc:1918] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250625 14:02:07.021584 12175 log.cc:1199] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-1/wal/wals/c06757067b3e465f8239b9ff38b68071
I20250625 14:02:07.021783 12175 ts_tablet_manager.cc:1939] T c06757067b3e465f8239b9ff38b68071 P bfff52620fea460d850827814b790c35: Deleting consensus metadata
I20250625 14:02:07.023856 12173 ts_tablet_manager.cc:1918] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250625 14:02:07.023989 12173 log.cc:1199] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: Deleting WAL directory at /tmp/dist-test-taskc2VY_P/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1750860110678810-11422-0/minicluster-data/ts-2/wal/wals/31f843108ecf440090c05255afa1687e
I20250625 14:02:07.024291 12173 ts_tablet_manager.cc:1939] T 31f843108ecf440090c05255afa1687e P 87a003e25dbf461ebec24a29ad7016ed: Deleting consensus metadata
I20250625 14:02:07.027176 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13234164b87464897bb8dc73e74aa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.027853 12167 tablet_bootstrap.cc:492] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed: No bootstrap required, opened a new log
I20250625 14:02:07.027957 12167 ts_tablet_manager.cc:1397] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed: Time spent bootstrapping tablet: real 0.111s user 0.001s sys 0.002s
I20250625 14:02:07.028499 12167 raft_consensus.cc:357] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:07.028623 12167 raft_consensus.cc:383] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:07.028659 12167 raft_consensus.cc:738] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a003e25dbf461ebec24a29ad7016ed, State: Initialized, Role: FOLLOWER
I20250625 14:02:07.028776 12167 consensus_queue.cc:260] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } }
I20250625 14:02:07.029081 12167 ts_tablet_manager.cc:1428] T 32dd38cbe4634d3e97d657a8a4129039 P 87a003e25dbf461ebec24a29ad7016ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250625 14:02:07.029289 12167 tablet_bootstrap.cc:492] T f7808bed1b8f4103bf728b8a525dad5d P 87a003e25dbf461ebec24a29ad7016ed: Bootstrap starting.
I20250625 14:02:07.029522 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4594d18314ec4584a21c9bc433d046a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.030277 12167 tablet_bootstrap.cc:654] T f7808bed1b8f4103bf728b8a525dad5d P 87a003e25dbf461ebec24a29ad7016ed: Neither blocks nor log segments found. Creating new log.
I20250625 14:02:07.031798 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ac196ab2744048aefd798ba2c52537. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.027221 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 185a1a5f14344caa89473baa57f0b02d (table default.Table_65610e9b154a415e81112beb1f0412b4 [id=2efaf3cfcced4f92a53e106561ccec60]) successfully deleted
I20250625 14:02:07.033084 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet c4c32692666047fe9a18a75e66365e16 (table default.Table_312ca07ca7b941c4a2dae1ae52c46b56 [id=44291c78dc3e4c0b9f1e81a9b8907e3f]) successfully deleted
I20250625 14:02:07.033217 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet a753b44395994a4abaaa96fb9b6d594a (table default.Table_d61d2d203bec435bb70dc93c563fd08f [id=50267944f4e24298b94151d9f1a1563f]) successfully deleted
W20250625 14:02:07.033341 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 55ede5e94e12449abbbec9146331deb5 because the tablet was not found. No further retry: Not found: Tablet not found: 55ede5e94e12449abbbec9146331deb5
I20250625 14:02:07.033449 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b345695e57a24b09aff2b8e00bf0fbdf (table default.Table_40002fc3ebb64224b030b871c7a3dd5f [id=0b16c8212aad40b6bd5289f62521c039]) successfully deleted
I20250625 14:02:07.033507 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2642df27bcb4708ae2162b612c0c09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.033543 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet 4ed7734f171f4692ba7900844100c878 (table default.Table_adab8acd3bfa4278a0007fbcaa2a79c8 [id=a4421b5e7a1845c2b92f8635993abec1]) successfully deleted
I20250625 14:02:07.033627 11520 catalog_manager.cc:4928] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): tablet b55487136b024aa788e31debeb1b2eca (table default.Table_418c3536c18d47b6ba687faf26494aec [id=2a1a9f6617b14b9791434d1474b48ea3]) successfully deleted
W20250625 14:02:07.033730 11520 catalog_manager.cc:4895] TS 56419e38d8e34f6985d4d970c1ce76e5 (127.11.39.129:44223): delete failed for tablet 31f843108ecf440090c05255afa1687e because the tablet was not found. No further retry: Not found: Tablet not found: 31f843108ecf440090c05255afa1687e
W20250625 14:02:07.033810 11520 connection.cc:537] client connection to 127.11.39.190:38199 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250625 14:02:07.033860 11520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
I20250625 14:02:07.034865 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d4bbb734dd4f2e98fdf9fd1b16cd8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.035019 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8727d01c8f794ec1939846f4bfb9194a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.035225 11531 master_service.cc:948] ReplaceTablet: received request to replace tablet 1a0f1ff588d741c59633ca693573a32f from {username='slave'} at 127.0.0.1:57414
I20250625 14:02:07.035465 12166 tablet_bootstrap.cc:492] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35: No bootstrap required, opened a new log
I20250625 14:02:07.035552 12166 ts_tablet_manager.cc:1397] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35: Time spent bootstrapping tablet: real 0.119s user 0.002s sys 0.000s
I20250625 14:02:07.035742 11530 catalog_manager.cc:2232] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57414:
name: "default.Table_c4ca15f0e5a84ba7a4ce7eb8c2cb6160"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250625 14:02:07.036001 11528 master_service.cc:948] ReplaceTablet: received request to replace tablet 4fd2ee633d464f7c8be1f06da7be0c70 from {username='slave'} at 127.0.0.1:57414
W20250625 14:02:07.036190 11530 catalog_manager.cc:6944] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4ca15f0e5a84ba7a4ce7eb8c2cb6160 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250625 14:02:07.036140 12166 raft_consensus.cc:357] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:07.036263 12166 raft_consensus.cc:383] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250625 14:02:07.036298 12166 raft_consensus.cc:738] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfff52620fea460d850827814b790c35, State: Initialized, Role: FOLLOWER
I20250625 14:02:07.036386 11528 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cdfd8561a4094060b384a27b86b5db6d" } modify_external_catalogs: true
I20250625 14:02:07.036435 12166 consensus_queue.cc:260] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56419e38d8e34f6985d4d970c1ce76e5" member_type: VOTER last_known_addr { host: "127.11.39.129" port: 44223 } } peers { permanent_uuid: "bfff52620fea460d850827814b790c35" member_type: VOTER last_known_addr { host: "127.11.39.130" port: 45381 } } peers { permanent_uuid: "87a003e25dbf461ebec24a29ad7016ed" member_type: VOTER last_known_addr { host: "127.11.39.131" port: 34921 } }
I20250625 14:02:07.036469 11528 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_cdfd8561a4094060b384a27b86b5db6d" } modify_external_catalogs: true
I20250625 14:02:07.036743 12166 ts_tablet_manager.cc:1428] T cdbebbb725564dc98c30ce4bbd3af8db P bfff52620fea460d850827814b790c35: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250625 14:02:07.036918 12166 tablet_bootstrap.cc:492] T 41eb1c8d2afa4a4593a466bffae5dc23 P bfff52620fea460d850827814b790c35: Bootstrap starting.
I20250625 14:02:07.036996 11533 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_337b4d633c9645dca88b5b53c38f21dc" } modify_external_catalogs: true
I20250625 14:02:07.037091 11533 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_337b4d633c9645dca88b5b53c38f21dc" } modify_external_catalogs: true
I20250625 14:02:07.037211 11532 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe" } modify_external_catalogs: true
I20250625 14:02:07.037284 11532 catalog_manager.cc:2730] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_7983c50f08204a96b0cbf2b0ad3f8ffe" } modify_external_catalogs: true
I20250625 14:02:07.037441 12020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9324c1881d643f099f250ec647b3aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250625 14:02:07.037869 11529 catalog_manager.cc:2482] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57414:
table { table_name: "default.Table_08cfffe10d4f4a7bbad590562e90eddd"